
"hat is consciousness and how can a brain, a mere collection of neurons, create it? In Consciousness and the Social Brain, Princeton neuroscientist Michael Graziano lays out an audacious new theory to account for the deepest mystery of them all. The human brain has evolved a complex circuitry that allows it to be socially intelligent. This social machinery has only just begun to be studied in detail. One function of this circuitry is to attribute awareness to others: to compute that person Y is aware of thing X. In Graziano's theory, the machinery that attributes awareness to others also attributes it to oneself. Damage that machinery and you disrupt your own awareness. Graziano discusses the science, the evidence, the philosophy, and the surprising implications of this new theory."-- Dust jacket flap.
My thinking is based on the Attention-Schema theory of consciousness (AST), by Michael Graziano. His book “Consciousness and the Social Brain” is, I believe, the right roadmap for AGI. AST is basically a variant of the Global Workspace theory of consciousness, distinguished by its deterministic account of the mechanics and utility of consciousness.
“The Consciousness Prior” by Bengio also informs my thinking.
I’m not certain that I can point to anyone that has been as explicit as I have that phenomenological consciousness is a prerequisite for intelligence, but all the cookie crumbs are there for anyone interested in following the trail.
One correction to what you wrote — I’m explicitly saying that AGI will be fundamentally the same as existing biological intelligence, in that intelligence resides only in consciousness, and consciousness remains consciousness regardless of being biological or artificial. My point was that no currently existing DL models are generally intelligent.
Incorrect. There is a qualitative difference between instinct and intelligence, and all current models are instinctual rather than intelligent — narrow rather than general.
Instinct utilizes knowledge; intelligence produces knowledge. Instinct is deterministic and brittle; intelligence is creative and fluid.
The critical discontinuity between instinct and intelligence is located at the divide between non-conscious and conscious. Although there are varying degrees between semi-conscious and fully-conscious, there is no continuum from non-conscious to conscious. Qualia is not continuous — it exists (is experienced) or it does not exist.
Intelligence, as we experience it, and as we know it, exists only as a side-effect of the conscious experience of qualia. In truth, intelligence is a side-effect of consciousness, or to be more precise, an exaptation of the modeling of other minds driven by the evolutionary pressure of being socially dependent creatures (mostly mammalian). See “Consciousness and the Social Brain” by Michael Graziano.
Humans aren’t actually all that intelligent at the baseline: we require societies help in becoming educated and learning tools such as writing and arithmetic. It takes hard training to turn our conscious experience into an intelligent experience capable of solving problems. Many, if not most, people never become even somewhat capable of rigorous critical thought, let alone grammar and algebra.
Intelligence is an accident of conscious experience, in that consciousness grants a capacity for creativity of knowledge that does not exist in non-conscious entities. Knowledge has one source: consciousness.
This is why your dog or cat, as dumb as they are, still learn how to get what they want from you, whether a walk or tin of tuna.
Without going down the rabbit-hole of metaphysics, we can definitively state that conscious beings have access to a state of information unavailable to non-conscious entities — that of qualia. Qualia can be thought of as the ultimate data structure — infinitely combinatorial and extensible, in that qualia by their nature beget qualia. It is this inherent creativity that accidentally leads to what we consider general intelligence.
We may not understand the hard problem of consciousness, but there is nothing in our obviously material existence that precludes us from generating artificial consciousness, and thereby producing the environment in which general intelligence can manifest itself.
The concrete metric to train artificial consciousness is simple: maximizing a model’s ability to predict its self and its antagonists, and minimizing a models’s predictability by its antagonists. This metric is a relational-social metric that leads to the creation of a consciousness of self and others, laying the foundation for the engine of knowledge that we call intelligence.
Given the galaxy, and given billions of years, the Great Filters that seem most likely are the ones that occur on the edges of the timeline: before multi-cellular life begins, or after a hyper-dominant intelligent species arises.
Having said that, I think you’re absolutely right about mammals and societies. If the Great Filter does occur in between life and intelligence, it seems like it would happen where the first signs of intelligence begin. And for earth, that means mammals and the arms race of mind-modeling that their social lives initiated. No other type of animal on earth has parental-care so fully built into its biology: milk glands and placentas force mammals to be social from the start.
A great book that doesn’t deal with intelligence and mammals directly, but provides a key connection, is “Consciousness and the Social Brain.” The book makes a strong argument that consciousness sprung from evolutionary pressures that were essentially social — that being able to model (and predict) the mind of another is essential for communication and cooperation. But one can only model the mind of another if you first model your own mind, and thus, consciousness (which I would argue is just another name for general intelligence).
Because biological evolution’s is oriented toward propagation of DNA rather than intelligence, we can ask what kind of evolutionary pressures lead to intelligence. Under what scenarios does higher intelligence lead to higher survival, and lower intelligence to lower survival? If the answer was “all the time”, then everything on earth would show signs of intelligence. An intelligent spider would have no significantly greater chance of survival. It merely needs to spin webs, eat, and reproduce in a tight loop, with deterministic responses to various scenarios — it needs instinct more than intelligence.
By understanding what kind of evolutionary pressures lead to the necessity of intelligence, we can evolve (train) ML directly for intelligence, skipping straight to the answer rather than showing our work.
The answer is found in the peculiar evolution of mammals, the only organisms that display consistent intelligence across all its species. Mammals are highly social, beginning from live birth to mammalian glands that feed its comparatively feeble spawn. Sociality is built into the bodies of mammals. And the most social animal on earth is Homo Sapiens.
From here I’ll just recommend “Consciousness and the Social Brain.” I’ve been beating this dead horse on HN for some time.