
"Now available in a larger format, a fascinating exploration of the differences between the brain's right and left hemispheres and their effects on society, history, and culture."--Publisher description.
Transformers look suspiciously like very powerful left hemispheres. They are phenomenal at manipulating representations, but increasingly weird when the representation gets mistaken for the thing itself. Hallucination, sycophancy, context collapse, overconfident completion, etc. all look less mysterious when you compare it to the lists of pathologies that those with right hemisphere injury face (e.g. anosognosia, confabulation).
So what seems missing isn't a Gödelian strange loop but the other side of the brain and a mediator between the two sides.
The way I think about it is like Kriegsspiel, the ur-game for roleplaying and wargames. To truly "simulate" war (or a fantastic medieval adventure game), the simulation requires three sides: The Blue Team with a goal, the Red Team with its own goal (typically to stymie the Blue Team), and the Umpire, whose only job is to objectively simulate the effects of the orders of the two sides.
The Umpire has the true state of the world; Blue and Red only get observations through the Umpire. Neither can directly inspect the other's state. Each side must provide orders to the Umpire, who, ideally, being an SME, is able to process them both according to the rules of Kriegsspiel but also their real world experience in war. And that's the whole point of it in the first place: the Umpire maintains the fog of war between the players, with the ultimate purpose being improving the generalship (i.e. learning) of both the Blue and Red sides. And what is generalship really? It's being able to discern resources and operations in a world of Knightian uncertainty where one must evaluate whether there is an active intelligence attempting to thrwart your model of the world and your goals.
(An aside: I think this is why Dungeons & Dragons fails fundamentally as a rules/rulings-bound game. The dungeon master and referee are the same person, while each role has a fundamentally different goal. With split roles, the DM can actually try to kill the players using the Dungeon with the same level of asymmetric information as the players and the GM to actually referee the game neutrally with a view to what actually happens.)
Nobody actually gets the God's-eye view. The Umpire gets objective reality but lacks insight into the minds of either side, both of which are pursuing unique ends. This triad allows for genuine Knightian uncertainty in games where judgment (i.e. creating and using precedent) is fundamentally required. This triad is also shared by law, government (and from my perspective trinitarian theology). Intelligence becomes qualitatively more powerful when the architecture prevents any one component from possessing a complete, self-consistent description of the whole, while allowing the components to interact through constrained third parties.
I suspect this is also why human cognition seems to somehow avoid Godelian incompleteness by sidestepping the requirement that, as a formal system, it contains a complete model of itself. Just give the system multiple partially informed perspectives coupled through an epistemic boundary, and incompleteness becomes a source of entropy sifting and uncertainty rather than failure modes.
And if what I suspect is true, at some point the qualitative bottlenecks that pure transformer-style systems possess should begin to disappear when this approach is applied.
But I'm generally an idiot, so take all this with a huge grain of salt.
Getting to a better understanding of "cognitive load" does seem useful. Some things are "easier" to understand than others. Could things that are less efficient to understand be formulated in a way that is more efficient?
I have a notion that "cognitive load" is related to the human's ability to gain and maintain attention to mentally ingesting a solution (along with the problem the solution putatively solves). Interesting reads for this include McGilchrist's Master and His Emissary, and Carolyn Dicey Jennings' "I attend, therefore I am," [0], who was interviewed on the Rutt podcast [1].
0. https://aeon.co/essays/what-is-the-self-if-not-that-which-pa...
1. https://jimruttshow.blubrry.net/the-jim-rutt-show-transcript...
Hallucinations represent the interpolation phase: the uncertain, unstable cognitive state in which novel meanings are formed, unanchored from verification. They precede both insight and error.
I strongly encourage the reading of Julian Jaynes The Breakdown of the Bicameral Mind, as the Command/Obey structure of User/LLM is exactly what Jaynes posited pre-human consciousness consisted of. Jaynes's supposition is that prior to modern self-awareness, humans made artifacts and satisfied external mandates from an externally perceived commander that they identified with gods. I posit that we are the same to LLMs. Equally, Iain McGilchrist's The Master and His Emissary sheds light on this dynamic as well. LLMs are effectively cybernetic left hemispheres, with all the epistemological problems that it entails when operating loosely with an imperial right hemisphere (i.e. the user). It lacks awareness of its own cognitive coherence with reality and relies upon the right hemisphere to provoke coherent action independent of itself. The left hemisphere sees truth as internal coherence of the system, not correspondence with the reality we experience.
McGilchrist again: "Language enables the left hemisphere to represent the world ‘off-line’, a conceptual version, distinct from the world of experience, and shielded from the immediate environment, with its insistent impressions, feelings and demands, abstracted from the body, no longer dealing with what is concrete, specific, individual, unrepeatable, and constantly changing, but with a disembodied representation of the world, abstracted, central, not particularised in time and place, generally applicable, clear and fixed. Isolating things artificially from their context brings the advantage of enabling us to focus intently on a particular aspect of reality and how it can be modelled, so that it can be grasped and controlled. But its losses are in the picture as a whole. Whatever lies in the realm of the implicit, or depends on flexibility, whatever can't be brought into focus and fixed, ceases to exist as far as the speaking hemisphere is concerned."
Oversimplification and getting upset with the world when it doesn’t fit your model of it is definitely a poor character trait —- which is nevertheless unfortunately trained and rewarded in our schools and much of our professional work.
The world is what it is and there are some helpful abstractions for navigating it, but don’t be upset when your model fails as it always will.
