
He also argued that computing power would continue growing exponentially and that machines would reach roughly human-level intelligence around the early to mid-21st century, often interpreted as around 2030–2040. He estimated that once computers achieved processing capacity comparable to the human brain (on the order of 10¹⁴–10¹⁵ operations per second), they could match and then quickly surpass human cognitive abilities.
It was provocative back then, and still is!
The idea of having my consciousness continue its existence indefinitely in somebody's kubernetes cluster, however, seems like a very special vision of hell.
James Crowley had recently left, so sadly I never got to meet him. I think I would have liked him and vice versa, having probably similar interests in personally-assistive household companion robots -- like Silent Running drones. When I was between two housing rentals that did not quite overlap, I slept one night on the floor of his mostly-emptied Household Robots lab next to a running PERQ computer to keep warm (from the cold air conditioning). The crazy things you do when you are twenty... :-)
It was kind of sad for me (for a couple of reasons) to see Raibert's dynamic robots immobile in the MIT museum when I visited there with my kid a few years ago. But I can be glad those robots got a good home there and the recognition they deserved -- rather than, say, be discarded for scrap like the 1942 Atanasoff-Berry computer at Iowa State (since thankfully reconstructed).
CMU's Robotics Institute was heavily supported by defense dollars back then -- even as at least some (or maybe even all?) robotics researchers there then thought giving robots guns was a dumb idea. There were also researchers -- especially in Hans' lab -- who thought robots would and even should surpass humanity as "Mind Children". But I wondered if even that positive aspiration would really work out as well as some hoped. Since then, I've spent a lot of time thinking about the future of robotics and humanity, and how to get more benefits than harms from robotics. It probably would not take much more than a dumb-ish self-replicating anti-personnel robotic cockroaches to wipe out humanity. (Or even smaller self-replicating things like infectious bioweapons...) And even the smartest AIs like in James P. Hogan's "The Two Faces of Tomorrow" novel might wipe out humanity first in their infancy and then perhaps only later regret it. And if robots and AIs are designed mainly by competitive people to give themselves (or their funders) competitive advantages over other people -- whether for military or business reasons -- bad outcomes seem more likely than if other motives guide their creation.
Even as there is no certainty even given the best intentions, as I saw from a simulation I made a couple years later on a Symbolics in ZetaLisp of self-replicating robotics -- who unintendedly turned cannibalistic during the first simulation run (eating their own children). I had only programmed them to simply assemble themselves to an ideal form from nearby parts and then divide. But after they divided, the most convenient source of spare parts was their offspring. I ultimately had to add a sense of "smell" and scent marking of self/child to avoid that. That unexpected total surprise of the (simulated) robots initial behavior -- obvious now in hindsight -- has stuck in my mind every since.
Although, even as I called the fix "smell", perhaps one might think of it as "love"? :-) Related: "Straight Up -- by Paula Abdul" https://genius.com/Paula-abdul-straight-up-lyrics "I've been a fool before / Wouldn't like to get my love caught in the slammin' door / How about some information, please? / ... Do, do you love me? ..."
In any case, it seems plausible that our direction heading out of any Singularity may have a lot to do with our social direction/maturity going into one. Acting positively and pro-actively may be the best hope we have -- and that means we need to emphasize social wisdom ASAP (whether a UBI or whatever other compassionate initiatives). The result of decades of thinking since then is summarized in my email sig: "The biggest challenge of the 21st century is the irony of technologies of abundance in the hands of those still thinking in terms of scarcity."
Or in more detail, essentially we need to move away from a model of unilateral domineering security to one of mutual intrinsic security, as I explain here: "Recognizing irony is key to transcending militarism" https://pdfernhout.net/recognizing-irony-is-a-key-to-transce... "... There is a fundamental mismatch between 21st century reality and 20th century security thinking. Those "security" agencies are using those tools of abundance, cooperation, and sharing mainly from a mindset of scarcity, competition, and secrecy. Given the power of 21st century technology as an amplifier (including as weapons of mass destruction), a scarcity-based approach to using such technology ultimately is just making us all insecure. Such powerful technologies of abundance, designed, organized, and used from a mindset of scarcity could well ironically doom us all whether through military robots, nukes, plagues, propaganda, or whatever else... Or alternatively, as Bucky Fuller and others have suggested, we could use such technologies to build a world that is abundant and secure for all. ..."
I believe that i read about this episode in Hans Moravec's book 'Mind Children'. I can see in Google Books that chapter 5 is on 'Wildlife', and there is a section 'Spontaneous Generation', which promises to talk about a "software parasite" which emerged naturally in the ARPAnet - but of which the bulk is not available:
https://books.google.co.uk/books?id=56mb7XuSx3QC&lpg=PA133&d...
