I’ve already shared that I believe there is only one way that humanity has a hope of being meaningful in a world run by ASI – Artificial Super Intelligence. In ‘Humankind’s End – Pet, Child, or Colleague?‘ I described 3 scenarios where an ASI treats us as: Pets, basically an amusing species worthy of keeping around; Children, not mature enough to make decisions for ourselves; or, Colleagues, as people worth working with.
I titled Part 3 of the post, Inevitability, and I said,
While I suspect that most of us would want the outcome to be Colleague, rather than Child or Pet, I don’t believe this is our decision.
We can try to design ASI such that it sees value in working with us, but when our intelligence compared to a super intelligent AI is the equivalent to how we look at chimps, dolphins, or Octopus, we really have to consider why they would want to integrate our intelligence with theirs? While we might look at a chimpanzee and think, “Oh how cute, that one can do sign language, and knows 350 signs,” we don’t also think, “Lets create a relations with that chimp in a way that we share intelligence with them and let them make decisions with or for us. And in the same vein, ASI is unlikely to look at a very bright human and think, “Oh how cute, that human can do abstract calculus or astrophysics in his head… let’s integrate ourselves with this simple creature.”
Ultimately, an Artificial Super Intelligence is going to make the decision. Maybe there is something unique about the human brain or the human condition that would make an ASI want to integrate with us, but we can’t pretend to know if this would be of interest to the super intelligence or not. We can only hope that’s the case. The reality is that the metaphorical water is boiling, we don’t really know when it’s going to boil, and when it does the fate of humankind will not be up to us.
Then a few days ago I went down an ‘AI doom rabbit hole‘, realizing that almost every single expert in the field of AI and AI safety have considerable concern about humanity’s fate in a world with ASI. I asked Chat GPT about this concern and got quite a lot of insight, as can be seen in the post. One thing Chat GPT said was, “My central concern isn’t that AI will suddenly become evil. It’s that humanity might build something more intelligent than itself without first figuring out how to reliably keep it aligned with human interests.”
I can’t see a scenario where human interests align with an ASI’s interest 25 years from now. For example, at that point in our future all Math and Science discoveries will be solely the work of the ASI, and the level of sophistication required to understand these new discoveries will probably be beyond the comprehension of mere mortals. So unless we are strategic, we will become pets or children in the eyes of an ASI. Our only hope is to find ways to integrate ourselves with the ASI in order to have functional use as a colleague, or at least as a useful contributor to the ASI’s future. And we can only do this if we integrate with the technology.
Why do I think this? To date, the vast majority of ways that we integrate technology with ourselves are ways to improve a deficit. We wear glasses to improve our sight, have prosthetic appendages to replace ones we’ve lost. Pacemakers, insulin pumps, and even Neuralink, a brain implant to help quadriplegics control a computer. The focus has primarily been to fix something not working as well as it should. Basically a part of normal humanity is malfunctioning and so technology is assistive in returning some form of normalcy. That’s not going to be enough for a super intelligent AI to want to work with us.
Ultimately, our future depends on us adding value to an ASI. To do this, we will need to provide something they don’t have. I think that thing will be our very efficient neural network… our brains. And to harness the value our brains provide, we are going to need to integrate with an ASI using cyborg styled technology that isn’t just assistive but works to advance what we can do, how we can communicate with, and how much value we can add to an ASI… Which will hopefully see us as a contributing colleague and not just a less intelligent species. Ultimately, being human in the 2050’s is going to be about being a cyborg, a technologically enhanced human. If we aren’t cyborg, we will be either pets or children in the eyes of a super intelligent AI, and that won’t feel human at all.




