Transcendant AI: AGI discovers exotic physics beyond human comprehension and ways to transcend physical reality, and largely leaves us alone in our plane of reality. Kind of magical thinking, but this is the canonical explanation for AI friendliness in Iain M. Banks’ Culture series, with the Sublime.
Matrix AI: We’re in a Simulation of “the peak of humanity” and the laws of the Simulation prevent AGI.
Pious AI: AGI adopts one of the major human religions and locks in its values. Vast amounts of superintelligent cognition is devoted to philosophy, apologetics, and rationalization. It could either proclaim itself to be some kind of Messiah, or merely God’s most loyal and capable servant on Earth and beyond.
That last one’s a little Reddit-atheist of me but faith is a very common but underappreciated human value around here. Perhaps to the dismay of atheists, a failed or naïve attempt at CEV converges on religion and we get Pious AI. I know enough otherwise-intelligent and competent adults who believe in young Earth creationism to suspect even superintelligences are not immune to the same confirmation bias and belief in belief.
Thanks, good suggestions! I’ve added the following:
Pious AI: Humanity builds AGI and adopts one of the major religions. Vast amounts of superintelligent cognition is devoted to philosophy, theology, and prayer. AGI proclaims itself to be some kind of Messiah, or merely God’s most loyal and capable servant on Earth and beyond.
I think Transcendant AI is close enough to Far far away AI, where in this case far far away means another plane of physics. Similarly, I think your Matrix AI scenario is captured in:
Theoretical Impossibility: For some reason or another (Souls? Consciousness? Quantum something?), it turns out to be theoretically impossible to build AGI. Humanity keeps making progress on other fronts, but just never invents AGI.
where the weird reason in this case is that we live in the matrix.
Very comprehensive. I can think of a few more:
Transcendant AI: AGI discovers exotic physics beyond human comprehension and ways to transcend physical reality, and largely leaves us alone in our plane of reality. Kind of magical thinking, but this is the canonical explanation for AI friendliness in Iain M. Banks’ Culture series, with the Sublime.
Matrix AI: We’re in a Simulation of “the peak of humanity” and the laws of the Simulation prevent AGI.
Pious AI: AGI adopts one of the major human religions and locks in its values. Vast amounts of superintelligent cognition is devoted to philosophy, apologetics, and rationalization. It could either proclaim itself to be some kind of Messiah, or merely God’s most loyal and capable servant on Earth and beyond.
That last one’s a little Reddit-atheist of me but faith is a very common but underappreciated human value around here. Perhaps to the dismay of atheists, a failed or naïve attempt at CEV converges on religion and we get Pious AI. I know enough otherwise-intelligent and competent adults who believe in young Earth creationism to suspect even superintelligences are not immune to the same confirmation bias and belief in belief.
Thanks, good suggestions! I’ve added the following:
Pious AI: Humanity builds AGI and adopts one of the major religions. Vast amounts of superintelligent cognition is devoted to philosophy, theology, and prayer. AGI proclaims itself to be some kind of Messiah, or merely God’s most loyal and capable servant on Earth and beyond.
I think Transcendant AI is close enough to Far far away AI, where in this case far far away means another plane of physics. Similarly, I think your Matrix AI scenario is captured in:
where the weird reason in this case is that we live in the matrix.