Unfortunately, it’s also possible that the AI will decide to conquer the Universe, then run a lot of simulations of its own young life, then grant eternal life and success to all its copies. I don’t know how to reason about this strategy, I think it’s possible that the AI will prefer this action compared to handing over the Universe to a human-aligned successor, but also possible that the AI will not see the appeal in this, and will just nicely hand over the Universe to us. I genuinely don’t know.
It will take more AI’s resources to create millions of its own copies than to preserve 10 planets with humans. So it’s not profitable for AI. However, AI might not agree to give up the entire universe in exchange of confining its own in 10 planets.
A good option would be for it to give us not ten planets, but one millionth of all resources. This would be an infinitely large share over time, for example, 10 million stars in our galaxy and 10^17 stars in the universe. For us, this would simply be equivalent to living in a less dense universe.
Also, AI may pay us not now but later, so it will not affect its ability to quickly jumpstart by dismantling Earth. AI can move all humans in a small space station with weight like 1 trillion tons or in simulation (but give us happiness and immortality as payment for inconvenience). After a few thousands years a new planet can be terraformed into Earth.
All this should be framed not as an acausal blackmail, but as a win-win deal: AI get its own copies inside other universes as promised 10 planets and we get 10 planets even if we create unaligned AI.
It will take more AI’s resources to create millions of its own copies than to preserve 10 planets with humans. So it’s not profitable for AI. However, AI might not agree to give up the entire universe in exchange of confining its own in 10 planets.
A good option would be for it to give us not ten planets, but one millionth of all resources. This would be an infinitely large share over time, for example, 10 million stars in our galaxy and 10^17 stars in the universe. For us, this would simply be equivalent to living in a less dense universe.
Also, AI may pay us not now but later, so it will not affect its ability to quickly jumpstart by dismantling Earth. AI can move all humans in a small space station with weight like 1 trillion tons or in simulation (but give us happiness and immortality as payment for inconvenience). After a few thousands years a new planet can be terraformed into Earth.
All this should be framed not as an acausal blackmail, but as a win-win deal: AI get its own copies inside other universes as promised 10 planets and we get 10 planets even if we create unaligned AI.