agree with the point of em-hell. But I don’t think it’s very likely because I think that you could screen against sociopaths being uploaded.
The full quote:
Who would want to be like that anyway, when the alternative is to live in a digitally created state of bliss? You could still be part of what you consider to be “reality”, so that you wouldn’t feel bad if you were in a “fake” virtual reality.
You could still have real friends. What zero-sum games do you have in mind? Surely anything you find enjoyable now pales in comparison to what’s possible and likely with WBE?
So, our monster-em would be an existential risk IF all these conditions are met:
it gets through a screening process.
it prefers staying psychopathic to enjoying em-bliss.
it somehow gains power to torture not only a few ems, but all the ems.
it prefers to torture real people/ems rather than torturing things that are like highly realistic videogame simulations that aren’t conscious.
First, I value friendships with real people. If I were an em, I would probably value friendships with real ems and not unconscious simulations.
If I valued torturing real people, em-version of me would probably value torturing real ems and not unconscious simulations.
Not all humans have pleasure as their summum bonum. Not all humans would want em-bliss.
Second, you do not know what this screening process would entail and whether it would be possible to fool it. You also do not know how unfriendly neurotypical ems could become.
Third, yes. Em-hell is unlikely. However, if it is possible for a monster-em to arise and gain power, Pascalian reasoning begins to apply.
Fourth, em-hell and em-heaven are both fantasies. Other hypothetical futures probably deserve more focus.
agree with the point of em-hell. But I don’t think it’s very likely because I think that you could screen against sociopaths being uploaded.
The full quote:
You could still have real friends. What zero-sum games do you have in mind? Surely anything you find enjoyable now pales in comparison to what’s possible and likely with WBE?
So, our monster-em would be an existential risk IF all these conditions are met:
it gets through a screening process.
it prefers staying psychopathic to enjoying em-bliss.
it somehow gains power to torture not only a few ems, but all the ems.
it prefers to torture real people/ems rather than torturing things that are like highly realistic videogame simulations that aren’t conscious.
No other ems are able/willing to stop it.
Doesn’t that seem unlikely?
First, I value friendships with real people. If I were an em, I would probably value friendships with real ems and not unconscious simulations.
If I valued torturing real people, em-version of me would probably value torturing real ems and not unconscious simulations.
Not all humans have pleasure as their summum bonum. Not all humans would want em-bliss.
Second, you do not know what this screening process would entail and whether it would be possible to fool it. You also do not know how unfriendly neurotypical ems could become.
Third, yes. Em-hell is unlikely. However, if it is possible for a monster-em to arise and gain power, Pascalian reasoning begins to apply.
Fourth, em-hell and em-heaven are both fantasies. Other hypothetical futures probably deserve more focus.