Yes, the paper clip reference wasn’t the only point I was trying to make; it was just a (failed) cherry on top. I mainly took issue with being revived in the common dystopian vision: constant states of warfare, violence, and so on. It simply isn’t possible, given that you need to keep refilling dewars with LN2 and so much more; in other words, the chain of care would be disrupted, and you would be dead long before they found a way to resuscitate you. And that leaves basically only a sudden “I Have No Mouth” scenario; i.e. one day it’s sunny, Alcor is fondly taking care of your dewar, and then BAM! you’ve been resuscitated by that A.I. I guess I just find it unlikely that such an A.I. will say: “I will find Yvain, resuscitate him, and torture him.” It just seems like a waste of energy.
What you’re describing is an evil AI, not just an unFriendly one—unFriendly AI doesn’t care about your values. Wouldn’t an evil AI be even harder to achieve than a Friendly one?
It would take quite a black swan tech to undo all the good from tech up to this point. UFAI probably wouldn’t pass the test, since without tech humans would go extinct with a smaller total population of lives lived anyway. Hell worlds seem unlikely. 1984 or the Brave New World (roughly) are a bit more likely, but is it worse than extinction? I don’t generally feel that way, though I’m not sure.
This has been discussed here. Enoosti:
This has also been discussed here. humpolec:
It has also been discussed here. Michael Vassar: