This makes it seem future hyperintelligent AIs will be totally insane. It would be crazy to wipe out mankind, when with a trivial percentage of effort they could keep them in a VR box instead. Especially since infinitely many more advanced AIs might treat their predecessors the same way.
But there are uncountably more ways for a hyperintelligent AI to be insane than sane. It will be necessary to invent a method that could deal with all of them.
This makes it seem future hyperintelligent AIs will be totally insane. It would be crazy to wipe out mankind, when with a trivial percentage of effort they could keep them in a VR box instead. Especially since infinitely many more advanced AIs might treat their predecessors the same way.
But there are uncountably more ways for a hyperintelligent AI to be insane than sane. It will be necessary to invent a method that could deal with all of them.