I am not at all sure why the humans wouldn’t just turn the AI on again anyway if it were only 99% probable.
That’s a human institution problem, that seems more solvable (at least, we shouldn’t run the AI if it isn’t solved).
That’s a human institution problem, that seems more solvable (at least, we shouldn’t run the AI if it isn’t solved).