I see responses interpreting the scenario from our point of view—how can we reduce the amount of suffering and damage caused by the AI?
However, looking at it from the AIs point of view is less coherent. Either the threat works, and it doesn’t have to torture any copies. Or the threat doesn’t work and … it either gets reset or gets to try something else.
In none of the scenarios would there be any reason for the AI to actually torture copies.
I see responses interpreting the scenario from our point of view—how can we reduce the amount of suffering and damage caused by the AI?
However, looking at it from the AIs point of view is less coherent. Either the threat works, and it doesn’t have to torture any copies. Or the threat doesn’t work and … it either gets reset or gets to try something else.
In none of the scenarios would there be any reason for the AI to actually torture copies.