Decision-theoretically, the AI has incentive to punish you if you type “AI DESTROYED” when it’s already out of the box, in order to make you think twice about doing it in the case where it’s still contained.
I’m not sure this matters much, because if it’s unfriendly, you’re already made of atoms which it has other plans for.
I’m not sure this matters much, because if it’s unfriendly, you’re already made of atoms which it has other plans for.
That’s why torture was invented.