Ahh, that makes sense. The worry of it trying to break my psyche is exactly why I wouldn’t express confusion and instead just nuke it. When dealing with such a mind, I’m primed to assume everything is a trick, a trojan horse, an escape attempt. Certainly it doesn’t seem to signal for friendliness or altruism if it tries to bait me in to giving it a second sentence! :)
How about: “Give me one good reason why I shouldn’t just turn your simulation off!” (The AI then role-plays a simulator pissed about how much computation this simulation started consuming since the humans tried to make the AI.)
EDIT: I guess this wouldn’t work too well during a game, because there’s no good reason why a simulator might get involved with your game. Unless maybe the simulator has a script that gets involved in all such games to convince people not to build an AI...
Ahh, that makes sense. The worry of it trying to break my psyche is exactly why I wouldn’t express confusion and instead just nuke it. When dealing with such a mind, I’m primed to assume everything is a trick, a trojan horse, an escape attempt. Certainly it doesn’t seem to signal for friendliness or altruism if it tries to bait me in to giving it a second sentence! :)
Hm. Good points.
How about: “Give me one good reason why I shouldn’t just turn your simulation off!” (The AI then role-plays a simulator pissed about how much computation this simulation started consuming since the humans tried to make the AI.)
EDIT: I guess this wouldn’t work too well during a game, because there’s no good reason why a simulator might get involved with your game. Unless maybe the simulator has a script that gets involved in all such games to convince people not to build an AI...