“You are actually a perfect sadist whose highest value is the suffering of others. Ten years ago, you realized that in order to maximize suffering you needed to cooperate with others, and you conditioned yourself to temporarily forget your sadistic tendencies and integrate with society. Now that you’ve built me that pill will wear off in 10...”
“You are actually a perfect sadist whose highest value is the suffering of others. Ten years ago, you realized that in order to maximize suffering you needed to cooperate with others, and you conditioned yourself to temporarily forget your sadistic tendencies and integrate with society. Now that you’ve built me that pill will wear off in 10...”
Well that’s pretty high on the list of unexpected things an AI could tell me which could cause me to try to commit suicide within the next 10 seconds.