People here seem confident that there exists a decision theory immune to blackmail.
Really? I hope not. Sound like a very silly idea to me. Does that just mean unresponsive to coercion? Pretending like you never heard it? Always refusing to give in to a threat? I suppose one could program that into an AI, and when someone says to the AI, “your money or your life”, we’ll get a dead AI. Why not just program your AI to self destruct when threatened? Sometimes, knuckling under is the right call.
Sometimes. As long as it’s only sometimes, maybe you’re better off not always driving off the cliff.
I see some people recommending broadcasting your precommmitment to not knuckle under to blackmail. Not so good when you run into a blackmailer with a precommitment to always follow through. And not so good when the other guy isn’t certain about your precommitment. Or if he is just a spiteful prick. Never underestimate the power of spite.
Really? I hope not. Sound like a very silly idea to me. Does that just mean unresponsive to coercion? Pretending like you never heard it? Always refusing to give in to a threat? I suppose one could program that into an AI, and when someone says to the AI, “your money or your life”, we’ll get a dead AI. Why not just program your AI to self destruct when threatened? Sometimes, knuckling under is the right call.
...and sometimes choosing to die is.
Sometimes. As long as it’s only sometimes, maybe you’re better off not always driving off the cliff.
I see some people recommending broadcasting your precommmitment to not knuckle under to blackmail. Not so good when you run into a blackmailer with a precommitment to always follow through. And not so good when the other guy isn’t certain about your precommitment. Or if he is just a spiteful prick. Never underestimate the power of spite.