So does the evil manipulative psychologist or the manipulative lover who convinces you to commit crimes to prove you really love them.
And it’s simply astounding some of the things unscrupulous psychologists and doctors have convinced people to do via mere suggestion. Psychologists have convinced people to sleep with their own fathers to ‘resolve’ their issues. Convincing people to do something that turns the AI into a direct (rather than indirect) agent seems fairly minor compared to what people convince each other to do all the time.
Hell, US presidents have prosecuted every major war we’ve been involved in, dropped the A-bomb, developed the H-bomb, etc… all merely by making suggestions to people. I doubt any president since Jackson has actually picked up a pistol or physically forced anyone to do anything. People are merely accustomed to doing as they suggest and that is the entirety of their power. Do you not believe people would become accustomed to just driving (or going, or doing) whatever the google recommend bot recommended?
POTUS is the commander in chief of the united states armed forces, so under the right circumstances disobeying the president’s orders could be a violation of military law ultimately punishable by death. There doesn’t have to be a gun already in hand for something to be more than a ‘suggestion.’
Correct, and upvoted for concreteness. But even if one were to be punished by death for disobeying the president’s order, how likely do you think it would be for the POTUS himself to perform the execution? I doubt even the North Korean president would bother himself with that.
Apart from scheduling problems, I’m pretty sure it would be illegal for POTUS to personally kill someone in general (apart from self defense, etc.) and in the specific case of military law, there’s still a judicial process involved.
From a game-theoretic standpoint, what does it matter whose job it is to pull the trigger, to the person considering disobedience? The credible threat is what distinguishes between manipulation and coercion, regardless of where that potential violence is being stored.
So does the evil manipulative psychologist or the manipulative lover who convinces you to commit crimes to prove you really love them.
And it’s simply astounding some of the things unscrupulous psychologists and doctors have convinced people to do via mere suggestion. Psychologists have convinced people to sleep with their own fathers to ‘resolve’ their issues. Convincing people to do something that turns the AI into a direct (rather than indirect) agent seems fairly minor compared to what people convince each other to do all the time.
Hell, US presidents have prosecuted every major war we’ve been involved in, dropped the A-bomb, developed the H-bomb, etc… all merely by making suggestions to people. I doubt any president since Jackson has actually picked up a pistol or physically forced anyone to do anything. People are merely accustomed to doing as they suggest and that is the entirety of their power. Do you not believe people would become accustomed to just driving (or going, or doing) whatever the google recommend bot recommended?
POTUS is the commander in chief of the united states armed forces, so under the right circumstances disobeying the president’s orders could be a violation of military law ultimately punishable by death. There doesn’t have to be a gun already in hand for something to be more than a ‘suggestion.’
Correct, and upvoted for concreteness. But even if one were to be punished by death for disobeying the president’s order, how likely do you think it would be for the POTUS himself to perform the execution? I doubt even the North Korean president would bother himself with that.
Apart from scheduling problems, I’m pretty sure it would be illegal for POTUS to personally kill someone in general (apart from self defense, etc.) and in the specific case of military law, there’s still a judicial process involved.
From a game-theoretic standpoint, what does it matter whose job it is to pull the trigger, to the person considering disobedience? The credible threat is what distinguishes between manipulation and coercion, regardless of where that potential violence is being stored.