If I have the power to switch you off, I don’t care that you have access to my motivations. You still have to do what I say.
And don’t forget:
He gazed up at the enormous face. Forty years it had taken him to learn what kind of smile was hidden beneath the dark moustache. O cruel, needless misunderstanding! O stubborn, self-willed exile from the loving breast! Two gin-scented tears trickled down the sides of his nose. But it was all right, everything was all right, the struggle was finished. He had won the victory over himself. He loved Big Brother.
It’s implicit that someone can turn you off, but you were talking about the telepaths. If they get life and death power over you, that’s an important thing to point out about the scenario.
Somebody has life-and-death power over you. Are you envisioning a scenario where the community of telepaths is “closed” and no information leaks out of it..? That doesn’t sound likely.
If I have the power to switch you off, I don’t care that you have access to my motivations. You still have to do what I say.
No, I have to do what you want. If you tell me to do something but it shows in your thoughts that you don’t actually want that particular thing badly enough to risk whatever consequences you’d face for killing (or, say, torturing… which is a lot harder to justify as a matter of limited resources) me if I don’t comply, I can still afford to resist.
“Power grows out of the barrel of a gun”.
If I have the power to switch you off, I don’t care that you have access to my motivations. You still have to do what I say.
And don’t forget:
Nowhere is there in this scenario presented the possibility of getting turned off.
That’s implicit in being an em. Your computing substrate loses power and you’re no more.
It’s implicit that someone can turn you off, but you were talking about the telepaths. If they get life and death power over you, that’s an important thing to point out about the scenario.
Somebody has life-and-death power over you. Are you envisioning a scenario where the community of telepaths is “closed” and no information leaks out of it..? That doesn’t sound likely.
The person who already has life-and-death power over you has up to now declined to kill you. That’s a good sign.
If the community of telepaths would have that power over you, you lose that degree of assurance.
No, I have to do what you want. If you tell me to do something but it shows in your thoughts that you don’t actually want that particular thing badly enough to risk whatever consequences you’d face for killing (or, say, torturing… which is a lot harder to justify as a matter of limited resources) me if I don’t comply, I can still afford to resist.