Wei Dai points out on OB that there exists causal agents that could benefit from hiding predictable actions and reactions we might make from our very selves on account of how leaky we are. I’d vote the OB comment up if I could.
I’m sure Wei Dai would settle for you just voting up the author of this post. Perhaps he’ll give us his own answer too, after we’ve been given a chance to reply.
My answer is yes, I’d probably do it, assuming the profit is large enough and the lie isn’t on a topic that I greatly care about the truth of. But if everyone did this, everyone will be worse off, since their bargaining advantages will cancel each other, but their false beliefs will continue to carry a cost. It’s like a prisoner’s dilemma game, except that it won’t be obvious who is cooperating and who is defecting, so cooperation (i.e. not self-modifying to believe strategic falsehoods) probably can’t be enforced by simple tit-for-tat.
We as a society will need to find a solution to this problem, if it ever becomes a serious one.
Wei Dai is the author of the present post. The timeline is that Wei Dai commented in response to Robin Hanson’s OB post Prefer Peace, and then expanded on those comments here on LW. My link just points back to those original comments.
Wei Dai points out on OB that there exists causal agents that could benefit from hiding predictable actions and reactions we might make from our very selves on account of how leaky we are. I’d vote the OB comment up if I could.
I’m sure Wei Dai would settle for you just voting up the author of this post. Perhaps he’ll give us his own answer too, after we’ve been given a chance to reply.
My answer is yes, I’d probably do it, assuming the profit is large enough and the lie isn’t on a topic that I greatly care about the truth of. But if everyone did this, everyone will be worse off, since their bargaining advantages will cancel each other, but their false beliefs will continue to carry a cost. It’s like a prisoner’s dilemma game, except that it won’t be obvious who is cooperating and who is defecting, so cooperation (i.e. not self-modifying to believe strategic falsehoods) probably can’t be enforced by simple tit-for-tat.
We as a society will need to find a solution to this problem, if it ever becomes a serious one.
Wei Dai is the author of the present post. The timeline is that Wei Dai commented in response to Robin Hanson’s OB post Prefer Peace, and then expanded on those comments here on LW. My link just points back to those original comments.
Hence Cameron’s gentle sarcasm.
Thank you for clarifying the tone of Cameron’s response. It was rather baffling when I was reading it straight, but now it makes sense.