Of course, the rational thing to do is to convince everyone ELSE to be “superrational”, and convince them that you are ALSO “superrational”, and then defect if you actually play a prisoner’s dilemma for sufficiently high stakes.
Eliezer has done a good job of this. Hofstadter too. Inventing the term “superrationality” for “magicalthinking” was a good move.
Of course, the rational thing to do is to convince everyone ELSE to be “superrational”, and convince them that you are ALSO “superrational”, and then defect if you actually play a prisoner’s dilemma for sufficiently high stakes.
Eliezer has done a good job of this. Hofstadter too. Inventing the term “superrationality” for “magicalthinking” was a good move.