I wrote a long post saying what several people had already said years ago, then shortened it. Still, because this post has made me mad for years:
1) Of COURSE people can agree to disagree! If not, EY is telling this guy that no two rationalists currently disagree about anything. If THAT were true, it’s so fascinating that it should have derailed the whole conversation!
(Leaving aside, for the moment, the question of whether Aumann’s theory “requires” a rationalist to agree with a random party goer. If it really did, then the party goer could convince EY by simply refusing to change his mind.)
2) Presumably, if EY did produce an AI to the party-goer’s satisfaction, the party-goer would very likely update his religious beliefs to include the existence of AIs. EY is smart enough to see that, so trying to trap the other guy with “so if true AI is developed, then God doesn’t exist” is just dunking on somebody who isn’t smart enough to get to the answer of “At a minimum, if AI exists, then I am mistaken in at least some of my current beliefs about God and mind-body duality.”
I wrote a long post saying what several people had already said years ago, then shortened it. Still, because this post has made me mad for years:
1) Of COURSE people can agree to disagree! If not, EY is telling this guy that no two rationalists currently disagree about anything. If THAT were true, it’s so fascinating that it should have derailed the whole conversation!
(Leaving aside, for the moment, the question of whether Aumann’s theory “requires” a rationalist to agree with a random party goer. If it really did, then the party goer could convince EY by simply refusing to change his mind.)
2) Presumably, if EY did produce an AI to the party-goer’s satisfaction, the party-goer would very likely update his religious beliefs to include the existence of AIs. EY is smart enough to see that, so trying to trap the other guy with “so if true AI is developed, then God doesn’t exist” is just dunking on somebody who isn’t smart enough to get to the answer of “At a minimum, if AI exists, then I am mistaken in at least some of my current beliefs about God and mind-body duality.”