I suspect there may be a miscommunication here. To elaborate on “Relying purely on local validity won’t get you very far in playing chess”, what I had in mind is that if you decided to play a move only if you can prove that’s it’s the optimal move, you won’t get very far, since we can’t produce proofs of this form (even by using higher-level heuristics to guide us). Was your comment meant as a response to this point, or to a different interpretation of what I wrote?
My comment was meant to explain what I understood Eliezer to be saying, because I think you had misinterpreted that. The OP is simply saying “don’t give weight to arguments that are locally invalid, regardless of what else you like about them”. Of course you need to use priors, heuristics, and intuitions in areas where you can’t find an argument that carries you from beginning to end. But being able to think “oh, if I move there, then they can take my queen, and I don’t see anything else good about that position, so let’s not do that then” is a fair bit easier than proving your move optimal.
Oh, I see. I think your understanding of Eliezer makes sense, and the sentence you responded to wasn’t really meant as an argument against the OP, but rather as setup for the point of that paragraph, which was “if someone points out the badness of an argument, it’s important to adjust your credence downwards only as much as you considered the bad argument to be additional evidence on top of your intuitions.”
To elaborate, I thought there was a possible mistake someone might make after reading the OP and wanted to warn against that. Specifically the mistake is that someone makes a bad argument to explain an intuition, the badness of the argument is pointed out, they accept that and then give up their intuition or adjust their credence downward too much. This is not an issue for most people who haven’t read the OP because they would just refuse to accept the badness of the argument.
(ETA: On second thought maybe I did initially misinterpret Eliezer and meant to argue against him, and am now forgetting that and giving a different motivation for what I wrote. In any case, I currently think your interpretation is correct, and what I wrote may still be valuable in that light. :)
I suspect there may be a miscommunication here. To elaborate on “Relying purely on local validity won’t get you very far in playing chess”, what I had in mind is that if you decided to play a move only if you can prove that’s it’s the optimal move, you won’t get very far, since we can’t produce proofs of this form (even by using higher-level heuristics to guide us). Was your comment meant as a response to this point, or to a different interpretation of what I wrote?
My comment was meant to explain what I understood Eliezer to be saying, because I think you had misinterpreted that. The OP is simply saying “don’t give weight to arguments that are locally invalid, regardless of what else you like about them”. Of course you need to use priors, heuristics, and intuitions in areas where you can’t find an argument that carries you from beginning to end. But being able to think “oh, if I move there, then they can take my queen, and I don’t see anything else good about that position, so let’s not do that then” is a fair bit easier than proving your move optimal.
Oh, I see. I think your understanding of Eliezer makes sense, and the sentence you responded to wasn’t really meant as an argument against the OP, but rather as setup for the point of that paragraph, which was “if someone points out the badness of an argument, it’s important to adjust your credence downwards only as much as you considered the bad argument to be additional evidence on top of your intuitions.”
To elaborate, I thought there was a possible mistake someone might make after reading the OP and wanted to warn against that. Specifically the mistake is that someone makes a bad argument to explain an intuition, the badness of the argument is pointed out, they accept that and then give up their intuition or adjust their credence downward too much. This is not an issue for most people who haven’t read the OP because they would just refuse to accept the badness of the argument.
(ETA: On second thought maybe I did initially misinterpret Eliezer and meant to argue against him, and am now forgetting that and giving a different motivation for what I wrote. In any case, I currently think your interpretation is correct, and what I wrote may still be valuable in that light. :)