Yes, and no, it does not boil down to Chalmer’s argument. (as Aaronson makes clear in the paragraph before the one you quote, where he cites the Chalmers argument!) The argument from complexity is about the nature and complexity of systems capable of playing chess—which is why I think you need to carefully read the entire piece and think about what it says.
But as a small rejoinder, if we’re talking about playing a single game, the entire argument is ridiculous; I can write the entire “algorithm” a kilobyte of specific instructions. So it’s not that an algorithm must be capable of playing multiple counterfactual games to qualify, or that counterfactuals are required for moral weight—it’s that the argument hinges on a misunderstanding of how complex different classes of system need to be to do the things they do.
PS. Apologies that the original response comes off as combative—I really think this discussion is important, and wanted to engage to correct an important point, but have very little time to do so at the moment!
Yes, and no, it does not boil down to Chalmer’s argument. (as Aaronson makes clear in the paragraph before the one you quote, where he cites the Chalmers argument!) The argument from complexity is about the nature and complexity of systems capable of playing chess—which is why I think you need to carefully read the entire piece and think about what it says.
But as a small rejoinder, if we’re talking about playing a single game, the entire argument is ridiculous; I can write the entire “algorithm” a kilobyte of specific instructions. So it’s not that an algorithm must be capable of playing multiple counterfactual games to qualify, or that counterfactuals are required for moral weight—it’s that the argument hinges on a misunderstanding of how complex different classes of system need to be to do the things they do.
PS. Apologies that the original response comes off as combative—I really think this discussion is important, and wanted to engage to correct an important point, but have very little time to do so at the moment!