My comment had an important typo, sorry: I meant to write that I hadn’t noticed this through-line before!
I mostly agree with you re: Einstein, but I do think that removing the overstatement changes the conclusion in an important way. Narrowing the search space from (say) thousands of candidate theories to just 4 is an great achievement, but you still need a method of choosing among them, not just to fulfill the persuasive social ritual of Science but because otherwise you have a 3 in 4 chance of being wrong. Even someone who trusts you can’t update that much on those odds. That’s really different from being able to narrow the search space down to just 1 theory; at that point, we can trust you—and better still, you can trust yourself! But the history of science doesn’t, so far as I can tell, contain any “called shots” of this type; Einstein might literally have set the bar.
I think we disagree on Yudkowsky’s conclusion: his point IMO is that Einstein was able to reduce the search space a lot. He overemphasize for effect (and because it’s more impressive to have someone who guesses right directly through these methods), but that doesn’t change that Einstein reduced the state space a lot (which you seem to agree with).
Many of the relevant posts I quoted talk about how the mechanism of Science are fundamentally incapable of doing that, because they don’t specify any constraint on hypothesis except that they must be falsifiable. Your point seems to be that in the end, Einstein still used the sort of experimental data and methods underlying traditional Science, and I tend to agree. But the mere fact that he was able to get the right answer out of millions of possible formulations by checking a couple of numbers should tell you that there was a massive hypothesis-space reducing step before.
Nah, we’re on the same page about the conclusion; my point was more about how we should expect Yudkowsky’s conclusion to generalize into lower-data domains like AI safety. But now that I look at it that point is somewhat OT for your post, sorry.
My comment had an important typo, sorry: I meant to write that I hadn’t noticed this through-line before!
I mostly agree with you re: Einstein, but I do think that removing the overstatement changes the conclusion in an important way. Narrowing the search space from (say) thousands of candidate theories to just 4 is an great achievement, but you still need a method of choosing among them, not just to fulfill the persuasive social ritual of Science but because otherwise you have a 3 in 4 chance of being wrong. Even someone who trusts you can’t update that much on those odds. That’s really different from being able to narrow the search space down to just 1 theory; at that point, we can trust you—and better still, you can trust yourself! But the history of science doesn’t, so far as I can tell, contain any “called shots” of this type; Einstein might literally have set the bar.
I think we disagree on Yudkowsky’s conclusion: his point IMO is that Einstein was able to reduce the search space a lot. He overemphasize for effect (and because it’s more impressive to have someone who guesses right directly through these methods), but that doesn’t change that Einstein reduced the state space a lot (which you seem to agree with).
Many of the relevant posts I quoted talk about how the mechanism of Science are fundamentally incapable of doing that, because they don’t specify any constraint on hypothesis except that they must be falsifiable. Your point seems to be that in the end, Einstein still used the sort of experimental data and methods underlying traditional Science, and I tend to agree. But the mere fact that he was able to get the right answer out of millions of possible formulations by checking a couple of numbers should tell you that there was a massive hypothesis-space reducing step before.
Nah, we’re on the same page about the conclusion; my point was more about how we should expect Yudkowsky’s conclusion to generalize into lower-data domains like AI safety. But now that I look at it that point is somewhat OT for your post, sorry.