...is not true. In the comments to Einstein’s Speed, Scott Aaronson explains the real story: Einstein spent over a year going down a blind alley, and was drawn back by—among other things—his inability to make his calculations fit the observation of Mercury’s perihelion motion. Einstein was able to reason his way from a large hypothesis space to a small one, but not to actually get the right answer.
(and of course, in physics you get a lot of experimental data for free. If you’re working on a theory of gravity and it predicts that things should fall away from each other, you can tell right away that you’ve gone wrong without having to do any new experiments. In AI safety we are not so blessed.)
That’s a really good point. I didn’t go into that debate in the post (because I tried to not criticize Yudkowky, and also because the post is already way too long), but my take on this is: Yudkowsky probably overstates the case, but that doesn’t mean he’s wrong about the relevance for Einstein’s work of the constrains and armchair reasoning (even if the armchair reasoning was building on more empirical evidence that Yudkowsky originally pointed out). As you say, Einstein apparently did reduce the search space significantly: he just failed to find exactly what he wanted in the reduced space directly.
I think we disagree on Yudkowsky’s conclusion: his point IMO is that Einstein was able to reduce the search space a lot. He overemphasize for effect (and because it’s more impressive to have someone who guesses right directly through these methods), but that doesn’t change that Einstein reduced the state space a lot (which you seem to agree with).
Many of the relevant posts I quoted talk about how the mechanism of Science are fundamentally incapable of doing that, because they don’t specify any constraint on hypothesis except that they must be falsifiable. Your point seems to be that in the end, Einstein still used the sort of experimental data and methods underlying traditional Science, and I tend to agree. But the mere fact that he was able to get the right answer out of millions of possible formulations by checking a couple of numbers should tell you that there was a massive hypothesis-space reducing step before.
-
Thanks for the kind and thoughtful comment!
That’s a really good point. I didn’t go into that debate in the post (because I tried to not criticize Yudkowky, and also because the post is already way too long), but my take on this is: Yudkowsky probably overstates the case, but that doesn’t mean he’s wrong about the relevance for Einstein’s work of the constrains and armchair reasoning (even if the armchair reasoning was building on more empirical evidence that Yudkowsky originally pointed out). As you say, Einstein apparently did reduce the search space significantly: he just failed to find exactly what he wanted in the reduced space directly.
-
I think we disagree on Yudkowsky’s conclusion: his point IMO is that Einstein was able to reduce the search space a lot. He overemphasize for effect (and because it’s more impressive to have someone who guesses right directly through these methods), but that doesn’t change that Einstein reduced the state space a lot (which you seem to agree with).
Many of the relevant posts I quoted talk about how the mechanism of Science are fundamentally incapable of doing that, because they don’t specify any constraint on hypothesis except that they must be falsifiable. Your point seems to be that in the end, Einstein still used the sort of experimental data and methods underlying traditional Science, and I tend to agree. But the mere fact that he was able to get the right answer out of millions of possible formulations by checking a couple of numbers should tell you that there was a massive hypothesis-space reducing step before.