Despite the simplicity prior, “this nontrivial program implements the behavior I want” almost always fails to be true because the program contains bugs. Even after you fix the bugs, it still almost always fails to be true because it contains even more bugs.
False scientific theories don’t seem to fail in quite the same ways, and I’m not sure how much of that is due to differences in the search processes versus the search spaces (e.g. physics seems quite different from Python).
Despite the simplicity prior, “this nontrivial program implements the behavior I want” almost always fails to be true because the program contains bugs. Even after you fix the bugs, it still almost always fails to be true because it contains even more bugs.
False scientific theories don’t seem to fail in quite the same ways, and I’m not sure how much of that is due to differences in the search processes versus the search spaces (e.g. physics seems quite different from Python).