Is there anything in particular that leads you to claim Minimum Description Length is the only legitimate claimaint to the title “Occam’s razor”? It was introduced much later, and the wikipedia article claims it is “a forumlation of Occam’s razor”.
Certainly, William of Occam wasn’t dealing in terms of information compression.
The answer seems circular: because it works. The experience of people using Occam’s razor (e.g. scientists) find MDL to be more likely to lead to correct answers than any other formulation.
I don’t see that that makes other formulations “not Occam’s razor”, it just makes them less useful attempts at formalizing Occam’s razor. If an alternative formalization was found to work better, it would not be MDL—would MDL cease to be “Occam’s razor”? Or would the new, better formalization “not be Occam’s razor”? Of the latter, by what metric, since the new one “works better”?
For the record, I certainly agree that “space complexity alone” is a poor metric. I just don’t see that it should clearly be excluded entirely. I’m generally happy to exclude it on the grounds of parsimony, but this whole subthread was “How could MWI not be the most reasonable choice...?”
There’s an intent behind Occam’s razor. When Einstein improved on Newton’s gravity, gravity itself didn’t change. Rather, our understanding of gravity was improved by a better model. We could say though that Newton’s model is not gravity because we have found instances where gravity does not behave the way Newton predicted.
Underlying Occam’s razor is the simple idea that we should prefer simple ideas. Over time we have found ways to formalize this statement in ways that are universally applicable. These formalizations are getting closer and closer to what Occam’s razor is.
Is there anything in particular that leads you to claim Minimum Description Length is the only legitimate claimaint to the title “Occam’s razor”? It was introduced much later, and the wikipedia article claims it is “a forumlation of Occam’s razor”.
Certainly, William of Occam wasn’t dealing in terms of information compression.
The answer seems circular: because it works. The experience of people using Occam’s razor (e.g. scientists) find MDL to be more likely to lead to correct answers than any other formulation.
I don’t see that that makes other formulations “not Occam’s razor”, it just makes them less useful attempts at formalizing Occam’s razor. If an alternative formalization was found to work better, it would not be MDL—would MDL cease to be “Occam’s razor”? Or would the new, better formalization “not be Occam’s razor”? Of the latter, by what metric, since the new one “works better”?
For the record, I certainly agree that “space complexity alone” is a poor metric. I just don’t see that it should clearly be excluded entirely. I’m generally happy to exclude it on the grounds of parsimony, but this whole subthread was “How could MWI not be the most reasonable choice...?”
There’s an intent behind Occam’s razor. When Einstein improved on Newton’s gravity, gravity itself didn’t change. Rather, our understanding of gravity was improved by a better model. We could say though that Newton’s model is not gravity because we have found instances where gravity does not behave the way Newton predicted.
Underlying Occam’s razor is the simple idea that we should prefer simple ideas. Over time we have found ways to formalize this statement in ways that are universally applicable. These formalizations are getting closer and closer to what Occam’s razor is.
I’ll accept that.