Heh. I think you’re trying to generalize a narrow result way too much. Especially when we are not talking about compression ratios, but things like “explanatory power” which is quite different from getting to the shortest bit string.
Let’s take a real example which was discussed on the LW recently: the heliocentrism debates in Renaissance Europe, for example between Copernicus and Kepler, pre-Galileo (see e.g. here). Show me how the MML theory is relevant to this choice between two competing theories.
Kepler’s heliocentric theory is a direct result of Newtonian mechanics and gravitation, equations which can be encoded very simply and require few parameters to achieve accurate predictions for the planetary orbits. Copernicus’ theory improved over Ptolemy’s geocentric theory by using the same basic model for all the planetary orbits (instead of a different model for each) and naturally handling the appearance of retrograde motion. However, it still required numerous epicycles in order to make accurate predictions, because Copernicus constrained the theory to use only perfect circular motion. Allowing elliptical motion would have made the basic model slightly more complex, but would have drastically reduced the amount of necessary parameters and corrections. That’s exactly the tradeoff described by MML.
The dozens of epicycles aren’t on a par with Kepler’s laws. “Planets move in circles plus epicycles” is what you have to compare with Kepler’s laws. “Such-and-such a planet moves in such-and-such a circle plus such-and-such epicycles” is parallel not to Kepler’s laws themselves but to “Such-and-such a planet moves in such-and-such an ellipse, apart from such-and-such further corrections”. If some epicycles are needed in the first case, but no corrections in the second, then Kepler wins. If you need to add corrections to the Keplerian model, either might come out ahead.
(Why would you need corrections in the Keplerian model? Inaccurate observations. Gravitational influences of one planet on another—this is how Neptune was discovered.)
I have heard that Copernican astronomy (circles centred on the sun, plus corrections) ended up needing more epicycles than Ptolemaic (circles centred on the earth, plus corrections) for reasons I don’t know. I think Kepler’s system needed much less correction, but don’t know the details.
The linked Wikipedia page provides a succinct derivation from Shannon and Bayes’ Theorem.
Heh. I think you’re trying to generalize a narrow result way too much. Especially when we are not talking about compression ratios, but things like “explanatory power” which is quite different from getting to the shortest bit string.
Let’s take a real example which was discussed on the LW recently: the heliocentrism debates in Renaissance Europe, for example between Copernicus and Kepler, pre-Galileo (see e.g. here). Show me how the MML theory is relevant to this choice between two competing theories.
Kepler’s heliocentric theory is a direct result of Newtonian mechanics and gravitation, equations which can be encoded very simply and require few parameters to achieve accurate predictions for the planetary orbits. Copernicus’ theory improved over Ptolemy’s geocentric theory by using the same basic model for all the planetary orbits (instead of a different model for each) and naturally handling the appearance of retrograde motion. However, it still required numerous epicycles in order to make accurate predictions, because Copernicus constrained the theory to use only perfect circular motion. Allowing elliptical motion would have made the basic model slightly more complex, but would have drastically reduced the amount of necessary parameters and corrections. That’s exactly the tradeoff described by MML.
Not for Kepler who lived about a century before Newton.
My question was about the Copernicus—Kepler debates and Newtonian mechanics were quite unknown at that point.
Even Kepler’s theory expressed as his three separate laws is much simpler than a theory with dozens of epicycle.
The dozens of epicycles aren’t on a par with Kepler’s laws. “Planets move in circles plus epicycles” is what you have to compare with Kepler’s laws. “Such-and-such a planet moves in such-and-such a circle plus such-and-such epicycles” is parallel not to Kepler’s laws themselves but to “Such-and-such a planet moves in such-and-such an ellipse, apart from such-and-such further corrections”. If some epicycles are needed in the first case, but no corrections in the second, then Kepler wins. If you need to add corrections to the Keplerian model, either might come out ahead.
(Why would you need corrections in the Keplerian model? Inaccurate observations. Gravitational influences of one planet on another—this is how Neptune was discovered.)
I have heard that Copernican astronomy (circles centred on the sun, plus corrections) ended up needing more epicycles than Ptolemaic (circles centred on the earth, plus corrections) for reasons I don’t know. I think Kepler’s system needed much less correction, but don’t know the details.