Yes, and the sequence (as well as the post I linked below) tries to define a complexity measure based on Solomonoff Induction, which is a formalization of Occam’s Razor.
I have the impression that Solomonoff Induction provides a precise procedure to a very narrow set of problems with little practical applicability elsewhere.
How would you use Solomonoff Induction to choose between the two alternative theories mentioned in the article: one based on Newton’s Force Laws, the other based on the principle of least action. (Both theories have the same range of validity and produce the identical results).
But it isn’t very successful, because if you cast SI on terms of a linear string of bits, as is standard, you are building in a kind of single universe assumption.
if you cast SI on terms of a linear string of bits, as is standard, you are building in a kind of single universe assumption.
First, I assume you mean a sequential string of bits. “Linear” has a well defined meaning in math that doesn’t make sense in the context you used it.
Second, can you explain what you mean by that? It doesn’t sound correct. I mean, an agent can only make predictions about its observable universe, but that’s true of humans too. We can speculate about multiverses and how they may shape our observations (e.g. the many worlds interpretation of QFT), but so could an SI agent.
Yes, and the sequence (as well as the post I linked below) tries to define a complexity measure based on Solomonoff Induction, which is a formalization of Occam’s Razor.
I have the impression that Solomonoff Induction provides a precise procedure to a very narrow set of problems with little practical applicability elsewhere.
How would you use Solomonoff Induction to choose between the two alternative theories mentioned in the article: one based on Newton’s Force Laws, the other based on the principle of least action. (Both theories have the same range of validity and produce the identical results).
But it isn’t very successful, because if you cast SI on terms of a linear string of bits, as is standard, you are building in a kind of single universe assumption.
First, I assume you mean a sequential string of bits. “Linear” has a well defined meaning in math that doesn’t make sense in the context you used it.
Second, can you explain what you mean by that? It doesn’t sound correct. I mean, an agent can only make predictions about its observable universe, but that’s true of humans too. We can speculate about multiverses and how they may shape our observations (e.g. the many worlds interpretation of QFT), but so could an SI agent.