… And the really subtle bit, that I don’t want you to miss, is that it doesn’t all shift there, it’s still not a point posterior. There’s still mass on:
That mass won’t go away for a LONG time (that is if the data keeps coming from http://oeis.org/A006530 for at least Googol/2 steps.
And there are many possibilities like this out there. Sure, they have less mass individually, but there ARE many of them. And some don’t even have appreciably less prior mass (under a Solomonoff prior and a “reasonable” Turing machine). Computability is a whole ’nother issue.
… And the really subtle bit, that I don’t want you to miss, is that it doesn’t all shift there, it’s still not a point posterior. There’s still mass on:
Use http://oeis.org/A006530 for the first Googol entries, and then, all zeros.
That mass won’t go away for a LONG time (that is if the data keeps coming from http://oeis.org/A006530 for at least Googol/2 steps.
And there are many possibilities like this out there. Sure, they have less mass individually, but there ARE many of them. And some don’t even have appreciably less prior mass (under a Solomonoff prior and a “reasonable” Turing machine). Computability is a whole ’nother issue.