My current “background I” (maybe not the one from 2017, but one I would tend to deploy here in 2024) includes something like: “Kolmogorov complexity is a cool ideal, but it is formally uncomputable in theory unless you have a halting oracle laying around in your cardboard box in your garage labeled Time Travel Stuff, and Solomonoff Induction is not tractably approximably sampled by extant techniques that aren’t just highly skilled MCMC”.
My current “background I” (maybe not the one from 2017, but one I would tend to deploy here in 2024) includes something like: “Kolmogorov complexity is a cool ideal, but it is formally uncomputable in theory unless you have a halting oracle laying around in your cardboard box in your garage labeled Time Travel Stuff, and Solomonoff Induction is not tractably approximably sampled by extant techniques that aren’t just highly skilled MCMC”.
Yeah. But if you give up on reasoning about/approximating solomonoff, then where do you get your priors? Do you have a better approach?