I think some people are too convinced of the AIXI approximation route and therefore believe that it is just a math problem that only takes some thinking and one or two deep insights
Inductive inference is “just a math problem”. That’s the part that models the world—which is what our brain spends most of its time doing. However, it’s probably not “one or two deep insights”. Inductive inference systems seem to be complex and challenging to build.
how is intelligence well specified compared to space travel? We know physics well enough. We know we want to get from point A to point B. The intelligence: we don’t even quite know what do exactly we want from it. We know of some ridiculous towers of exponents slow method, that means precisely nothing.
The claim was: inductive inference is just a math problem. If we know how to build a good quality, general-purpose stream compressor, the problem would be solved.
Inductive inference is “just a math problem”. That’s the part that models the world—which is what our brain spends most of its time doing. However, it’s probably not “one or two deep insights”. Inductive inference systems seem to be complex and challenging to build.
Everything is a math problem. But that doesn’t mean that you can build a brain by sitting in your basement and literally think it up.
A well-specified math problem, then. By contrast with fusion or space travel.
how is intelligence well specified compared to space travel? We know physics well enough. We know we want to get from point A to point B. The intelligence: we don’t even quite know what do exactly we want from it. We know of some ridiculous towers of exponents slow method, that means precisely nothing.
The claim was: inductive inference is just a math problem. If we know how to build a good quality, general-purpose stream compressor, the problem would be solved.