Not a very helpful answer, but: If you don’t also require computational efficiency, we can do some of those. Like, you can make AIXI variants. Is the question “Can we do this with deep learning?”, or “Can we do this with deep learning or something competitive with it?”
I think I mean “within a factor of 100 in competitiveness”, that seems like the point at which things become at all relevant for engineering, in ways other than trivial bounds.
Not a very helpful answer, but: If you don’t also require computational efficiency, we can do some of those. Like, you can make AIXI variants. Is the question “Can we do this with deep learning?”, or “Can we do this with deep learning or something competitive with it?”
I think I mean “within a factor of 100 in competitiveness”, that seems like the point at which things become at all relevant for engineering, in ways other than trivial bounds.