I mean, it’s not exactly provable from first principles, but using the architecture of AIXI as a heuristic for what a general intelligence will look like seems to make sense to me. ‘Do reinforcement learning on a learned world model’ is, I think, also what many people think a GAI may end up in fact looking like, e.g., and saying that that’s half decision theory and half predictive model doesn’t seem too far off.
Well I’m not sure there’s any reason to think that we can tell, by looking at the mathematical idealizations, that the inductive parts will take about the same amount of work to create as the agentic parts, just because the formalisms seem to weigh similar amounts (and what does that seeming mean?). I’m not sure our intuitions about the weights of the components mean anything.
If a thing has two main distinct parts, it seems reasonable to say that the thing is half part-1 and half part-2. This does not necessarily imply that the parts are equally difficult to create, although that would be a reasonable prior if you didn’t know much about how the parts worked.
I mean, it’s not exactly provable from first principles, but using the architecture of AIXI as a heuristic for what a general intelligence will look like seems to make sense to me. ‘Do reinforcement learning on a learned world model’ is, I think, also what many people think a GAI may end up in fact looking like, e.g., and saying that that’s half decision theory and half predictive model doesn’t seem too far off.
Well I’m not sure there’s any reason to think that we can tell, by looking at the mathematical idealizations, that the inductive parts will take about the same amount of work to create as the agentic parts, just because the formalisms seem to weigh similar amounts (and what does that seeming mean?). I’m not sure our intuitions about the weights of the components mean anything.
If a thing has two main distinct parts, it seems reasonable to say that the thing is half part-1 and half part-2. This does not necessarily imply that the parts are equally difficult to create, although that would be a reasonable prior if you didn’t know much about how the parts worked.