does not have any integrated world-model that it can loop on to do novel long-term planning
I am interested in more of your thoughts on this part, because I do not grok the necessity of a single world-model or long-term planning (though I’m comfortable granting that they would make it much more effective). Are these independent requirements, or are they linked somehow? Would an explanation look like:
Because the chunks of the world model are small, foom won’t meaningfully increase capabilities past a certain point.
Or maybe:
Without long-term planning, the disproportionate investment in increasing capabilities that leads to foom never makes sense.
The second one. The logic for increasing capabilities is “if I increase my capabilities, then I’ll better reach my goal”. But Gato does not implement the dynamic of “if I infer [if X then I’ll better reach my goal] then promote X to an instrumental goal”. Nor does it particularly pursue goals by any other means. Gato just acts similar to how its training examples acted in similar situations to the ones it finds itself in.
I am interested in more of your thoughts on this part, because I do not grok the necessity of a single world-model or long-term planning (though I’m comfortable granting that they would make it much more effective). Are these independent requirements, or are they linked somehow? Would an explanation look like:
Because the chunks of the world model are small, foom won’t meaningfully increase capabilities past a certain point.
Or maybe:
Without long-term planning, the disproportionate investment in increasing capabilities that leads to foom never makes sense.
The second one. The logic for increasing capabilities is “if I increase my capabilities, then I’ll better reach my goal”. But Gato does not implement the dynamic of “if I infer [if X then I’ll better reach my goal] then promote X to an instrumental goal”. Nor does it particularly pursue goals by any other means. Gato just acts similar to how its training examples acted in similar situations to the ones it finds itself in.