Note that most of the talk is about several (in his opinion) promising research directions for ML in the coming years. Which, he hopes, would lead to planning and more general animal-like capability, or AGI, although he doesn’t like that term. One upshot is that autoregressive language models will not scale to AGI. The slides in the screenshot above aren’t really the topic of the talk, he in fact skipped the last two. I found the talk interesting, although I can’t judge how realistic his proposals are.
Note that most of the talk is about several (in his opinion) promising research directions for ML in the coming years. Which, he hopes, would lead to planning and more general animal-like capability, or AGI, although he doesn’t like that term. One upshot is that autoregressive language models will not scale to AGI. The slides in the screenshot above aren’t really the topic of the talk, he in fact skipped the last two. I found the talk interesting, although I can’t judge how realistic his proposals are.