the claim is that language modelling (on some curriculum) will be sufficient to competitively help you build your next AI.
With an agent-like AI, it’s easy to see how you use it to help build your next AI. (If it’s really good, you can even just delegate the entire task to it!) How would this work with really good language modelling? (Maybe I’m just seconding what Ofer said—I’d love to read an entire post about the view you are putting forth here!)
The goal of something like amplification or debate is to create a sort of oracle AI that can answer arbitrary questions (like how to build your next AI) for you. The claim I’m making is just that language is a rich enough environment that it’ll be competitive to only use language as the training data for building your first such system.
With an agent-like AI, it’s easy to see how you use it to help build your next AI. (If it’s really good, you can even just delegate the entire task to it!) How would this work with really good language modelling? (Maybe I’m just seconding what Ofer said—I’d love to read an entire post about the view you are putting forth here!)
The goal of something like amplification or debate is to create a sort of oracle AI that can answer arbitrary questions (like how to build your next AI) for you. The claim I’m making is just that language is a rich enough environment that it’ll be competitive to only use language as the training data for building your first such system.