But I’m pretty sure stuff would go crazy even before then. How?
We can end up with an intelligence explosion via automated ML research. One of the tasks that could be automated by the language model is “brainstorming novel ML ideas”. So you’ll be able to pay $200 and get a text, that could have been written by a brilliant ML researcher, containing novel ideas that allow you to create a more efficient/capable language model. (Though I expect that this specific approach won’t be competitive with fully automated approaches that do stuff like NAS.)
We can end up with an intelligence explosion via automated ML research. One of the tasks that could be automated by the language model is “brainstorming novel ML ideas”. So you’ll be able to pay $200 and get a text, that could have been written by a brilliant ML researcher, containing novel ideas that allow you to create a more efficient/capable language model. (Though I expect that this specific approach won’t be competitive with fully automated approaches that do stuff like NAS.)