Game-playing AI is also mediocre, as are models fine-tuned to write good code. 100B parameter models trained from scratch to write code (rather than to imitate human coders) would be much better but would take quite a lot longer to train, and I don’t see any evidence that they would spend less time in the mediocre subhuman regime (though I do agree that they would more easily go well past human level).
Game-playing AI is also mediocre, as are models fine-tuned to write good code. 100B parameter models trained from scratch to write code (rather than to imitate human coders) would be much better but would take quite a lot longer to train, and I don’t see any evidence that they would spend less time in the mediocre subhuman regime (though I do agree that they would more easily go well past human level).