David James comments on [missing post]

[David James]

From Is Deep Learning Actually Hitting a Wall? Evaluating Ilya Sutskever’s Recent Claims:

But what we seem to be seeing is a bit different from deep learning broadly hitting a wall. More specifically it appears to be: returns to scaling up model pretraining are plateauing.