David James comments on What are some positive developments in AI safety in 2024?

[David James]

From Is Deep Learning Actually Hitting a Wall? Evaluating Ilya Sutskever’s Recent Claims:

But what we seem to be seeing is a bit different from deep learning broadly hitting a wall. More specifically it appears to be: returns to scaling up model pretraining are plateauing.