We care still alive
No GPT-5 yet
Rumors of hitting the wall
From Is Deep Learning Actually Hitting a Wall? Evaluating Ilya Sutskever’s Recent Claims:
But what we seem to be seeing is a bit different from deep learning broadly hitting a wall. More specifically it appears to be: returns to scaling up model pretraining are plateauing.
We care still alive
No GPT-5 yet
Rumors of hitting the wall
From Is Deep Learning Actually Hitting a Wall? Evaluating Ilya Sutskever’s Recent Claims: