One other plausible theory of the results is that conditional on the results being true, this might not represent deep learning hitting a wall, but rather the leaving of key people like Ilya Sutskever meaning that OpenAI has lost it’s mojo and ability to scale well:
One other plausible theory of the results is that conditional on the results being true, this might not represent deep learning hitting a wall, but rather the leaving of key people like Ilya Sutskever meaning that OpenAI has lost it’s mojo and ability to scale well:
https://www.reddit.com/r/mlscaling/comments/1djoqjh/comment/l9uogp9/