The point I was trying to make is not that there weren’t fundamental advances in the past. There were decades of advances in fundamentals that rocketed forward development at an unsustainable pace. The effect of this can be seen with sheer amount of computation that is being used for SOTA models. I don’t forsee that same leap happening twice.
The point I was trying to make is not that there weren’t fundamental advances in the past. There were decades of advances in fundamentals that rocketed forward development at an unsustainable pace. The effect of this can be seen with sheer amount of computation that is being used for SOTA models. I don’t forsee that same leap happening twice.