On the matter of software improvements potentially available during recursive self-improvement, we can look at the current pace of algorithmic improvement, which has been probably faster than scaling for some time now. So that’s another lower bound on what AI will be capable of, assuming that the extrapolation holds up.
I’m wary about that one, because that isn’t a known “general” intelligence architecture, so we can expect AIs to make better learning algorithms for deep neural networks, but not necessarily themselves.
On the matter of software improvements potentially available during recursive self-improvement, we can look at the current pace of algorithmic improvement, which has been probably faster than scaling for some time now. So that’s another lower bound on what AI will be capable of, assuming that the extrapolation holds up.
I’m wary about that one, because that isn’t a known “general” intelligence architecture, so we can expect AIs to make better learning algorithms for deep neural networks, but not necessarily themselves.