In the Quanta Theory of Neural Scaling, individual token tasks (quanta) occupy some continuum between monogenic (non-linear/emergent) and polygenic (smooth linear). Seems reasonable that some tasks have circuit solution dependencies that work out to being more multiplicative/combinatoric than additive—ie circuit Z requires both X and Y, rather than X or Y.
In the Quanta Theory of Neural Scaling, individual token tasks (quanta) occupy some continuum between monogenic (non-linear/emergent) and polygenic (smooth linear). Seems reasonable that some tasks have circuit solution dependencies that work out to being more multiplicative/combinatoric than additive—ie circuit Z requires both X and Y, rather than X or Y.