Obviously this is all speculation but maybe I’m saying that the universal approximation theorem implies that neural architectures are fractal in space of all distributtions (or some restricted subset thereof)?
Stone-weierstrass isn’t quantitative. If true it suggest the fractal dimension (probably related to the information dimension I linked to above) may be important.
Obviously this is all speculation but maybe I’m saying that the universal approximation theorem implies that neural architectures are fractal in space of all distributtions (or some restricted subset thereof)?
Stone-weierstrass isn’t quantitative. If true it suggest the fractal dimension (probably related to the information dimension I linked to above) may be important.