There’s a difference between discovering something and being able to formalise it. We use the simple meta-algorithm of gradient descent to train neural networks, but that doesn’t allow us to understand their behaviour.
Also, meta-algorithms which seem simple to us may not in fact be simple, if our own minds are complicated to describe.
There’s a difference between discovering something and being able to formalise it. We use the simple meta-algorithm of gradient descent to train neural networks, but that doesn’t allow us to understand their behaviour.
Also, meta-algorithms which seem simple to us may not in fact be simple, if our own minds are complicated to describe.