I’m not sure that’s quite right. A genetic mutation is “one thing” but it can easily have many different effects especially once you consider that it’s active for an entire lifetime.
And doesn’t gradient descent also demand that each weight update is beneficial? At a much more fine grain than evolution does… then again I guess there’s grokking so I’m not sure.
Strong downvote.