But learning to guess the teacher’s password is exactly what supervised learning is all about. It’s such a popular technique precisely because it converges so quickly on generating correct answers, even though it’s often at the expense of learning spurious correlations. That’s why these models tend to reproduce human biases and prejudices that exist in the training data. Learning the true causal structure of reality is a much harder problem.
But learning to guess the teacher’s password is exactly what supervised learning is all about. It’s such a popular technique precisely because it converges so quickly on generating correct answers, even though it’s often at the expense of learning spurious correlations. That’s why these models tend to reproduce human biases and prejudices that exist in the training data. Learning the true causal structure of reality is a much harder problem.