Gurkenglas answers Do mesa-optimizer risk arguments rely on the train-test paradigm?

[Gurkenglas]

The problem arises whenever the environment changes. Natural selection was a continual process, and yet humans still aren’t fitness-aligned.