axioman comments on Do mesa-optimizer risk arguments rely on the train-test paradigm?

[axioman]

You don’t even need a catastrophe in any global sense. Disrupting the training procedure at step t should be sufficient.