Hmm, this seems a little different from Goodhart’s law (or at least it’s a particular special case that deserves its own name).
This concept, as I understand it, is not about picking the wrong metric to optimize. It’s more like picking the wrong metric to satisfice, or putting the bar for satisficing in the wrong place.
Hmm, this seems a little different from Goodhart’s law (or at least it’s a particular special case that deserves its own name).
This concept, as I understand it, is not about picking the wrong metric to optimize. It’s more like picking the wrong metric to satisfice, or putting the bar for satisficing in the wrong place.