I think all self improvement is subject to Goodharting, even the type you recommend.
In particular, I’d worry that “not Goodharting yourself” is Goodharting yourself. Dunno that I have this very coherently, but things that feel like hooks:
Selling nonapples.
Don’t try to “get better at rationality”; rationality needs to have a goal outside itself.
“How are you doing at your goals?” “Well, I stopped measuring things that weren’t perfect metrics for them.”
In particular, I’d worry that “not Goodharting yourself” is Goodharting yourself. Dunno that I have this very coherently, but things that feel like hooks:
Selling nonapples.
Don’t try to “get better at rationality”; rationality needs to have a goal outside itself.
“How are you doing at your goals?” “Well, I stopped measuring things that weren’t perfect metrics for them.”