If your model is perfectly accurate, yep this process is not needed.
I’d argue though if you had a perfect Model and a Model of the Measure, you wouldn’t need the real Measure either. The Measure is just something to help you search. You would just create the good life or an AI or whatever hard to define thing you have a definition for.
My point isn’t that if the model is perfectly accurate the process isn’t needed.
My point is that if the model is perfectly accurate the process doesn’t work (at least in the difficult cases) and that the process involves trying to improve the model all the time, so it’s liable to push itself into a situation where it doesn’t work.
In other words, I don’t see that this process is really effective in saving you from Goodhart’s law.
If your model is perfectly accurate, yep this process is not needed.
I’d argue though if you had a perfect Model and a Model of the Measure, you wouldn’t need the real Measure either. The Measure is just something to help you search. You would just create the good life or an AI or whatever hard to define thing you have a definition for.
My point isn’t that if the model is perfectly accurate the process isn’t needed.
My point is that if the model is perfectly accurate the process doesn’t work (at least in the difficult cases) and that the process involves trying to improve the model all the time, so it’s liable to push itself into a situation where it doesn’t work.
In other words, I don’t see that this process is really effective in saving you from Goodhart’s law.