I was probably assuming third party evaluator. I think the individuals should be free to do another project while they wait for the metrics to kick in / the numbers to come back. I think if the metrics come back and it turns out they had done a great job, then they should gain social capital to spend on their future projects, and maybe return to a project similar to the one they shuttered in the future.
You’re right that this is a problem if the metrics are expected to be done in house!
Metrics are everywhere and always a problem. If the project doesn’t continue and the metrics are used to judge the person’s performance, it’s even more of a Goodhart issue, so I’d be very cautious about judging via known metrics, unless a given situation provides a very good fit.
I was probably assuming third party evaluator. I think the individuals should be free to do another project while they wait for the metrics to kick in / the numbers to come back. I think if the metrics come back and it turns out they had done a great job, then they should gain social capital to spend on their future projects, and maybe return to a project similar to the one they shuttered in the future.
You’re right that this is a problem if the metrics are expected to be done in house!
Metrics are everywhere and always a problem. If the project doesn’t continue and the metrics are used to judge the person’s performance, it’s even more of a Goodhart issue, so I’d be very cautious about judging via known metrics, unless a given situation provides a very good fit.