The part of OP you quoted only covers part of what I’m saying. It’s not just that we can be pressured into doing good things, it’s also that we have no idea what our intrinsic desires will become as we learn more about they interact with each other and the world, and there is a lot of legitimate change in intrinsic preferences which are more reflectively stable upon sufficiently good reflection, but which nevertheless revert to the shallower preferences upon typical reflection because reflection is hard and people are bad at it.
“Reflectively stable in absence of coercive pressure” is very difficult to actually measure, so it’s more of a hypothetical construct which is easy to get wrong—especially since “absence of coercive pressure” can’t actually exist, so we have to figure out which kinds of coercive pressure we’re going to include in our hypothetical.
The part of OP you quoted only covers part of what I’m saying. It’s not just that we can be pressured into doing good things, it’s also that we have no idea what our intrinsic desires will become as we learn more about they interact with each other and the world, and there is a lot of legitimate change in intrinsic preferences which are more reflectively stable upon sufficiently good reflection, but which nevertheless revert to the shallower preferences upon typical reflection because reflection is hard and people are bad at it.
“Reflectively stable in absence of coercive pressure” is very difficult to actually measure, so it’s more of a hypothetical construct which is easy to get wrong—especially since “absence of coercive pressure” can’t actually exist, so we have to figure out which kinds of coercive pressure we’re going to include in our hypothetical.