If it were up to me, I’d use “CEV” to refer to the proposal Eliezer calls “CEV” in his original article (which I think could be cashed out either in a way where applying the concept to subselves makes sense or in a way where that does not make sense), use “extrapolated volition” to refer to the more general class of algorithms that extrapolate people’s volitions, and use something like “true preferences” or “ideal preferences” or “preferences on reflection” when the algorithm for finding those preferences isn’t important, like in the OP.
If I’m not mistaken, “CEV” originally stood for “Collective Extrapolated Volition”, but then Eliezer changed the name when people interpreted it in more of a “tyranny of the majority” way than he intended.
If it were up to me, I’d use “CEV” to refer to the proposal Eliezer calls “CEV” in his original article (which I think could be cashed out either in a way where applying the concept to subselves makes sense or in a way where that does not make sense), use “extrapolated volition” to refer to the more general class of algorithms that extrapolate people’s volitions, and use something like “true preferences” or “ideal preferences” or “preferences on reflection” when the algorithm for finding those preferences isn’t important, like in the OP.
If I’m not mistaken, “CEV” originally stood for “Collective Extrapolated Volition”, but then Eliezer changed the name when people interpreted it in more of a “tyranny of the majority” way than he intended.