“CEV”, i.e. “coherent extrapolated volition”, refers (as I understand it) to the notion of aggregating the extrapolated volition across many (all?) individuals (humans, usually), and to the idea that this aggregated EV will “cohere rather than interfere”. (Aside: please don’t anyone quibble with this hasty definition; I’ve read Eliezer’s paper on CEV and much else about it besides, I know it’s complicated. I’m just pointing at the concept.)
I’ll quibble with this definition anyway because I think many people get it wrong. The way I read CEV, it doesn’t claim that extrapolated preferences cohere, but specifically picks out the parts that cohere, and it does so in a way that’s interleaved with the extrapolation step instead of happening after the extrapolation step is over.
Yours is exactly the kind of comment that I specifically hoped would not get made, and which I therefore explicitly requested that people restrain themselves from making.
It didn’t look to me like my disagreement with your comment was caused by hasty summarization, given how specific your comment was on this point, so I figured this wasn’t among the aspects you were hoping people wouldn’t comment on. Apparently I was wrong about that. Note that my comment included an explanation of why I thought it was worth making despite your request and the implicit anti-nitpicking motivation behind it, which I agree with.
I’ll quibble with this definition anyway because I think many people get it wrong. The way I read CEV, it doesn’t claim that extrapolated preferences cohere, but specifically picks out the parts that cohere, and it does so in a way that’s interleaved with the extrapolation step instead of happening after the extrapolation step is over.
Yes. I know.
Yours is exactly the kind of comment that I specifically hoped would not get made, and which I therefore explicitly requested that people restrain themselves from making.
It didn’t look to me like my disagreement with your comment was caused by hasty summarization, given how specific your comment was on this point, so I figured this wasn’t among the aspects you were hoping people wouldn’t comment on. Apparently I was wrong about that. Note that my comment included an explanation of why I thought it was worth making despite your request and the implicit anti-nitpicking motivation behind it, which I agree with.