then an AI pointed at your volition will derive and implement CEV
Also, from OP:
Why must this particular thing be spelled out in a document like CEV and not left to the mysterious magic of “intelligence”, and what other such things are there?
If what you want is to have something pointed at your volition then you first have to design the AI that points to it rather than something else. This whole CEV stuff was an attempt at answering the “design an AI that points to it” question, and the crucial consideration that led to it was that there is no magically intelligent system that would automatically converge to what we’d prefer. Of course, there remains the question of balance between AI structure determined by what I want and AI structure determined by what the AI thinks I want. The realization of FAI is that you cannot eliminate the first item from the balance and get an acceptable result. It is better to ask “How could I best solve the FAI problem using my brain rather than something else?” than to ask “Could I use something else than my brain to solve the FAI problem?”.
If CEV isn’t what you want to implement, then why are you implementing it?
If a CEV isn’t what I want to implement, it is still good to implement CEV because it’ll find out what I want to implement—plus more stuff that I would agree to implementing but not think of in the first place.
Also, from OP:
If what you want is to have something pointed at your volition then you first have to design the AI that points to it rather than something else. This whole CEV stuff was an attempt at answering the “design an AI that points to it” question, and the crucial consideration that led to it was that there is no magically intelligent system that would automatically converge to what we’d prefer. Of course, there remains the question of balance between AI structure determined by what I want and AI structure determined by what the AI thinks I want. The realization of FAI is that you cannot eliminate the first item from the balance and get an acceptable result. It is better to ask “How could I best solve the FAI problem using my brain rather than something else?” than to ask “Could I use something else than my brain to solve the FAI problem?”.
If a CEV isn’t what I want to implement, it is still good to implement CEV because it’ll find out what I want to implement—plus more stuff that I would agree to implementing but not think of in the first place.