CEV is one of the many flavors of total act utilitarianism (or average? I can’t really make sense of Yudkowsky’s position given what he recently wrote in a comment on OB ).
Anyway, act utilitarianism comes in many flavors that differ essentially in how they define the utility functions of the moral patients and how to compare them. ‘Coherent Extrapolation’, IIUC, means “The Almighty FAI knows what is best for you better than you do”.
CEV is one of the many flavors of total act utilitarianism (or average?
This is not just false, but something of a category error. Here is the CEV working paper if you want to read it. It’s talking about a very loose class of procedures to select actions using the device of what an idealized version of some specified population would decide on under some idealized circumstances. The upshot of that for object-level normative questions depends on how the idealized process of moral deliberation would go. There’s no necessary connection to any form of utilitarianism, or any other first-order normative account.
CEV is one of the many flavors of total act utilitarianism (or average? I can’t really make sense of Yudkowsky’s position given what he recently wrote in a comment on OB ).
Anyway, act utilitarianism comes in many flavors that differ essentially in how they define the utility functions of the moral patients and how to compare them. ‘Coherent Extrapolation’, IIUC, means “The Almighty FAI knows what is best for you better than you do”.
That doesn’t look very pretty to me.
This is not just false, but something of a category error. Here is the CEV working paper if you want to read it. It’s talking about a very loose class of procedures to select actions using the device of what an idealized version of some specified population would decide on under some idealized circumstances. The upshot of that for object-level normative questions depends on how the idealized process of moral deliberation would go. There’s no necessary connection to any form of utilitarianism, or any other first-order normative account.
How does it aggregate preferences?
That’s an open question.