Relate this to value loading. If the programmer says cake, you value cake; if they say death, you value death. You could see this as choosing between two utilities, or you could see it as having a single utility function where “what the programmer says” strongly distinguishes between otherwise identical universes.
Relate this to value loading. If the programmer says cake, you value cake; if they say death, you value death. You could see this as choosing between two utilities, or you could see it as having a single utility function where “what the programmer says” strongly distinguishes between otherwise identical universes.