Besides, the purpose of CEV is to extrapolate the volition humanity would have if it were more intelligent—and since you just created the first AI, you are clearly the most intelligent person in the world (not that you didn’t already know that). Therefore, using your own current utility function is an even better approximation than trying to extrapolate humanity’s volition to your own level of intelligence!
Besides, the purpose of CEV is to extrapolate the volition humanity would have if it were more intelligent—and since you just created the first AI, you are clearly the most intelligent person in the world (not that you didn’t already know that). Therefore, using your own current utility function is an even better approximation than trying to extrapolate humanity’s volition to your own level of intelligence!