V seems quite close to U when compared to the utility function programmed into a paperclip maximizer.
Secondly, I see how V could allow the coefficient for autonomy to be zero or even negative, in principle. But I don’t think our values are actually that inconsistent. More precisely, if Value A and Value B require different choices with high frequency and have relatively similar priority, then U cannot implement both A and B unless it outputs very little of either one. Or so it seems to me.
V seems quite close to U when compared to the utility function programmed into a paperclip maximizer.
Secondly, I see how V could allow the coefficient for autonomy to be zero or even negative, in principle. But I don’t think our values are actually that inconsistent. More precisely, if Value A and Value B require different choices with high frequency and have relatively similar priority, then U cannot implement both A and B unless it outputs very little of either one. Or so it seems to me.