I’m glad enough that murderers are punished and dissuaded. Since a lot of people share my preference for not being murdered, throwing negative utility at murderers generates nett positive utility.
The same trick doesn’t work for preferences that aren’t shared. I am not going to create utility by enforcing my fondness for the colour pink and the number nine on people.
But that’s widely understood. (Lesswrongians are about the only people who treat any kind of value as moral relevant ). So what’s the problem?
I suppose the problem is that there isn’t a clean break between widely shared values and idiosyncratic personal values. You can have an uncanny valley situation where about half the population share a value and are trying to impose it on the rest
I’m glad enough that murderers are punished and dissuaded. Since a lot of people share my preference for not being murdered, throwing negative utility at murderers generates nett positive utility.
The same trick doesn’t work for preferences that aren’t shared. I am not going to create utility by enforcing my fondness for the colour pink and the number nine on people.
But that’s widely understood. (Lesswrongians are about the only people who treat any kind of value as moral relevant ). So what’s the problem?
I suppose the problem is that there isn’t a clean break between widely shared values and idiosyncratic personal values. You can have an uncanny valley situation where about half the population share a value and are trying to impose it on the rest