I think a good bit of my value complexity comes from the fact that I live in a human body.
Consider valuing tasty food.
What I will find “tasty” is based on a huge number of factors, like amount and type of fat, salt, sugar, texture, temperature, weather, what I’ve eaten that day, what I’ve eaten that week, what else I’m eating, time of day, the chemical state of my body, culture, etc.
And as long as I live in this body, I think that I won’t be able to self-modify enough to eliminate most of this complexity in what I like (and all else being equal, want).
I think a good bit of my value complexity comes from the fact that I live in a human body.
Consider valuing tasty food.
What I will find “tasty” is based on a huge number of factors, like amount and type of fat, salt, sugar, texture, temperature, weather, what I’ve eaten that day, what I’ve eaten that week, what else I’m eating, time of day, the chemical state of my body, culture, etc.
And as long as I live in this body, I think that I won’t be able to self-modify enough to eliminate most of this complexity in what I like (and all else being equal, want).