I think my terminology isn’t totally clear. By “goals” in that statement, I mean what we mean by “’values” in humans. The two are used in overlapping and mostly interchangable ways in my writing
Humans aren’t sufficiently intelligent to be all that internally consistent
In many cases of humans changing goals, I’d say they’re actually changing subgoals, while their central goal (be happy/satisfied/joyous) remains the same. This may be described as changing goals while keeping the same values.
Note ‘in the short term’ (I think you’re quoting Bostrom? The context isn’t quite clear). In the long term, with increasing intelligence and self-awareness, I’d expect some of people’s goals to change as they become more self-aware and work toward more internal coherence (e.g., many people change their goal of eating delicious food when they realize it conflicts with their more important goal of being happy and living a a long life).
Yes, humans may change exactly that way. A friend said he’d gotten divorced after getting a CPAP to solve his sleep apnea: “When we got married, we were both sad and angry people. Now I’m not.” But that’s because we’re pretty random and biology determined.
I think my terminology isn’t totally clear. By “goals” in that statement, I mean what we mean by “’values” in humans. The two are used in overlapping and mostly interchangable ways in my writing
Humans aren’t sufficiently intelligent to be all that internally consistent
In many cases of humans changing goals, I’d say they’re actually changing subgoals, while their central goal (be happy/satisfied/joyous) remains the same. This may be described as changing goals while keeping the same values.
Note ‘in the short term’ (I think you’re quoting Bostrom? The context isn’t quite clear). In the long term, with increasing intelligence and self-awareness, I’d expect some of people’s goals to change as they become more self-aware and work toward more internal coherence (e.g., many people change their goal of eating delicious food when they realize it conflicts with their more important goal of being happy and living a a long life).
Yes, humans may change exactly that way. A friend said he’d gotten divorced after getting a CPAP to solve his sleep apnea: “When we got married, we were both sad and angry people. Now I’m not.” But that’s because we’re pretty random and biology determined.
Both quotes are from your above post. Apologies for confusion.