But a human who learns rationality already has those values, and rationality can help them understand those values better, decompartmentalize, and optimize more efficiently.
So? Let’s say I value cleansing the Earth of untermenschen. Rationality can indeed help me achieve my goals and “optimize more efficiently”. Once you start associating rationality with sets of values, I don’t see how can you associate it with only “nice” values like altruism, but not “bad” ones like genocide.
Maybe, but at least they’ll be campaigning for mandatory genetic screening for genetic disorders rather than kill people of some arbitrary ethnicity they happened to fixate on.
So? Let’s say I value cleansing the Earth of untermenschen. Rationality can indeed help me achieve my goals and “optimize more efficiently”. Once you start associating rationality with sets of values, I don’t see how can you associate it with only “nice” values like altruism, but not “bad” ones like genocide.
Maybe, but at least they’ll be campaigning for mandatory genetic screening for genetic disorders rather than kill people of some arbitrary ethnicity they happened to fixate on.
Because there’s a large set of “nice” values that most of humanity shares.
Along with a large set of “not so nice” values that most of humanity shares as well. A glance at history should suffice to demonstrate that.
I think one of the lessons from history is that we can still massacre each other even when everyone is acting in good faith.