This is a logical vicious circle. Morality itself is the handmaiden of humans (and similar creatures in fantasy and SF). Morality has value only insofar as we find it important to care about human and quasi-human interests. This does not answer the question “Why do we care about human and quasi-human interests?”
One could try to find an answer in the prisoner’s dilemma. In the logic of Kant’s categorical imperative. Cooperation of rational agents and the like. Then I should sympathize with any system that cares about my interests, even if that system is otherwise like the Paperclipmaker and completely devoid of “unproductive” self-reflection. Great. There is some cynical common sense in this, but I feel a little disappointed.
This is a logical vicious circle. Morality itself is the handmaiden of humans (and similar creatures in fantasy and SF). Morality has value only insofar as we find it important to care about human and quasi-human interests. This does not answer the question “Why do we care about human and quasi-human interests?”
One could try to find an answer in the prisoner’s dilemma. In the logic of Kant’s categorical imperative. Cooperation of rational agents and the like. Then I should sympathize with any system that cares about my interests, even if that system is otherwise like the Paperclipmaker and completely devoid of “unproductive” self-reflection. Great. There is some cynical common sense in this, but I feel a little disappointed.