I disagree with this objection to Eliezer’s ethics because I think the distinction between “realist” and “nonrealist” theories is a confusion that needs to be done away with. The question is not whether morality (or anything else) is “something real,” but whether or not moral claims are actually true or false. Because that is all the reality that actually matter: tables and chairs are real, as far as I am concerned, because “there is a table in this room” is actually true. (This is also relevant to our previous discussion about consciousness.)
And in Eliezer’s theory, some moral claims are actually true, and some are actually false. So I agree with him that his theory is realist.
I do disagree with his theory, however, insofar as it implies that “what we care about” is essentially arbitrary, even if it is what it is.
The question is not whether morality (or anything else) is “something real”, but whether or not moral claims are actually true or false.
That (whether moral claims are actually true or false) is exactly how I distinguish moral realism from moral nonrealism, and I think this is a standardway to understand the terms.
But any nonrealist theory can be made into one in which moral claims have truth values by redefining the key words; my suggestion is that Eliezer’s theory is of this kind, that it is nearer to a straightforwardly nonrealist theory, which it becomes if e.g. you replace his use of terms like “good” with terms that are explicit about what value system the reference (“good according to human values”) than to typical more ambitious realist theories that claim that moral judgements are true or false according to some sort of moral authority that goes beyond any particular person’s or group’s or system’s values.
I agree that the typical realist theory implies more objectivity than is present in Eliezer’s theory. But in the same way, the typical non-realist theory implies less objectivity than is present there. E.g. someone who says that “this action is good” just means “I want to do this action” has less objectivity, because it will vary from person to person, which is not the case in Eliezer’s theory.
I think we are largely agreed as to facts and disagree only on whether it’s better to call Eliezer’s theory, which is intermediate between many realist theories and many non-realist theories, “realist” or “non-realist”.
I’m not sure, though, that someone who says that “this is good” = “I want to do this” is really a typical non-realist. My notion of a typical non-realist—typical, I mean, among people who’ve actually thought seriously about this stuff—is somewhat nearer to Eliezer’s position than that.
Anyway, the reason why I class Eliezer’s position as non-realist is that the distinction between Eliezer’s position and that of many (other?) non-realists is purely terminological—he agrees that there are all these various value systems, and that if ours seems special to us that’s because it’s ours rather than because of some agent-independent feature of the universe that picks ours out in preference to others, but he wants to use words like “good” to refer to one particular value system—whereas the distinction between his position and that of most (other?) realists goes beyond terminology: they say that the value system they regard as real is actually built into the fabric of reality in some way that goes beyond the mere fact that it’s our (or their) value system.
I think he wants a system which works like realism, in that there are definite answers to ethical questions (“fixed”, “frozen”) ,but without spookiness.
Yudkowsky,’s theory entails the same problem as relativism: if morality is whatever people value, and if what people happen to value is intuitively immoral , slavery, torture,whatever, then there’s no fixed standard of morality. The label “moral” has been placed on a moving target. (Standard relativism usually has this problem synchronously
, ie different communities are said to have different but equally valid moralities at the same time, but it makes little difference if you are asserting that the global community has different but equally valid moralities at different times)
You can avoid the problems of relativism by setting up an external standard, and there are many theories of that type, but they tend to have the problem that the external standard is not naturalistic....God’s commands, the Form of the good, and so on. I think Yudkowsky wants a theory that is non arbitrary and also naturalistic. I don’t think he arrives a single theory that does both. If the Moral Equation is just a label for human intuition, then it ssuffers from all the vagaries of labeling values as moral, the original theory. If the Moral Equation is something ideal and abstract, why can’t aliens partake?
I disagree with this objection to Eliezer’s ethics because I think the distinction between “realist” and “nonrealist” theories is a confusion that needs to be done away with. The question is not whether morality (or anything else) is “something real,” but whether or not moral claims are actually true or false. Because that is all the reality that actually matter: tables and chairs are real, as far as I am concerned, because “there is a table in this room” is actually true. (This is also relevant to our previous discussion about consciousness.)
And in Eliezer’s theory, some moral claims are actually true, and some are actually false. So I agree with him that his theory is realist.
I do disagree with his theory, however, insofar as it implies that “what we care about” is essentially arbitrary, even if it is what it is.
That (whether moral claims are actually true or false) is exactly how I distinguish moral realism from moral nonrealism, and I think this is a standard way to understand the terms.
But any nonrealist theory can be made into one in which moral claims have truth values by redefining the key words; my suggestion is that Eliezer’s theory is of this kind, that it is nearer to a straightforwardly nonrealist theory, which it becomes if e.g. you replace his use of terms like “good” with terms that are explicit about what value system the reference (“good according to human values”) than to typical more ambitious realist theories that claim that moral judgements are true or false according to some sort of moral authority that goes beyond any particular person’s or group’s or system’s values.
I agree that the typical realist theory implies more objectivity than is present in Eliezer’s theory. But in the same way, the typical non-realist theory implies less objectivity than is present there. E.g. someone who says that “this action is good” just means “I want to do this action” has less objectivity, because it will vary from person to person, which is not the case in Eliezer’s theory.
I think we are largely agreed as to facts and disagree only on whether it’s better to call Eliezer’s theory, which is intermediate between many realist theories and many non-realist theories, “realist” or “non-realist”.
I’m not sure, though, that someone who says that “this is good” = “I want to do this” is really a typical non-realist. My notion of a typical non-realist—typical, I mean, among people who’ve actually thought seriously about this stuff—is somewhat nearer to Eliezer’s position than that.
Anyway, the reason why I class Eliezer’s position as non-realist is that the distinction between Eliezer’s position and that of many (other?) non-realists is purely terminological—he agrees that there are all these various value systems, and that if ours seems special to us that’s because it’s ours rather than because of some agent-independent feature of the universe that picks ours out in preference to others, but he wants to use words like “good” to refer to one particular value system—whereas the distinction between his position and that of most (other?) realists goes beyond terminology: they say that the value system they regard as real is actually built into the fabric of reality in some way that goes beyond the mere fact that it’s our (or their) value system.
You may weight these differences differently.
I think he wants a system which works like realism, in that there are definite answers to ethical questions (“fixed”, “frozen”) ,but without spookiness.
Yudkowsky,’s theory entails the same problem as relativism: if morality is whatever people value, and if what people happen to value is intuitively immoral , slavery, torture,whatever, then there’s no fixed standard of morality. The label “moral” has been placed on a moving target. (Standard relativism usually has this problem synchronously , ie different communities are said to have different but equally valid moralities at the same time, but it makes little difference if you are asserting that the global community has different but equally valid moralities at different times)
You can avoid the problems of relativism by setting up an external standard, and there are many theories of that type, but they tend to have the problem that the external standard is not naturalistic....God’s commands, the Form of the good, and so on. I think Yudkowsky wants a theory that is non arbitrary and also naturalistic. I don’t think he arrives a single theory that does both. If the Moral Equation is just a label for human intuition, then it ssuffers from all the vagaries of labeling values as moral, the original theory. If the Moral Equation is something ideal and abstract, why can’t aliens partake?
I agree.