All you’ve done is write down your own beliefs and feelings (that it is a good thing that the child was pulled off the train tracks), reified it, and then claimed objectivity. But clearly, if you had had a different belief in the first place, you would have reified a different question/notion of morality. Yes, it is an objective fact that that is is what you think is moral, but I feel that this is unhelpful.
And, of course, this lack of objectivity leads to problems, because different people will have their own notions of goodness. My notion of goodness may be slightly different to yours—how can we have a sensible conversation where you insist on using the word “morality” to refer to morality_Eliezer2008? (Or worse still, where you use “moral” to mean “the morality that CEV outputs”)
All you’ve done is write down your own beliefs and feelings (that it is a good thing that the child was pulled off the train tracks), reified it, and then claimed objectivity. But clearly, if you had had a different belief in the first place, you would have reified a different question/notion of morality. Yes, it is an objective fact that that is is what you think is moral, but I feel that this is unhelpful.
And, of course, this lack of objectivity leads to problems, because different people will have their own notions of goodness. My notion of goodness may be slightly different to yours—how can we have a sensible conversation where you insist on using the word “morality” to refer to morality_Eliezer2008? (Or worse still, where you use “moral” to mean “the morality that CEV outputs”)