This is the interpretation I also have of Eliezer’s view, and it confuses me, as it applies to the story.
For example, I would expect aliens which do not value morality would be significantly more difficult to communicate with.
Also, the back story for the aliens gives a plausible argument for their actions as arising from a different path towards the same ultimate morality.
I interpreted the story as showing aliens which, as a quirk of their history and culture, have significant holes in their morality—holes which, given enough time, I would expect will disappear.
Also, the back story for the aliens gives a plausible argument for their actions as arising from a different path towards the same ultimate morality.
Really? Although babyeater_should coincides with akon_should on the notion of “toleration of reasonable mistakes” and on the Prisoner’s Dilemma, it seems clear from the story that these functions wouldn’t converge on the topic of “eating babies”. (If the Superhappies had their way, both functions would just be replaced by a new “compromise” function, but neither the Babyeaters nor the humans want that, and it appears to be the wrong choice according to both babyeater_should and akon_should.)
This is the interpretation I also have of Eliezer’s view, and it confuses me, as it applies to the story.
For example, I would expect aliens which do not value morality would be significantly more difficult to communicate with.
Also, the back story for the aliens gives a plausible argument for their actions as arising from a different path towards the same ultimate morality.
I interpreted the story as showing aliens which, as a quirk of their history and culture, have significant holes in their morality—holes which, given enough time, I would expect will disappear.
Really? Although babyeater_should coincides with akon_should on the notion of “toleration of reasonable mistakes” and on the Prisoner’s Dilemma, it seems clear from the story that these functions wouldn’t converge on the topic of “eating babies”. (If the Superhappies had their way, both functions would just be replaced by a new “compromise” function, but neither the Babyeaters nor the humans want that, and it appears to be the wrong choice according to both babyeater_should and akon_should.)