I truly and honestly say to you, Roko, that while you got most of my points, maybe even 75% of my points, there seems to be a remaining point that is genuinely completely lost on you. And a number of other people. It is a difficult point. People here are making fun of my attempt to explain it using an analogy to Lob’s Theorem, as if that was the sort of thing I did on a whim, or because of being stupid. But… my dear audience… really, by this point, you ought to be giving me the benefit of the doubt about that sort of thing.
Also, it appears from the comment posted below and earlier that this mysterious missed point is accessible to, for example, Nick Tarleton.
It looks to me like the opposing position is not based on disagreement with this point but rather outright failure to understand what is being said.
Well, you did make a claim about what is the right translation when speaking to babyeaters:
we and they are talking about a different subject matter and it is an error of the computer translation programs that the word comes out as “morality” in both cases. Morality is about how to save babies, not eat them, everyone knows that and they happen to be right. If we could get past difficulties of the translation, the babyeaters would agree with us about what is moral, we would agree with them about what is babyeating
But there has to be some standard by which you prefer the explanation “we mistranslated the term ‘morality’” to “we disagree about morality”, right? What is that? Presumably, one could make your argument about any two languages, not just ones with a species gap:
“We and Spaniards are talking about a different subject matter and it is an error of the computer translation programs that the word comes out as “morality” in both cases. Morality is about how to protect freedoms, not restrict them, everyone knows that and they happen to be right. If we could get past difficulties of the translation, the Spaniards would agree with us about what is moral, we would agree with them about what is familydutyhonoring.”
ETA: A lot of positive response to this, but let me add that I think a better term in the last place would be something like “morality-to-Spaniards”. The intuition behind the original phrasing was to show how you can redefine Spanish standards of morality to be “not-morality”, but rather, just “things that we place different priority on”.
But it’s clearly absurd there: the correct translation of ética is not “ethics-to-Spaniards”, but rather, just plain old “ethics”. And the same reasoning should apply to the babyeather case.
To go a step further, moral disagreement doesn’t require a language barrier at all.
“We and abolitionists are talking about a different subject matter and it is an error of the “computer translation programs” that the word comes out as “morality” in both cases. Morality is about how to create a proper relationship between races, everyone knows that and they happen to be right. If we could get past difficulties of the “translation”, the abolitionists would agree with us about what is moral, we would agree with them about what is abolitionism.”
Also, it appears from the comment posted below and earlier that this mysterious missed point is accessible to, for example, Nick Tarleton.
he defines it (as I understand) in terms of an objective computation that happens to be instantiated by humans
No, I understand that your long list wouldn’t change if humanity itself changed, that if I altered every human to like eating babies, that wouldn’t make babyeating right, in the Eliezer world.
“the rightness computation that humanity just happens to instantiate” is different from “whatever computation humanity instantiates”
Because Eliezer made the ingenious move of redefining “should” to mean “do what we prefer”.
He doesn’t define it indexically (like this) or in terms of humans; as I understand it, he defines it in terms of an objective computation that happens to be instantiated by humans (No License to be Human).
Because Eliezer made the ingenious move of redefining “should” to mean “do what we prefer”.
It is an internally consistent way of using language, it is just somewhat unique.
I truly and honestly say to you, Roko, that while you got most of my points, maybe even 75% of my points, there seems to be a remaining point that is genuinely completely lost on you. And a number of other people. It is a difficult point. People here are making fun of my attempt to explain it using an analogy to Lob’s Theorem, as if that was the sort of thing I did on a whim, or because of being stupid. But… my dear audience… really, by this point, you ought to be giving me the benefit of the doubt about that sort of thing.
Also, it appears from the comment posted below and earlier that this mysterious missed point is accessible to, for example, Nick Tarleton.
It looks to me like the opposing position is not based on disagreement with this point but rather outright failure to understand what is being said.
Well, you did make a claim about what is the right translation when speaking to babyeaters:
But there has to be some standard by which you prefer the explanation “we mistranslated the term ‘morality’” to “we disagree about morality”, right? What is that? Presumably, one could make your argument about any two languages, not just ones with a species gap:
“We and Spaniards are talking about a different subject matter and it is an error of the computer translation programs that the word comes out as “morality” in both cases. Morality is about how to protect freedoms, not restrict them, everyone knows that and they happen to be right. If we could get past difficulties of the translation, the Spaniards would agree with us about what is moral, we would agree with them about what is familydutyhonoring.”
ETA: A lot of positive response to this, but let me add that I think a better term in the last place would be something like “morality-to-Spaniards”. The intuition behind the original phrasing was to show how you can redefine Spanish standards of morality to be “not-morality”, but rather, just “things that we place different priority on”.
But it’s clearly absurd there: the correct translation of ética is not “ethics-to-Spaniards”, but rather, just plain old “ethics”. And the same reasoning should apply to the babyeather case.
To go a step further, moral disagreement doesn’t require a language barrier at all.
“We and abolitionists are talking about a different subject matter and it is an error of the “computer translation programs” that the word comes out as “morality” in both cases. Morality is about how to create a proper relationship between races, everyone knows that and they happen to be right. If we could get past difficulties of the “translation”, the abolitionists would agree with us about what is moral, we would agree with them about what is abolitionism.”
No, I understand that your long list wouldn’t change if humanity itself changed, that if I altered every human to like eating babies, that wouldn’t make babyeating right, in the Eliezer world.
“the rightness computation that humanity just happens to instantiate” is different from “whatever computation humanity instantiates”
Is there something else I am missing?
Eliezer uses the word “should” in what seems to me to be a weird and highly counter-intuitive way.
Multiple people have advised him about this—but he seems to like his usage.
He doesn’t define it indexically (like this) or in terms of humans; as I understand it, he defines it in terms of an objective computation that happens to be instantiated by humans (No License to be Human).