Yvain: “that’s why I think Eliezer’s system is relative. I admit it’s not directly relative, in that Eliezer isn’t directly picking “Don’t murder” out of belief-space every time he wonders about murder, based only on human opinion. But if I understand correctly, he’s referring the question to another layer, and then basing that layer on human opinion.
An umpire whose procedure for making tough calls is “Do whatever benefits the Yankees” isn’t very fair. A second umpire whose procedure is “Always follow the rules in Rulebook X” and writes in Rulebook X “Do whatever benefits the Yankees” may be following a rulebook, but he is still just as far from objectivity as the last guy was.
I think the second umpire’s call is “correct” relative to Rulebook X, but I don’t think the call is absolutely correct.”
Yvain: “that’s why I think Eliezer’s system is relative. I admit it’s not directly relative, in that Eliezer isn’t directly picking “Don’t murder” out of belief-space every time he wonders about murder, based only on human opinion. But if I understand correctly, he’s referring the question to another layer, and then basing that layer on human opinion.
An umpire whose procedure for making tough calls is “Do whatever benefits the Yankees” isn’t very fair. A second umpire whose procedure is “Always follow the rules in Rulebook X” and writes in Rulebook X “Do whatever benefits the Yankees” may be following a rulebook, but he is still just as far from objectivity as the last guy was.
I think the second umpire’s call is “correct” relative to Rulebook X, but I don’t think the call is absolutely correct.”
I’d agree with this analysis. Well put.