While Eliezer’s moral judgments are tentative, and he would update them if he had access to IE, he does have a process for making judgments that is distinct from thinking about the decisions of FAIs and ideal selves. IE will presumably base decisions entirely on these factors.
Agreed, but when IE is making decisions (using a process that is distinct from thinking about the decisions of FAIs and ideal selves), do the words “morality” or “should” ever enter into his mind and end up making a difference in his decisions? If so, what does he mean by them?
“Morality” describes (the result of) the process he uses. The thing as a whole is about morality, it is not an aspect in his decision process. Morality is the sum of the thousand shards of desire.
While Eliezer’s moral judgments are tentative, and he would update them if he had access to IE, he does have a process for making judgments that is distinct from thinking about the decisions of FAIs and ideal selves. IE will presumably base decisions entirely on these factors.
Agreed, but when IE is making decisions (using a process that is distinct from thinking about the decisions of FAIs and ideal selves), do the words “morality” or “should” ever enter into his mind and end up making a difference in his decisions? If so, what does he mean by them?
“Morality” describes (the result of) the process he uses. The thing as a whole is about morality, it is not an aspect in his decision process. Morality is the sum of the thousand shards of desire.