J Thomas, whether or not foxes or rabbits think about morality seems to me to be the less interesting aspect of Tim Tyler’s comments.
As far as can tell this is more about algorithms and persistence. I aspire to value the persistence of my own algorithm as a subjective conscious entity. I can conceive of someone else who values maximizing the persistence odds of any subjective conscious entity that has ever existed above all. A third that values maximizing the persistence odds of any human who has ever lived above all. Eliezer seems to value maximizing the persistence of a certain algorithm of morality above all (even if it deoptimizing the persistence odds of all humans who have ever lived). Optimizing the persistence odds of these various algorithms seems to me to be in conflict with each other, much the algorithm of the fox having the rabbit in it’s belly is in conflict with the algorithm of the rabbit eating grass, outside of the foxes belly. It’s an interesting problem, although I do of course have my own preferred solution to it.
J Thomas, whether or not foxes or rabbits think about morality seems to me to be the less interesting aspect of Tim Tyler’s comments.
As far as can tell this is more about algorithms and persistence. I aspire to value the persistence of my own algorithm as a subjective conscious entity. I can conceive of someone else who values maximizing the persistence odds of any subjective conscious entity that has ever existed above all. A third that values maximizing the persistence odds of any human who has ever lived above all. Eliezer seems to value maximizing the persistence of a certain algorithm of morality above all (even if it deoptimizing the persistence odds of all humans who have ever lived). Optimizing the persistence odds of these various algorithms seems to me to be in conflict with each other, much the algorithm of the fox having the rabbit in it’s belly is in conflict with the algorithm of the rabbit eating grass, outside of the foxes belly. It’s an interesting problem, although I do of course have my own preferred solution to it.