Nick, note that he treats the pebblesorters in parallel with the humans. The pebblesorters’ values lead them to seek primeness and Eliezer optimistically supposes that human values lead humans to seek an analogous rightness.
What Eliezer is trying to say in that post, I think, is that he would not consider it right to eat babies even conditional on humanity being changed by the babyeaters to have their values.
But the choice to seek rightness instead of rightness’ depends on humans having values that lead to rightness instead of rightness’.
Nick, note that he treats the pebblesorters in parallel with the humans. The pebblesorters’ values lead them to seek primeness and Eliezer optimistically supposes that human values lead humans to seek an analogous rightness.
What Eliezer is trying to say in that post, I think, is that he would not consider it right to eat babies even conditional on humanity being changed by the babyeaters to have their values.
But the choice to seek rightness instead of rightness’ depends on humans having values that lead to rightness instead of rightness’.