The first is that you ought to read the Metaethics sequence (long version) or Value Theory (abridged version).
Why? Does it solve everything? Does it make any good points?
Knowing how our current values arose is reason for pessimism about whether AIs we create will share our values, about humanity’s values in unsteered futures, and about what the values of aliens might look like.
I am very unconvinced that we humans have a single coherent set of values, and reading the metaethics sequence did not change my mind—the claim is assumed , not proven.
Why? Does it solve everything? Does it make any good points?
I am very unconvinced that we humans have a single coherent set of values, and reading the metaethics sequence did not change my mind—the claim is assumed , not proven.
(A commentator notices the problem: https://www.lesswrong.com/posts/fG3g3764tSubr6xvs/the-meaning-of-right?commentId=pgSokbnCJDWPbCRDC No one solves it)(But you responded by editing out the link to Meaning of Right).
Would that have been true if stated by a roman slave owner? If his values were wrong then, yours could be now.
(A commentator notes the problem—well, he uses Washington, not a Roman: https://www.lesswrong.com/posts/fG3g3764tSubr6xvs/the-meaning-of-right?commentId=eR5f6SZS3iJydHQsH)