Kingfisher’s definition of clarity is actually not quite right. In order to be clear, you have to carve reality at the joints. That’s what the problem was with the Intelligence vs. Wisdom post; there wasn’t anything obviously false, at least that I noticed, but it seemed to be dividing up concept space in an unnatural way. Similarly with this post. For example, “selfish” is a natural concept for humans, who have a basic set of self-centered goals by default, which they balance against non-self-centered goals like improving their community. But if you take that definition and try to transfer it to AIs, you run into trouble, because they don’t have those self-centered goals, so if you want to make sense of it you have to come up with a new definition. Is an AI that optimizes the happiness of its creator, at the expense of other humans, being selfish? How about the happiness of its creator’s friends, at the expense of humanity in general? How about humanity’s happiness, at the expense of other terrestrial animals?
Using fuzzy words in places where they don’t belong hides a lot of complexity. One way that people respond to that is by coming up with things that the words could mean, and presenting them as counterexamples. You seem to have misinterpreted that as presenting straw-men; it’s not saying that the best interpretation is wrong, but rather, saying that the phrasing was vague enough to admit some bad interpretations.
I would also like to add that detecting confusion, both in our own thoughts and in things we read, is one of the main skills of rationality. People here are, on average, much more sensitive to confusion than most people.
Kingfisher’s definition of clarity is actually not quite right. In order to be clear, you have to carve reality at the joints. That’s what the problem was with the Intelligence vs. Wisdom post; there wasn’t anything obviously false, at least that I noticed, but it seemed to be dividing up concept space in an unnatural way. Similarly with this post. For example, “selfish” is a natural concept for humans, who have a basic set of self-centered goals by default, which they balance against non-self-centered goals like improving their community. But if you take that definition and try to transfer it to AIs, you run into trouble, because they don’t have those self-centered goals, so if you want to make sense of it you have to come up with a new definition. Is an AI that optimizes the happiness of its creator, at the expense of other humans, being selfish? How about the happiness of its creator’s friends, at the expense of humanity in general? How about humanity’s happiness, at the expense of other terrestrial animals?
Using fuzzy words in places where they don’t belong hides a lot of complexity. One way that people respond to that is by coming up with things that the words could mean, and presenting them as counterexamples. You seem to have misinterpreted that as presenting straw-men; it’s not saying that the best interpretation is wrong, but rather, saying that the phrasing was vague enough to admit some bad interpretations.
I would also like to add that detecting confusion, both in our own thoughts and in things we read, is one of the main skills of rationality. People here are, on average, much more sensitive to confusion than most people.