Yes. There are lots of optimization processes built into us humans, but they feel natural to us, or we simply don’t notice them. Stating something that you want to optimize for, especially if it is something that seems to impose itself on the entire structure of the universe, is not natural for humans. And that goal, if implemented would restrict the individual’s freedoms. And that humans really don’t like.
I think this all makes sense when you are trying to live together in a society, but I am not sure if we should blindly extrapolate these intuitions to determine what we want in the far future.
I am not sure if we should blindly extrapolate these intuitions to determine what we want in the far future.
I’m pretty sure we shouldn’t. Note that “blindly” is a pretty biased way to describe something if you’re not trying to skew the discussion. I’m pretty sure we shouldn’t even knowingly and carefully extrapolate these intuitions terribly far into the future. I’m not sure whether we have a choice, though—it seems believable that a pure laissez-faire attitude toward future values leads to dystopia or extinction.
Yes. There are lots of optimization processes built into us humans, but they feel natural to us, or we simply don’t notice them. Stating something that you want to optimize for, especially if it is something that seems to impose itself on the entire structure of the universe, is not natural for humans. And that goal, if implemented would restrict the individual’s freedoms. And that humans really don’t like.
I think this all makes sense when you are trying to live together in a society, but I am not sure if we should blindly extrapolate these intuitions to determine what we want in the far future.
I’m pretty sure we shouldn’t. Note that “blindly” is a pretty biased way to describe something if you’re not trying to skew the discussion. I’m pretty sure we shouldn’t even knowingly and carefully extrapolate these intuitions terribly far into the future. I’m not sure whether we have a choice, though—it seems believable that a pure laissez-faire attitude toward future values leads to dystopia or extinction.