As actual society shows, hidden complexity of wishes make implementing social consensus hopeless
My basic point was that we shouldn’t worry about politics, at least not yet, because politics is a wonderful example of all the hard questions in CEV, and we haven’t even worked out the easy questions like how to prevent nuclear winter. My second point was that humans do seem to have a much clearer CEV when it comes to “prevent nuclear winter”, even if it’s still not unanimous.
Implicit in that should have been the idea that CEV is still ridiculously difficult. Just like intelligence, it’s something humans seem to have and use despite being unable to program for it.
So, then, summarized, I’m saying that we should perhaps work out the easy problems first, before we go throwing ourselves against harder problems like politics.
There’s not a clear dividing line between “easy” moral questions and hard moral questions. The Cold War, which massively increased the risk of nuclear winter, was a rational expression of Great Power relations between two powers.
Until we have mutually acceptable ways of resolving disputes when both parties are rationally protecting their interests, we can’t actually solve the easy problems either.
My basic point was that we shouldn’t worry about politics, at least not yet, because politics is a wonderful example of all the hard questions in CEV, and we haven’t even worked out the easy questions like how to prevent nuclear winter. My second point was that humans do seem to have a much clearer CEV when it comes to “prevent nuclear winter”, even if it’s still not unanimous.
Implicit in that should have been the idea that CEV is still ridiculously difficult. Just like intelligence, it’s something humans seem to have and use despite being unable to program for it.
So, then, summarized, I’m saying that we should perhaps work out the easy problems first, before we go throwing ourselves against harder problems like politics.
There’s not a clear dividing line between “easy” moral questions and hard moral questions. The Cold War, which massively increased the risk of nuclear winter, was a rational expression of Great Power relations between two powers.
Until we have mutually acceptable ways of resolving disputes when both parties are rationally protecting their interests, we can’t actually solve the easy problems either.
from you:
and from me:
So, um, we agree, huzzah? :)