Quoting Eliezer: “A minor, muddled preference of 60% of humanity might be countered by a strong, unmuddled preference of 10% of humanity.” So any good Marxist will be able to imagine the rich and powerful getting their way in the computation of CEV just as they get their way today: by inducing muddle in the masses.
There’s little reason for them to bother with such nonsense—if they are building and paying for the thing in the first place.
CEV may be a utilitarian’s wet dream—but it will most-likely look like a crapshoot to the millionaires who are actually likely to be building machine intelligence.
There’s little reason for them to bother with such nonsense—if they are building and paying for the thing in the first place.
CEV may be a utilitarian’s wet dream—but it will most-likely look like a crapshoot to the millionaires who are actually likely to be building machine intelligence.