To be frank, I think I would trust a CEV more if the FAI would only extrapolate the volition of highly intelligent people.
By ‘extrapolated’ we mean that the FAI is calculating what the wishes of those people would be IF they were as intelligent and well-informed as the FAI.
Given that, what difference do you think it would make for the FAI to only scan intelligent people? I can imagine only negatives: a potential neglect of physical/non intellectuals pursuits as a potential source of Fun, greater political opposition if not everyone is scanned, harder time justifying the morality of letting something take control that doesn’t take EVERYONE’S desires into consideration...
By ‘extrapolated’ we mean that the FAI is calculating what the wishes of those people would be IF they were as intelligent and well-informed as the FAI.
I don’t think I understand this.
If the FAI would make Stalin as intelligent and well-informed as the FAI, then this newly created entity wouldn’t be Stalin anymore. In fact, it would be something totally different.
But maybe I’m just too stupid and there is some continuity of identity going on.
Then I have to ask: Why not extrapolate the volition of every animal on earth? If you can make Stalin intelligent and moral and you somehow don’t annihilate the personality of Stalin then I propose the same thing is possible for every (other) pig.
Now you could say something like ” Well, Stalin is an exception, he obviously was hopelessly evil”, but even today Stalin is the hero of many people.
To but it bluntly: Many folks seem to me rather stupid or malicious or both. If the FAI makes them “as intelligent and well-informed as the FAI itself” then they would be different people.
Anyway, these were only my misanthropic ramblings, and I don’t believe they are accurate, since they are probably at least partly caused by depression and frustration. But somehow I felt the urge to utter them;)
Look, I really hope this whole CEV-stuff makes sense, but I think I’m not the only one who doubts it. ( And not only ordinary folks like me, but e.g. Wei Dai, Phil Goetz, etc. )
Do you know of any further explanations of CEV besides this one?
If the FAI would make Stalin as intelligent and well-informed as the FAI, then this newly created entity wouldn’t be Stalin anymore. In fact, it would be something totally different.
Yeah, so? Nobody said the intelligently extrapolated volition of Stalin would be Stalin. It would be a parameter in the calculation parameters of the FAI.
But maybe I’m just too stupid and there is some continuity of identity going on.
We’re not talking about simulating people. We’re talking about extrapolating their volition. Continuity of identity has nothing to do with anything.
To put it bluntly: Many folks seem to me either utterly stupid or evil or both.If the FAI makes them “as intelligent and well-informed as the FAI itself” then they would be different people.
Which is the exact point, that we don’t want the current volition of people (since people are currently stupid), we want their extrapolated volition, what they would choose if they were much more intelligent than they currently are.
By ‘extrapolated’ we mean that the FAI is calculating what the wishes of those people would be IF they were as intelligent and well-informed as the FAI.
Given that, what difference do you think it would make for the FAI to only scan intelligent people? I can imagine only negatives: a potential neglect of physical/non intellectuals pursuits as a potential source of Fun, greater political opposition if not everyone is scanned, harder time justifying the morality of letting something take control that doesn’t take EVERYONE’S desires into consideration...
I don’t think I understand this. If the FAI would make Stalin as intelligent and well-informed as the FAI, then this newly created entity wouldn’t be Stalin anymore. In fact, it would be something totally different. But maybe I’m just too stupid and there is some continuity of identity going on. Then I have to ask: Why not extrapolate the volition of every animal on earth? If you can make Stalin intelligent and moral and you somehow don’t annihilate the personality of Stalin then I propose the same thing is possible for every (other) pig. Now you could say something like ” Well, Stalin is an exception, he obviously was hopelessly evil”, but even today Stalin is the hero of many people.
To but it bluntly: Many folks seem to me rather stupid or malicious or both. If the FAI makes them “as intelligent and well-informed as the FAI itself” then they would be different people.
Anyway, these were only my misanthropic ramblings, and I don’t believe they are accurate, since they are probably at least partly caused by depression and frustration. But somehow I felt the urge to utter them;) Look, I really hope this whole CEV-stuff makes sense, but I think I’m not the only one who doubts it. ( And not only ordinary folks like me, but e.g. Wei Dai, Phil Goetz, etc. ) Do you know of any further explanations of CEV besides this one?
Yeah, so? Nobody said the intelligently extrapolated volition of Stalin would be Stalin. It would be a parameter in the calculation parameters of the FAI.
We’re not talking about simulating people. We’re talking about extrapolating their volition. Continuity of identity has nothing to do with anything.
Which is the exact point, that we don’t want the current volition of people (since people are currently stupid), we want their extrapolated volition, what they would choose if they were much more intelligent than they currently are.