We typically imagine CEV asking what people would do if they ‘knew what the AI knew’
No, we don’t, because this would be a stupid question. CEV doesn’t ask people, CEV tells people what they want.
any well-programmed FAI would expect ‘more knowledgeable versions of us’ to become atheists on general principles.
I see little evidence to support this point of view. You might think that atheism is obvious, but a great deal of people, many of them smarter than you, disagree.
No, we don’t, because this would be a stupid question. CEV doesn’t ask people, CEV tells people what they want.
I see little evidence to support this point of view. You might think that atheism is obvious, but a great deal of people, many of them smarter than you, disagree.