Isn’t that what you do with FAI in general by saying that the AI will have as its ultimate priority to implement CEV?
Nope, I don’t go around talking about it being the super top ultimate indefeatable priority. I just say, “Here’s a proposed decision criterion if I can (a) manage to translate it out of English and (b) code it stably.” It’s not the “ultimate priority”. It’s just a proposed what-it-does of the AI. The problem is not getting the AI to listen. The problem is translating something like CEV into nonmagical language.
Anyway, you are accusing me of having the same aesthetic as people you disagree with without actually attacking my claims, which is a fallacious argument.
Okay. Read the Dreams of Friendliness series—it’s not sequenced up yet, but hopefully you should be able to start there and click back on the dependency chain.
Nope, I don’t go around talking about it being the super top ultimate indefeatable priority. I just say, “Here’s a proposed decision criterion if I can (a) manage to translate it out of English and (b) code it stably.” It’s not the “ultimate priority”. It’s just a proposed what-it-does of the AI. The problem is not getting the AI to listen. The problem is translating something like CEV into nonmagical language.
Okay. Read the Dreams of Friendliness series—it’s not sequenced up yet, but hopefully you should be able to start there and click back on the dependency chain.