Why do you restrict Strong Friendliness to human values? Is there some value which an intelligence can have that can never be a human value?
Because we’re the one that has to live with the thing, and I don’t know but my inclination is that the answer is “Yes”
Implication: A Strongly Friendly (paperclip maximizer) AI is actually a meaningful phrase. (As opposed to all Strongly Friendly AIs being compatible with everyone)
Why all human values?
Why do you restrict Strong Friendliness to human values? Is there some value which an intelligence can have that can never be a human value?
Because we’re the one that has to live with the thing, and I don’t know but my inclination is that the answer is “Yes”
Implication: A Strongly Friendly (paperclip maximizer) AI is actually a meaningful phrase. (As opposed to all Strongly Friendly AIs being compatible with everyone)
Why all human values?