a ‘constitution’ matters only if it is within the goal system of a Friendly AI
Well, yes. I am assuming that the ‘constitution’ is part of the CEV, and we are both assuming that CEV or something like it is part of the goal system of the Friendly AI.
The whole reason for the discussion is that AI doesn’t really need permission or consent of anyone.
I wouldn’t say that it is the whole reason for the discussion, though that is the assumption explaining why many people consider it urgent to get the definition of Friendliness right on the first try. Personally, I think that it is a bad assumption—I believe it should be possible to avoid the all-powerful singleton scenario, and create a ‘society’ of slightly less powerful AIs, each of which really does need the permission and consent of its fellows to continue to exist. But a defense of that position also belongs in a separate discussion.
Well, yes. I am assuming that the ‘constitution’ is part of the CEV, and we are both assuming that CEV or something like it is part of the goal system of the Friendly AI.
I wouldn’t say that it is the whole reason for the discussion, though that is the assumption explaining why many people consider it urgent to get the definition of Friendliness right on the first try. Personally, I think that it is a bad assumption—I believe it should be possible to avoid the all-powerful singleton scenario, and create a ‘society’ of slightly less powerful AIs, each of which really does need the permission and consent of its fellows to continue to exist. But a defense of that position also belongs in a separate discussion.