Yeah, I did mostly mean “How should they be programmed to go about it?” But another possibility is that some AI safety schemes specify that if the AI is unsure about something that may be highly consequential, it should ask the user or operator what to do, so how they should answer if the AI asks how to merge with another AI is also part of it.
I don’t know very much about AI at all however this question struck me as odd;
How should two AIs that want to merge with each other aggregate their preferences?
If they are AI wouldn’t they do it however they wanted to? Or is the question “how should they be programmed to go about it?”
Yeah, I did mostly mean “How should they be programmed to go about it?” But another possibility is that some AI safety schemes specify that if the AI is unsure about something that may be highly consequential, it should ask the user or operator what to do, so how they should answer if the AI asks how to merge with another AI is also part of it.