Would the first AI want more AI’s around? Wouldn’t it compete more with AI’s than with humans for resources? Or do you assume that humans, having made an AI smarter than an individual human, would work to network AI’s into something even smarter?
Either way, the scaling issue is interesting. I would expect the gain from networking AI’s to differ from the gain from networking humans, but I’m not sure which would work better. Differences among individual humans are a potential source of conflict, but can also make the whole greater than the sum of the parts. I wouldn’t expect complementarity among a bunch of identical AI’s. Generating useful differences would be an interesting problem.
If there is more to be gained by adding an additional AI then there is to be gained by scaling up the individual AI, then the best strategy for the AI is to create more AI’s with the same utility function.
Edited to add: Unless, perhaps, the AI had an explicit dislike of creating others, in which case it would be a matter of which effect was stronger.
Would the first AI want more AI’s around? Wouldn’t it compete more with AI’s than with humans for resources? Or do you assume that humans, having made an AI smarter than an individual human, would work to network AI’s into something even smarter?
Either way, the scaling issue is interesting. I would expect the gain from networking AI’s to differ from the gain from networking humans, but I’m not sure which would work better. Differences among individual humans are a potential source of conflict, but can also make the whole greater than the sum of the parts. I wouldn’t expect complementarity among a bunch of identical AI’s. Generating useful differences would be an interesting problem.
If there is more to be gained by adding an additional AI then there is to be gained by scaling up the individual AI, then the best strategy for the AI is to create more AI’s with the same utility function.
Edited to add: Unless, perhaps, the AI had an explicit dislike of creating others, in which case it would be a matter of which effect was stronger.