Not only that, but if your goals is to create a powerful army of AIs the last thing you’d want to do is make them all identical. Any reason you’re going to choose for why there are a huge number of AI instances in the first place—as assumed by this argument—would want those AIs to be diverse, not identical, and that very diversity would argue against “emergent convergence”. You then have to revert to the “independently emerging common sub-goals” argument, which is a significantly bigger stretch because of the many additional assumptions it makes.
Not only that, but if your goals is to create a powerful army of AIs the last thing you’d want to do is make them all identical. Any reason you’re going to choose for why there are a huge number of AI instances in the first place—as assumed by this argument—would want those AIs to be diverse, not identical, and that very diversity would argue against “emergent convergence”. You then have to revert to the “independently emerging common sub-goals” argument, which is a significantly bigger stretch because of the many additional assumptions it makes.