Except the point of Yudkowsky’s “friendly AI” is that they don’t have freedom to pick their own goals, they have the goals we set to them, and they are (supposedly) safe in a sense that “wiping out humanity” is not something we want, therefore it’s not something an aligned AI would want. We don’t replicate evolution with AIs, we replicate careful design and engineering that humans have used for literally everything else. If there is only a handful of powerful AIs with careful restrictions on what their goals can be (something we don’t know how to do yet), then your scenario won’t happen
Except the point of Yudkowsky’s “friendly AI” is that they don’t have freedom to pick their own goals, they have the goals we set to them, and they are (supposedly) safe in a sense that “wiping out humanity” is not something we want, therefore it’s not something an aligned AI would want. We don’t replicate evolution with AIs, we replicate careful design and engineering that humans have used for literally everything else. If there is only a handful of powerful AIs with careful restrictions on what their goals can be (something we don’t know how to do yet), then your scenario won’t happen