I do think that AIs will eventually get much smarter than humans, and this implies that artificial minds will likely capture the majority of wealth and power in the world in the future. However, I don’t think the way that we get to that state will necessarily be because the AIs staged a coup. I find more lawful and smooth transitions more likely.
I think my writing was ambiguous. My comment was supposed to read “similar constraints may apply to AIs unless one (AI) gets much smarter (than other AIs) much more quickly, as you say.” I was trying to say the same thing.
My original point was also not actually that we will face an abrupt transition or AI coup, I was just objecting to the specific example Meme Machine gave.
I think my writing was ambiguous. My comment was supposed to read “similar constraints may apply to AIs unless one (AI) gets much smarter (than other AIs) much more quickly, as you say.” I was trying to say the same thing.
My original point was also not actually that we will face an abrupt transition or AI coup, I was just objecting to the specific example Meme Machine gave.