Not necessarily, depends on your AI and how god-like it is.
I hope you’re right. I just automatically think that AI is going to be god-like by default.
In the XIX century you could probably make the same argument about corporations
Not just corporations; you could make the some argument for sovereign states, foundations, trusts, militaries, and religious orgs.
Weak argument is that corporations with their visions, charters, and mission statements are ultimately run by a meatbag or run jointly by meatbags that die/retire, at least that’s how it currently is. You can’t retain humans forever. Corporations lose valuable and capable employee brains over time and replace them with new brains, which maybe better or worse, but you certainly cant keep your best humans forever. Power is checked; Bill Gates plans his legacy, while Sumner Redstone is infirm with kids jockeying for power and Steve Jobs is dead.
Well, the default on LW is EY’s FOOM scenario where an AI exponentially bootstraps itself into Transcendent Realms and, as you say, that’s it. The default in the rest of the world… isn’t like that.
I hope you’re right. I just automatically think that AI is going to be god-like by default.
Not just corporations; you could make the some argument for sovereign states, foundations, trusts, militaries, and religious orgs.
Weak argument is that corporations with their visions, charters, and mission statements are ultimately run by a meatbag or run jointly by meatbags that die/retire, at least that’s how it currently is. You can’t retain humans forever. Corporations lose valuable and capable employee brains over time and replace them with new brains, which maybe better or worse, but you certainly cant keep your best humans forever. Power is checked; Bill Gates plans his legacy, while Sumner Redstone is infirm with kids jockeying for power and Steve Jobs is dead.
Well, the default on LW is EY’s FOOM scenario where an AI exponentially bootstraps itself into Transcendent Realms and, as you say, that’s it. The default in the rest of the world… isn’t like that.