Yeah, this hits a key point. It’s not enough to ask whether the US Federal government is a better government currently. We must ask how it might look after the destabilizing effect of powerful AI is introduced. Who has ultimate control over this AI? The President? So much for checks and balances. At that point we are suddenly only still a democracy if the President wills it so. I would prefer not to put anyone in a position of such power over the world.
There has not been much discussion that I’ve seen for how keep a powerful AI directly operated by a small technical staff under the control of a democratic government and also keep that government a democracy.
Our democracy is problematically unstable and violent/imperial as it is. I do not put any credence in things not devolving upon advent of AGI.
Sometimes I jokingly suggest we give the reins of power over the AI to Switzerland, since they have the stereotype of being militarily neutral and having well-organized public goods. I don’t actually have the reins though, and see no way to get them into the Swiss government’s hands. Also, I still wouldn’t want Swiss government officials to have such power, since I’d still worry about the corrupting effects of the power.
I think we need new governance structures to handle this new strategic situation.
Yeah, this hits a key point. It’s not enough to ask whether the US Federal government is a better government currently. We must ask how it might look after the destabilizing effect of powerful AI is introduced. Who has ultimate control over this AI? The President? So much for checks and balances. At that point we are suddenly only still a democracy if the President wills it so. I would prefer not to put anyone in a position of such power over the world.
There has not been much discussion that I’ve seen for how keep a powerful AI directly operated by a small technical staff under the control of a democratic government and also keep that government a democracy.
Our democracy is problematically unstable and violent/imperial as it is. I do not put any credence in things not devolving upon advent of AGI.
Sometimes I jokingly suggest we give the reins of power over the AI to Switzerland, since they have the stereotype of being militarily neutral and having well-organized public goods. I don’t actually have the reins though, and see no way to get them into the Swiss government’s hands. Also, I still wouldn’t want Swiss government officials to have such power, since I’d still worry about the corrupting effects of the power.
I think we need new governance structures to handle this new strategic situation.