I note that the solutions you mention for the second, less-addressed class of misuse only prevent people who aren’t officially in charge of AGI from misusing it; they don’t address government appropriation.
Governments have a monopoly on the use of force, and their self-perceived mandate includes all issues critical to national security. AGI is surely such an issue.
I expect that government will assume control of AGI if they see it coming before it’s smart enough to help its creators evade that control. And that would be very difficult in most foreseeable scenarios.
You can hop borders, but you’re just moving to another government’s jurisdiction.
I don’t have any better solutions to government misuse for a self-coup and permanent dictatorship. Any such solutions are probably political, not technical, and I know nothing about politics.
But it seems like we need to get some politically savvy people onboard before we have powerful AI aligned to its creators intent. Technical alignment is only a partial solution.
I think this is a valuable distinction.
I note that the solutions you mention for the second, less-addressed class of misuse only prevent people who aren’t officially in charge of AGI from misusing it; they don’t address government appropriation.
Governments have a monopoly on the use of force, and their self-perceived mandate includes all issues critical to national security. AGI is surely such an issue.
I expect that government will assume control of AGI if they see it coming before it’s smart enough to help its creators evade that control. And that would be very difficult in most foreseeable scenarios.
You can hop borders, but you’re just moving to another government’s jurisdiction.
I don’t have any better solutions to government misuse for a self-coup and permanent dictatorship. Any such solutions are probably political, not technical, and I know nothing about politics.
But it seems like we need to get some politically savvy people onboard before we have powerful AI aligned to its creators intent. Technical alignment is only a partial solution.