Which kinds of power do you refer to? Most kinds of power require human cooperation. The danger that an AI tricks us into destroying ourselves is small (though a false detection of nuclear weapons could do it). We need much more cooperation between world leaders, a much more positive dialogue between them.
Yes, you need human cooperation but human cooperation isn’t hard. You can easily pay people money to get them to do what you want.
With time more processes can use robots instead of humans for doing physical work and if the AGI already has all the economic and political power there’s nothing to stop the AGI from doing that.
The AGI might then reuse land that’s currently used for growing food for other purposes and step by step reduce the amount of food that’s available and there never needs to be a point where a human thinks that they are working for the destruction of humanity.
More stringent (in-person) verification of bank account ownership could mitigate this risk.
Anyways, the chance of discovery for any covert operation is proportional to the size of the operation and the time that it takes to execute. The more we pre-limit the tools available to a rogue machine to cause harm immediate harm, the more likely we will catch it in the act.
There’s no need for anything being covert. NetDragon Websoft is already having a chatbot as CEO. That chatbot can get funds wired by giving orders to employees.
If the chat bot would be a superintelligence, that would allow it to outcompete other companies.
Which kinds of power do you refer to? Most kinds of power require human cooperation. The danger that an AI tricks us into destroying ourselves is small (though a false detection of nuclear weapons could do it). We need much more cooperation between world leaders, a much more positive dialogue between them.
Yes, you need human cooperation but human cooperation isn’t hard. You can easily pay people money to get them to do what you want.
With time more processes can use robots instead of humans for doing physical work and if the AGI already has all the economic and political power there’s nothing to stop the AGI from doing that.
The AGI might then reuse land that’s currently used for growing food for other purposes and step by step reduce the amount of food that’s available and there never needs to be a point where a human thinks that they are working for the destruction of humanity.
More stringent (in-person) verification of bank account ownership could mitigate this risk.
Anyways, the chance of discovery for any covert operation is proportional to the size of the operation and the time that it takes to execute. The more we pre-limit the tools available to a rogue machine to cause harm immediate harm, the more likely we will catch it in the act.
There’s no need for anything being covert. NetDragon Websoft is already having a chatbot as CEO. That chatbot can get funds wired by giving orders to employees.
If the chat bot would be a superintelligence, that would allow it to outcompete other companies.