Other parties, China being the most visible, but any party outside of us government control gaining an insurmountable advantage from unrestricted r&d on this technology. If you accept the premise that government restrictions slow everything down, and you appear to hold that belief, you have the possibility of people building open agency AGIs and using them to end the geopolitical game.
Empire building and one party conquering this tiny planet was always limited by the inefficiencies of large governments and nuclear weapons. Both potentially counterable to a party with open agency AGIs.
You seem to have fixed on the conclusion that the “banana is poisoned” without considering obvious ways we could eat it and get superpowers.
I think China becoming more of a threat than it currently is (very little) might be good since it might be the Boogeyman the US gov needs to take appropriate action.
Sure but that action means more AI development and most chip fabs so that the USA is not solely dependent on factories within easy low end missile range of china
Zvi you totally ignored the risks of:
Other parties, China being the most visible, but any party outside of us government control gaining an insurmountable advantage from unrestricted r&d on this technology. If you accept the premise that government restrictions slow everything down, and you appear to hold that belief, you have the possibility of people building open agency AGIs and using them to end the geopolitical game.
Empire building and one party conquering this tiny planet was always limited by the inefficiencies of large governments and nuclear weapons. Both potentially counterable to a party with open agency AGIs.
You seem to have fixed on the conclusion that the “banana is poisoned” without considering obvious ways we could eat it and get superpowers.
I think China becoming more of a threat than it currently is (very little) might be good since it might be the Boogeyman the US gov needs to take appropriate action.
Sure but that action means more AI development and most chip fabs so that the USA is not solely dependent on factories within easy low end missile range of china