Absolutely. Main thing is one guy in his garage who hooks up an open source agi to some hand built robots that start assembling more of themselves is a totally different scale of threat than a multi square kilometer...or cubic kilometer....optimized factory that is making weapons.
Billions of times scale difference. And this points to a way to control AI—so long as the humans have a very large resource advantage, ideally billions of times, that they achieved with the help of “controlled” AI models, the humans can defend themselves against superintelligence.
But you won’t get a billion fold advantage with any AI pauses—you need a crash program to accelerate developing ai. You won’t get there without ai either, we don’t have enough living humans and besides, these large factories won’t have any concessions to humans. No hand rails, probably no breathable gas inside, etc.
Absolutely. Main thing is one guy in his garage who hooks up an open source agi to some hand built robots that start assembling more of themselves is a totally different scale of threat than a multi square kilometer...or cubic kilometer....optimized factory that is making weapons.
Billions of times scale difference. And this points to a way to control AI—so long as the humans have a very large resource advantage, ideally billions of times, that they achieved with the help of “controlled” AI models, the humans can defend themselves against superintelligence.
But you won’t get a billion fold advantage with any AI pauses—you need a crash program to accelerate developing ai. You won’t get there without ai either, we don’t have enough living humans and besides, these large factories won’t have any concessions to humans. No hand rails, probably no breathable gas inside, etc.