If I was convinced that any AI built would destroy the world, I would advocate for a preemptive Butlerian Jihad. I would want coordinated dismantling of all supercomputing facilities (à la nuclear disarmament), which I would define as any system currently capable of training GPT-3. I would want global (NATO/China) coordination to shut down all major semiconductor fabrication plants. Despite my distaste for tyrannical policy, I would support government efforts to confiscate and destroy every Xbox, Playstation, and every GPU over 2 TFlops.
Since we are one or more key insights away from AGI, a small guerilla group with a Beowulf cluster would not be too much of a risk. Even a smallish rogue nation would not be too bad, as AI talent is highly concentrated in Europe, the USA, and China.
There’s no way world governments would coordinate around this, especially since it is a) a problem that most people barely understand and b) would completely cut off all human technological progress. No one would support this policy. Hell, even if ridiculously powerful aliens à la God came and told us that we weren’t allowed to build AGI on the threat of eternal suffering, I’m not sure world governments would coordinate around this.
If alignment was impossible, we might just be doomed.
If I was convinced that any AI built would destroy the world, I would advocate for a preemptive Butlerian Jihad. I would want coordinated dismantling of all supercomputing facilities (à la nuclear disarmament), which I would define as any system currently capable of training GPT-3. I would want global (NATO/China) coordination to shut down all major semiconductor fabrication plants. Despite my distaste for tyrannical policy, I would support government efforts to confiscate and destroy every Xbox, Playstation, and every GPU over 2 TFlops.
Since we are one or more key insights away from AGI, a small guerilla group with a Beowulf cluster would not be too much of a risk. Even a smallish rogue nation would not be too bad, as AI talent is highly concentrated in Europe, the USA, and China.
There’s no way world governments would coordinate around this, especially since it is a) a problem that most people barely understand and b) would completely cut off all human technological progress. No one would support this policy. Hell, even if ridiculously powerful aliens à la God came and told us that we weren’t allowed to build AGI on the threat of eternal suffering, I’m not sure world governments would coordinate around this.
If alignment was impossible, we might just be doomed.
Yeah. On the off chance that the CIA actually does run the government from the shadows, I really hope some of them lurk on LessWrong.