I’ve actually been moving in the opposite direction, thinking that the gameboard might not be flipped over, and actually life will stay mostly the same. Political movements to block superintelligence seem to be gaining steam, and people are taking it seriously.
(Even for more mundane AI, I think it’s fairly likely that we’ll be soon moving “backwards” on that as well, for various reasons which I’ll be writing posts about in the coming week or two if all goes well.)
Also, some social groups will inevitably internally “ban” certain technologies if things get weird. There’s too much that people like about the current world, to allow that to be tossed away in favor of such uncertainty.
these social movements only delay AI. unless you ban all computers in all countries, after a while someone, somewhere will figure out how to build {AI that takes over the world} in their basement, and the fate of the lightcone depends on whether that AI is aligned or not.
I’ve actually been moving in the opposite direction, thinking that the gameboard might not be flipped over, and actually life will stay mostly the same. Political movements to block superintelligence seem to be gaining steam, and people are taking it seriously.
(Even for more mundane AI, I think it’s fairly likely that we’ll be soon moving “backwards” on that as well, for various reasons which I’ll be writing posts about in the coming week or two if all goes well.)
Also, some social groups will inevitably internally “ban” certain technologies if things get weird. There’s too much that people like about the current world, to allow that to be tossed away in favor of such uncertainty.
these social movements only delay AI. unless you ban all computers in all countries, after a while someone, somewhere will figure out how to build {AI that takes over the world} in their basement, and the fate of the lightcone depends on whether that AI is aligned or not.