Disaster doesn’t need to make humans extinct to stop AI takeover. Only destroy enough of our excess technological capacity to make it impossible for a hostile AI to come into existence with enough infrastructure to bootstrap itself to self-sufficiency where it doesn’t need humans anymore.
I guess it’s possible that the human population could drop by 90%, lose most tech and manufacturing capabilities, and recover within a few generations and pick up where today’s AI left off, only delaying the takeover. Kind of goes to the question of “what is doomed”? In some sense, every individual and species including the AI that FOOMs is doomed—something else will eventually replace it.
Disaster doesn’t need to make humans extinct to stop AI takeover. Only destroy enough of our excess technological capacity to make it impossible for a hostile AI to come into existence with enough infrastructure to bootstrap itself to self-sufficiency where it doesn’t need humans anymore.
I guess it’s possible that the human population could drop by 90%, lose most tech and manufacturing capabilities, and recover within a few generations and pick up where today’s AI left off, only delaying the takeover. Kind of goes to the question of “what is doomed”? In some sense, every individual and species including the AI that FOOMs is doomed—something else will eventually replace it.