If trying to invent ever more powerful AI is too dangerous, the focus should temporarily be shifted to the REAL goal. That would be to invent a solution to the problem of human death. More specifically a method to “back up” the mind contents of a human brain. Like, if you can back up your life’s work onto a USB, why not your memories and personality, at least somewhat? Figuring out how to do such a thing may or may not require godlike superhuman AI.
Backing up your mind doesn’t help defeat death if someone else then proceeds to invent powerful AI and disassemble your mind back-up for spare parts. One way or another, we need to figure out how to prevent the creation of powerful resource-grabbing AI.
If trying to invent ever more powerful AI is too dangerous, the focus should temporarily be shifted to the REAL goal. That would be to invent a solution to the problem of human death. More specifically a method to “back up” the mind contents of a human brain. Like, if you can back up your life’s work onto a USB, why not your memories and personality, at least somewhat? Figuring out how to do such a thing may or may not require godlike superhuman AI.
Backing up your mind doesn’t help defeat death if someone else then proceeds to invent powerful AI and disassemble your mind back-up for spare parts. One way or another, we need to figure out how to prevent the creation of powerful resource-grabbing AI.