The report doesn’t even mention one of the largest long-run problems, if autonomous robotic weapons proliferate: rebellion, or rather the lack of it. Numerous dictators and generals have found themselves looking at the wrong end of their soldiers’ weapons, because orders to slaughter their own populace (for example) were unacceptable to those who would have to carry them out. That might end, if robotic soldiers come to hold more firepower than flesh and blood ones.
It’s possible in principle, of course, to build in safeguards, and safeguards for the safeguards (safeguards against reprogramming). But I’m not at all confident that sufficient consideration of the problem will be given.
The report doesn’t even mention one of the largest long-run problems, if autonomous robotic weapons proliferate: rebellion, or rather the lack of it. Numerous dictators and generals have found themselves looking at the wrong end of their soldiers’ weapons, because orders to slaughter their own populace (for example) were unacceptable to those who would have to carry them out. That might end, if robotic soldiers come to hold more firepower than flesh and blood ones.
It’s possible in principle, of course, to build in safeguards, and safeguards for the safeguards (safeguards against reprogramming). But I’m not at all confident that sufficient consideration of the problem will be given.