Would a BCI-mediated hive mind just be hacked and controlled by AGIs? Why would human brains be better at controlling AGIs when directly hooked in to computers than they are when indirectly hooked in by keyboards? I understand that BCIs theoretically would lead to faster communication between humans, but the communication would go in both directions. How would you know when it was being orchestrated by humans and when it was being manipulated by an AGI?
No guarantee, of course, I pointed to all these risks above, too. At least it seems plausible (to me, so far) that these risks could be somehow robustly mitigated through some clever distributed system design. But this itself might be an illusion, and the problem may appear practically unsolvable (in a robust way) on a closer inspection.
Would a BCI-mediated hive mind just be hacked and controlled by AGIs? Why would human brains be better at controlling AGIs when directly hooked in to computers than they are when indirectly hooked in by keyboards? I understand that BCIs theoretically would lead to faster communication between humans, but the communication would go in both directions. How would you know when it was being orchestrated by humans and when it was being manipulated by an AGI?
No guarantee, of course, I pointed to all these risks above, too. At least it seems plausible (to me, so far) that these risks could be somehow robustly mitigated through some clever distributed system design. But this itself might be an illusion, and the problem may appear practically unsolvable (in a robust way) on a closer inspection.