The problem in that case is that I’m not sure your b) is true. I certainly hope it is. I agree that it’s unclear. That’s why I’d like to get more analysis of a multipolar human-controlled ASI scenario. I don’t think people have thought about this very seriously yet.
Absolutely. I mentioned getting advice briefly in this short article and a little more in Instruction-following AGI is easier...
The problem in that case is that I’m not sure your b) is true. I certainly hope it is. I agree that it’s unclear. That’s why I’d like to get more analysis of a multipolar human-controlled ASI scenario. I don’t think people have thought about this very seriously yet.