And I think claim 5 is basically in line with what, say, Bostrom would discuss (where stabilization is a thing to do before we attempt to build a sovereign).
You mean in the sense of stabilizing the whole world? I’d be surprised if that’s what Yann had in mind. I took him just to mean building a specialized AI to be a check on a single other AI.
the defensive AI systems designed to protect against rogue AI systems are not akin to the military, they are akin to the police, to law enforcement. Their “jurisdiction” would be strictly AI systems, not humans.
To be clear, I think he would mean it more in the way that there’s currently an international police order that is moderately difficult to circumvent, and that the same would be true for AGI, and not necessarily the more intense variants of stabilization (which are necessarily primarily if you think offense is highly advantaged over defense, which I don’t know his opinion on).
You mean in the sense of stabilizing the whole world? I’d be surprised if that’s what Yann had in mind. I took him just to mean building a specialized AI to be a check on a single other AI.
That’s how I interpreted:
To be clear, I think he would mean it more in the way that there’s currently an international police order that is moderately difficult to circumvent, and that the same would be true for AGI, and not necessarily the more intense variants of stabilization (which are necessarily primarily if you think offense is highly advantaged over defense, which I don’t know his opinion on).