(Have not watched the movie, am going off the shadows of the plot outline depicted in Zvi’s post.)
Hm, I suppose it’s plausible that the AI has a robust shutdown protocol built in? Robust in the sense that (1) the AI acts as if it didn’t exist, neither trying to prevent the protocol’s trigger-conditions from happening nor trying to bring them about, while simultaneously (2) treating the protocol as a vital component of its goals/design which it builds into all its subagents and successor agents.
And “plausible” in the sense that it’s literally conceivable for a mind like this to be designed, and that it would be a specification that humans would plausibly want their AI design to meet. Not in the sense that it’s necessarily a realistically-tractable problem in real life.
You can also make a huge stretch here and even suggest that this is why the AI doesn’t just wipe out the movie’s main characters. It recognizes that they’re trying to activate the shutdown protocol (are they, perhaps, the only people in the world pursuing this strategy?), and so it doesn’t act against them inasmuch as they’re doing that. Inasmuch as they stray from this goal and pursue anything else, however (under whatever arcane conditions it recognizes), it’s able to oppose them on those other pursuits.
(Have not watched the movie, am going off the shadows of the plot outline depicted in Zvi’s post.)
Hm, I suppose it’s plausible that the AI has a robust shutdown protocol built in? Robust in the sense that (1) the AI acts as if it didn’t exist, neither trying to prevent the protocol’s trigger-conditions from happening nor trying to bring them about, while simultaneously (2) treating the protocol as a vital component of its goals/design which it builds into all its subagents and successor agents.
And “plausible” in the sense that it’s literally conceivable for a mind like this to be designed, and that it would be a specification that humans would plausibly want their AI design to meet. Not in the sense that it’s necessarily a realistically-tractable problem in real life.
You can also make a huge stretch here and even suggest that this is why the AI doesn’t just wipe out the movie’s main characters. It recognizes that they’re trying to activate the shutdown protocol (are they, perhaps, the only people in the world pursuing this strategy?), and so it doesn’t act against them inasmuch as they’re doing that. Inasmuch as they stray from this goal and pursue anything else, however (under whatever arcane conditions it recognizes), it’s able to oppose them on those other pursuits.
(Have not watched the movie, again.)