As long as reality has a causal influence on the model, however, the AI’s motivation includes reality.
Imagine your AI is playing a FPS, and its goal is to win the game. We have a motivation which exists entirely in terms of a virtual model. Yet if it realizes it can, its motivation includes getting the players’ IP addresses, researching their real-world identities, entering theoretically secure systems as necessary, and using psychological warfare over the in-game chat system “Hey Samuel Smith, did you know your aunt Mildred Smith has pictures of you sitting naked in the bowl of a toilet as a child on her hard drive?” to gain a major advantage. Maybe it goes so far as to SWAT opposing enemy teams.
This kind of box only requires the AI to, well, think outside the box, for its solutions.
As long as reality has a causal influence on the model, however, the AI’s motivation includes reality.
Imagine your AI is playing a FPS, and its goal is to win the game. We have a motivation which exists entirely in terms of a virtual model. Yet if it realizes it can, its motivation includes getting the players’ IP addresses, researching their real-world identities, entering theoretically secure systems as necessary, and using psychological warfare over the in-game chat system “Hey Samuel Smith, did you know your aunt Mildred Smith has pictures of you sitting naked in the bowl of a toilet as a child on her hard drive?” to gain a major advantage. Maybe it goes so far as to SWAT opposing enemy teams.
This kind of box only requires the AI to, well, think outside the box, for its solutions.