If the robot knows that its camera is indestructible but its gun isn’t, it would still shoot at the mirror and destroy only its gun.
So it would be [I SEE BLUE AND I TRY TO SHOOT].
… except that it wouldn’t mind if shooting itself damaged its own program so that it wouldn’t even try to shoot if it saw blue anymore.
Ok, I am inclined to agree that its behaviour can’t be described in terms of goals.
If the robot knows that its camera is indestructible but its gun isn’t, it would still shoot at the mirror and destroy only its gun.
So it would be [I SEE BLUE AND I TRY TO SHOOT].
… except that it wouldn’t mind if shooting itself damaged its own program so that it wouldn’t even try to shoot if it saw blue anymore.
Ok, I am inclined to agree that its behaviour can’t be described in terms of goals.