Manfred comments on Tool/​Agent distinction in the light of the AI box experiment

[Manfred]

Is there some reason a simple program can’t “have goals different from those of the outside world?”