Stopping is one of the simplest possible desires—and you have a better chance of being able to program that in than practically anything else.
It does seem to be a safety precaution that could reduce the consequences of some possible flaws in an AI design.
It does seem to be a safety precaution that could reduce the consequences of some possible flaws in an AI design.