If a system identifies a human as an important part of itself it will strive to protect it and its normal functioning, as we instinctively protect important parts of ourselves such as the head and genitals.
So what possible objections to this are there?
How about: the use of the word “important” begs the question.
How about: the use of the word “important” begs the question.
Okay assuming omohundro’s AI drives, how do we get humans as part of the self that is preserved.