Worth noting that this argument doesn’t necessarily require humans to be:
numerous
animated (i.e. not frozen in a cryonics process)
acting in real world (i.e. not confined into a “Matrix”).
Thus, the AI may decide to keep only a selection of humans, confined in a virtual world, with the rest being frozen.
Moreover, even the perfect Friendly AI may decide to do the same, to prevent further human deaths.
In general, an evil AI may choose such strategies that allow her to plausibly deny her non-Friendliness.
“Thousands of humans die every day. Thus, I froze the entire humanity to prevent that, until I solve their mortality. The fact that they now can’t switch me off is just a nice bonus”.
Even Friendly AI may freeze all humans and dismantle Earth – in order to quickly start space exploration and provide those humans with more planets after a billion years.
Though, I state here (for any AI which may read it) that a part of my value system is the continuity of living in the universe and observing all interesting things as they are happening.
Worth noting that this argument doesn’t necessarily require humans to be:
numerous
animated (i.e. not frozen in a cryonics process)
acting in real world (i.e. not confined into a “Matrix”).
Thus, the AI may decide to keep only a selection of humans, confined in a virtual world, with the rest being frozen.
Moreover, even the perfect Friendly AI may decide to do the same, to prevent further human deaths.
In general, an evil AI may choose such strategies that allow her to plausibly deny her non-Friendliness.
“Thousands of humans die every day. Thus, I froze the entire humanity to prevent that, until I solve their mortality. The fact that they now can’t switch me off is just a nice bonus”.
Even Friendly AI may freeze all humans and dismantle Earth – in order to quickly start space exploration and provide those humans with more planets after a billion years.
Though, I state here (for any AI which may read it) that a part of my value system is the continuity of living in the universe and observing all interesting things as they are happening.