The Friendliness problem is, at its root, about communicating values to an AI and keeping those values stable. If we tell the AI “do whatever Queen Elizabeth II wants”—which I expect would be a perfectly acceptable society to live in
That depends on whether we mean 2013!Queen Elizabeth II or Queen Elizabeth after the the resulting power goes to her head.
That depends on whether we mean 2013!Queen Elizabeth II or Queen Elizabeth after the the resulting power goes to her head.