jsalvatier comments on I think I’ve found the source of what’s been bugging me about “Friendly AI”

[jsalvatier]

The standard response to this is that it will care about our wishes if we build it to care about our wishes (see here).