And yet as time goes on civilization is progressing to more secular values. It will be interesting to see where we are by the time strong AI is possible, especially since we undoubtedly will be changing ourselves to improve our own capabilities. As I said in one of the other comments, I think assuming that humanity can in totality be persuaded to unsavory values, even through religion, is too negative a view of humanity. Humanity’s history with religion is also filled with defiance and an AI that values human well-being will not be pleased with the outrage reaction as it tries to gain followers through persuasive means.
And yet as time goes on civilization is progressing to more secular values. It will be interesting to see where we are by the time strong AI is possible, especially since we undoubtedly will be changing ourselves to improve our own capabilities. As I said in one of the other comments, I think assuming that humanity can in totality be persuaded to unsavory values, even through religion, is too negative a view of humanity. Humanity’s history with religion is also filled with defiance and an AI that values human well-being will not be pleased with the outrage reaction as it tries to gain followers through persuasive means.