This brings up an interesting ethical dilemma. If strong AI will ever be possible, it will be probably designed with the values of what you described as a small minority. Does this this small minority have the ethical right to enforce a new world upon the majority which will be against their values?
Do you (or we) have the ethical right to enforce current world, the majority of which is against our values (as measured by the amount of complaining, at least).
This brings up an interesting ethical dilemma. If strong AI will ever be possible, it will be probably designed with the values of what you described as a small minority. Does this this small minority have the ethical right to enforce a new world upon the majority which will be against their values?
Wouldn’t be the first time that a small minority were enacting the change they wanted. The universe is not ethical or anything.
That’s true, but the change a strong AI would make would be probably completely irreversible and unmodifiable.
Is that different to how humans are the dominant planetary species?
The entire concept of CEV is meant to address this question.
https://arbital.com/p/cev/
Do you (or we) have the ethical right to enforce current world, the majority of which is against our values (as measured by the amount of complaining, at least).
I didn’t say I had an answer. I only said it can be an interesting dilemma.