You need to conclude “can be taken by its creators to make it return a different answer while it remains an Oracle”. With that caveat inserted, I’m not sure what your point is...
That was my point. If you accept the premise that superintelligence implies the adoption some sort of objective moral conduct, then it is no different from an oracle returning correct answers. You can’t change that behavior and retain superintelligence. You’ll end up with a retarded intelligence.
I was just stating an analog example that highlights the tautological nature of your post. But I suppose that was your intention anyway.
That was my point. If you accept the premise that superintelligence implies the adoption some sort of objective moral conduct, then it is no different from an oracle returning correct answers. You can’t change that behavior and retain superintelligence. You’ll end up with a retarded intelligence.
I was just stating an analog example that highlights the tautological nature of your post. But I suppose that was your intention anyway.
Ah, ok :-) It just felt it was pulling intuitions in a different direction!