Well, that is so vague as to hardly be worth the trouble of responding to—but I will say that I do hope you were not thinking of referring me here.
However, I should perhaps add that I overspoke. I did not literally mean “any sufficiently-powerful optimisation process”. Only that such things are natural tendencies—that tend to be produced unless you actively wire things into the utility function to prevent their manifestation.
Well, that is so vague as to hardly be worth the trouble of responding to—but I will say that I do hope you were not thinking of referring me here.
However, I should perhaps add that I overspoke. I did not literally mean “any sufficiently-powerful optimisation process”. Only that such things are natural tendencies—that tend to be produced unless you actively wire things into the utility function to prevent their manifestation.