It argues against the conjecture that utility function is separate from optimization power? Do you mean that it argues against Omohundro’s instrumental AI drives?
Yes, I know; they’re convergent. I’m questioning what aberglas is arguing against with his Darwinist supergoal. It doesn’t make sense to say that such a supergoal is mutually exclusive with the independence of utility and optimization power. It makes more sense to say that the supergoal is an alternative to Omohundro’s instrumental drives.
I don’t see how what aberglas wrote makes coherent sense.
It argues against the conjecture that utility function is separate from optimization power? Do you mean that it argues against Omohundro’s instrumental AI drives?
The whole point of instrumental drives is that they don’t have to be in the utility function.
Yes, I know; they’re convergent. I’m questioning what aberglas is arguing against with his Darwinist supergoal. It doesn’t make sense to say that such a supergoal is mutually exclusive with the independence of utility and optimization power. It makes more sense to say that the supergoal is an alternative to Omohundro’s instrumental drives.
I don’t see how what aberglas wrote makes coherent sense.
Well, alternative if you like. I will post an elaboration as a full article.