Obviously, weighing equally over every logically possible utility function will produce a null result—for every utility function, a corresponding utility function with the opposite preferences will exist.
That doesn’t make it wrong, it makes it impotent. To break this “tie”, you’d end up preferring to create creatures that existing creatures would prefer exist, and then preferring to satisfy their preferences. Which makes sense to me.
Obviously, weighing equally over every logically possible utility function will produce a null result—for every utility function, a corresponding utility function with the opposite preferences will exist.
I agree, of course. The question was a rhetorical one to point out the incomplete nature of Robin’s solution.
Curse the lack of verbal cues on the Interwebs!
That doesn’t make it wrong, it makes it impotent. To break this “tie”, you’d end up preferring to create creatures that existing creatures would prefer exist, and then preferring to satisfy their preferences. Which makes sense to me.
I don’t understand your objection to my remark—I was analyzing the system Wei_Dai described, which evidently differs from yours.