Yeah, I think what I said isn’t strictly within your system. In your system, where does “the measure that I assign” come from? I mean, if I was already a UDT agent, I would already have such a measure, but I’m not already a UDT agent so I’d have to come up with a measure if I want to become a UDT agent (assuming that’s the right thing to do). But what do I based it on, and why? BTW, have you read my post http://lesswrong.com/lw/1iy/what_are_probabilities_anyway/ where option 4 is similar to your system? I wasn’t sure option 4 is the right answer back then, and I’m still in the same basic position now.
Well in mind space, there will be many agents basing their measures on different things. For me, it is based my intuition about “caring about everyone equally,” and looking at programs as infinite binary strings as you describe. That does not feel like a satisfactory answer to me, but it seems just as good as any answer I have seen to the question “Where does your utility function come from?”
I have read that post, and of course, I agree with your reasons to prefer 4.
Yeah, I think what I said isn’t strictly within your system. In your system, where does “the measure that I assign” come from? I mean, if I was already a UDT agent, I would already have such a measure, but I’m not already a UDT agent so I’d have to come up with a measure if I want to become a UDT agent (assuming that’s the right thing to do). But what do I based it on, and why? BTW, have you read my post http://lesswrong.com/lw/1iy/what_are_probabilities_anyway/ where option 4 is similar to your system? I wasn’t sure option 4 is the right answer back then, and I’m still in the same basic position now.
Well in mind space, there will be many agents basing their measures on different things. For me, it is based my intuition about “caring about everyone equally,” and looking at programs as infinite binary strings as you describe. That does not feel like a satisfactory answer to me, but it seems just as good as any answer I have seen to the question “Where does your utility function come from?”
I have read that post, and of course, I agree with your reasons to prefer 4.