Values ultimately have to map to the real world, though, even if it’s in a complicated way. If something wants the same world as me to exist, I’m not fussed as to what it calls the reason. But how likely is it that they will converge? That’s what matters.
I presume by “the same world” you mean a sufficiently overlapping class of worlds. I don’t think that “the same world” is well defined. I think that determining in particular cases what is “the world” you want affects who you are.
Values ultimately have to map to the real world, though, even if it’s in a complicated way. If something wants the same world as me to exist, I’m not fussed as to what it calls the reason. But how likely is it that they will converge? That’s what matters.
I presume by “the same world” you mean a sufficiently overlapping class of worlds. I don’t think that “the same world” is well defined. I think that determining in particular cases what is “the world” you want affects who you are.
Well, I suppose in practice it’s a question of short-term instrumental goals overlapping, yeah.