What if they cooperate acausally between themselves? Well there’s an infinite amount of humans vs an infinite amount of UFAIs, and this is an infinity vs infinity scenario
And how do you divide up that infinity between the infinite number of possible UFAIs and future-humanities that could exist? That this procedure gives undefined answers in infinite universes is a sign that it’s probably not a good fit for reasoning about them. I think a better answer is something like UDASSA, which can assign different amounts of ‘measure’ to humanity and UFAIs, giving them potentially unequal bargaining power, even if there are an infinite number of instantiations of both.
UDASSA works fine in level 2 and 4 multiverses. Indeed, its domain of applicability is all possible Turing machines, which could be seen as a model of the level 4 multiverse.
Close, but no cigar. The problem is that while a Turing machine can simulate arbitrarily powerful computers, they can’t simulate infinitely powerful computers like a hyper computer, which is necessary to do.
As constructed, I don’t see how UDASSA solves the problem.
And how do you divide up that infinity between the infinite number of possible UFAIs and future-humanities that could exist? That this procedure gives undefined answers in infinite universes is a sign that it’s probably not a good fit for reasoning about them. I think a better answer is something like UDASSA, which can assign different amounts of ‘measure’ to humanity and UFAIs, giving them potentially unequal bargaining power, even if there are an infinite number of instantiations of both.
Has UDASSA been updated since then? Because they present pretty severe problems for that prior.
And in any case, even if it did work, it only works in the Level I and III multiverses, and not II (Eternal Inflation) or IV multiverses.
UDASSA works fine in level 2 and 4 multiverses. Indeed, its domain of applicability is all possible Turing machines, which could be seen as a model of the level 4 multiverse.
Close, but no cigar. The problem is that while a Turing machine can simulate arbitrarily powerful computers, they can’t simulate infinitely powerful computers like a hyper computer, which is necessary to do.
As constructed, I don’t see how UDASSA solves the problem.