Bunthut comments on Problems in AI Alignment that philosophers could potentially contribute to

[Bunthut]

How should two AIs that want to merge with each other aggregate their preferences?

Is this question intended to include a normative aspect or purely game theoretic?