Since you’ve got no preference one way or the other, I don’t expect you’ll be objecting, right?
If I’m merely indifferent between A and B, then I will not object to trades exchanging A for B. But if A and B are incomparable for me, then I definitely may object!
Noticing unresolved conflicts within its preference framework, possibly unresolveable without self-modifying into an agent that has different preferences from itself.
Halting and catching fire, folding under the weight of an impossible choice.
If I’m merely indifferent between A and B, then I will not object to trades exchanging A for B. But if A and B are incomparable for me, then I definitely may object!
Say more about behaviors associated with “incomparability”?
Depending on the implementation details of the agent design, it may do some combination of:
Turning down your offer, path-dependently preferring whichever option is already in hand / whichever option is consistent with its history of past trades.
Noticing unresolved conflicts within its preference framework, possibly unresolveable without self-modifying into an agent that has different preferences from itself.
Halting and catching fire, folding under the weight of an impossible choice.
EDIT: The post also suggests an alternative (better) policy that agents with incomplete preferences may follow.