The typical algorithm I’ve seen for enforcing fairness is to reject unfair offers randomly with some probability such that the counterparty’s EV decreases with increasing unfairness of the offer. This incentivizes fair offers without completely burning the possibility of partial cooperation between agents with slightly differing notions of fairness.
I’m a bit torn on where fairness should be properly placed. For example, if Alice is the only one deciding and Bob has no power to punish her at all, it seems like fairness should still come into Alice’s consideration. So maybe it should be encoded into the utility function, not into the strategic behavior running on top of it. But that would mean we need to take actions that benefit random aliens while going about our daily lives, and I’m not sure we want that.
You might precommit to fairness if you don’t know which side of the game you’ll be playing or if you anticipate being punished by onlookers, but I don’t know if I want my AI to be “fair” to an alien paperclipper that can’t retaliate.
The typical algorithm I’ve seen for enforcing fairness is to reject unfair offers randomly with some probability such that the counterparty’s EV decreases with increasing unfairness of the offer. This incentivizes fair offers without completely burning the possibility of partial cooperation between agents with slightly differing notions of fairness.
Yeah, this works.
I’m a bit torn on where fairness should be properly placed. For example, if Alice is the only one deciding and Bob has no power to punish her at all, it seems like fairness should still come into Alice’s consideration. So maybe it should be encoded into the utility function, not into the strategic behavior running on top of it. But that would mean we need to take actions that benefit random aliens while going about our daily lives, and I’m not sure we want that.
You might precommit to fairness if you don’t know which side of the game you’ll be playing or if you anticipate being punished by onlookers, but I don’t know if I want my AI to be “fair” to an alien paperclipper that can’t retaliate.