Francis Rhys Ward comments on On Agent Incentives to Manipulate Human Feedback in Multi-Agent Reward Learning Scenarios

[Francis Rhys Ward]

That’s true (and I hadn’t considered it!) -- also there’s a social dilemma type situation in the case with many potential manipulators, since if any one manipulates then noone can get value from observing the target’s actions.