Another example might be democratic politics. Optimization is meant to produce a government and policies representing a majority view while protecting minority rights. Search is via voting, a procedure which is defined in a difficult-to-change constitution; politicians who are elected have an incentive to preserve the system that got them elected. Exploitation happens when actions that would better represent majority views and protect minority rights don’t necessarily get politicians elected. In fact, there are actions politicians can take to further decouple representation and rights-protection from voting.
Another example might be democratic politics. Optimization is meant to produce a government and policies representing a majority view while protecting minority rights. Search is via voting, a procedure which is defined in a difficult-to-change constitution; politicians who are elected have an incentive to preserve the system that got them elected. Exploitation happens when actions that would better represent majority views and protect minority rights don’t necessarily get politicians elected. In fact, there are actions politicians can take to further decouple representation and rights-protection from voting.