Other agents are complicated regularities in the world (or a more general decision problem setting). Finding problems with understanding what’s going on when we try to optimize in other agents’ presence is a good heuristic for spotting gaps in our understanding of the idea of optimization.
Other agents are complicated regularities in the world (or a more general decision problem setting). Finding problems with understanding what’s going on when we try to optimize in other agents’ presence is a good heuristic for spotting gaps in our understanding of the idea of optimization.