Relevant to Robin Hanson’s point: I’ve argued here that agents betraying their principals happens in politics all the time, sometime with disastrous results. By restricting to the economic literature on this problem, we’re only looking at a small subsets of “agency problems”, and implicitly assuming that institutions are sufficiently strong to detect and deter bad behaviour of very powerful AI agents—which is not at all evident.
Relevant to Robin Hanson’s point: I’ve argued here that agents betraying their principals happens in politics all the time, sometime with disastrous results. By restricting to the economic literature on this problem, we’re only looking at a small subsets of “agency problems”, and implicitly assuming that institutions are sufficiently strong to detect and deter bad behaviour of very powerful AI agents—which is not at all evident.