Manfred comments on Heroin model: AI “manipulates” “unmanipulatable” reward

[Manfred]

It implies it only in combination with the false premise that peoples’ actions accurately reflect the utility function we want to maximize.