Stuart_Armstrong comments on Plausibly, almost every powerful algorithm would be manipulative

[Stuart_Armstrong]

The story didn’t seem to include a disaster.

No. That’s a separate issue—the reason that mild manipulation could be a problem. If we had a clear division, I wouldn’t care about mild manipulation.