The line goes “to fathom a strange plot, one technique was to look at what ended up happening, assume it was the intended result, and ask who benefited”. But in the real world strange secret complicated Machiavellian plots are pretty rare, and successful strange secret complicated Machiavellian plots are even rarer. So I’d be wary of applying this rule to explain big once-off events outside of fiction. (Even to HPMoR’s author!)
I agree Eliezer didn’t seem to be trying very hard to suppress information. I think that’s probably just because he’s a human, and humans get angry when they see other humans defecting from a (perceived) social norm, and anger plus time pressure causes hasty dumb decisions. I don’t think this is super complicated. Though I hope he’d have acted differently if he thought the infohazard risk was really severe, as opposed to just not-vanishingly-small.
The line goes “to fathom a strange plot, one technique was to look at what ended up happening, assume it was the intended result, and ask who benefited”. But in the real world strange secret complicated Machiavellian plots are pretty rare, and successful strange secret complicated Machiavellian plots are even rarer. So I’d be wary of applying this rule to explain big once-off events outside of fiction. (Even to HPMoR’s author!)
I agree Eliezer didn’t seem to be trying very hard to suppress information. I think that’s probably just because he’s a human, and humans get angry when they see other humans defecting from a (perceived) social norm, and anger plus time pressure causes hasty dumb decisions. I don’t think this is super complicated. Though I hope he’d have acted differently if he thought the infohazard risk was really severe, as opposed to just not-vanishingly-small.