I agree: the argument given here doesn’t address whether existential risk charities are likely to be helpful or actively harmful. The fourth paragraph of the conclusion and various caveats like “basically competent” were meant to limit the scope of the discussion to only those whose effects were mostly positive rather than negative. Carl Shulman suggested in a feedback comment that one could set up an explicit model where one multiplies (1) a normal variable centered on zero, or with substantial mass below zero, intended to describe uncertainty about whether the charity has mostly positive or mostly negative effects, with (2) a thicker-tailed and always positive variable describing uncertainty about the scale the charity is operating on.
“Basically” sounds like quite an understatement. It is not just an anthropogenic catastrophe, it’s highly-competent-and-dedicated-people-screwing-up-spectacularly-in-a-way-nobody-wants catastrophe. One could naively think that funding more safety conscious efforts can’t hurt but this is problematic when the concern with safety is not statistically independent of the unsafety of the approach that’s deemed viable or pursued.
I agree: the argument given here doesn’t address whether existential risk charities are likely to be helpful or actively harmful. The fourth paragraph of the conclusion and various caveats like “basically competent” were meant to limit the scope of the discussion to only those whose effects were mostly positive rather than negative. Carl Shulman suggested in a feedback comment that one could set up an explicit model where one multiplies (1) a normal variable centered on zero, or with substantial mass below zero, intended to describe uncertainty about whether the charity has mostly positive or mostly negative effects, with (2) a thicker-tailed and always positive variable describing uncertainty about the scale the charity is operating on.
“Basically” sounds like quite an understatement. It is not just an anthropogenic catastrophe, it’s highly-competent-and-dedicated-people-screwing-up-spectacularly-in-a-way-nobody-wants catastrophe. One could naively think that funding more safety conscious efforts can’t hurt but this is problematic when the concern with safety is not statistically independent of the unsafety of the approach that’s deemed viable or pursued.