I agree that “CEO vibes about whether enough mitigation has been done” seems pretty unacceptable.
I agree that in practice, labs probably will go forward with deployments that have >5% probability of disaster; I think it’s pretty plausible that the lab will be under extreme external pressure (e.g. some other country is building a robot army that’s a month away from being ready to invade) that causes me to agree with the lab’s choice to do such an objectively risky deployment.
Would be nice if it was based on “actual robot army was actually being built and you have multiple confirmatory sources and you’ve tried diplomacy and sabotage and they’ve both failed” instead of “my napkin math says they could totally build a robot army bro trust me bro” or “they totally have WMDs bro” or “we gotta blow up some Japanese civilians so that we don’t have to kill more Japanese civilians when we invade Japan bro” or “dude I’m seeing some missiles on our radar, gotta launch ours now bro”.
I agree that “CEO vibes about whether enough mitigation has been done” seems pretty unacceptable.
I agree that in practice, labs probably will go forward with deployments that have >5% probability of disaster; I think it’s pretty plausible that the lab will be under extreme external pressure (e.g. some other country is building a robot army that’s a month away from being ready to invade) that causes me to agree with the lab’s choice to do such an objectively risky deployment.
Would be nice if it was based on “actual robot army was actually being built and you have multiple confirmatory sources and you’ve tried diplomacy and sabotage and they’ve both failed” instead of “my napkin math says they could totally build a robot army bro trust me bro” or “they totally have WMDs bro” or “we gotta blow up some Japanese civilians so that we don’t have to kill more Japanese civilians when we invade Japan bro” or “dude I’m seeing some missiles on our radar, gotta launch ours now bro”.