I think at least some of this backlash comes from Earth being very bad at coordination. “To get moderate result you should scare opponents with radicals” and other negotiation frictions.
Sure. But scaring opponents with inflated arguments and demands by radicals didn’t seem to work well for the environmental movement, so the AI safety movement probably shouldn’t employ those tactics.
To clarify in more general way: Earth is bad in coordination in a sense that you can’t expect that if industrial producer dumps toxic waste into environment, special government agency will walk in with premise: “hey, you seem to destroy environmental commons to get profits, let’s negotiate point on Pareto frontier in space of environmental commons-profits which leave both of us not very upset”.
I think at least some of this backlash comes from Earth being very bad at coordination. “To get moderate result you should scare opponents with radicals” and other negotiation frictions.
Sure. But scaring opponents with inflated arguments and demands by radicals didn’t seem to work well for the environmental movement, so the AI safety movement probably shouldn’t employ those tactics.
To clarify in more general way: Earth is bad in coordination in a sense that you can’t expect that if industrial producer dumps toxic waste into environment, special government agency will walk in with premise: “hey, you seem to destroy environmental commons to get profits, let’s negotiate point on Pareto frontier in space of environmental commons-profits which leave both of us not very upset”.