Moral intuitions are odd. The current government’s gutting of the AI safety summit is upsetting, but somehow less upsetting to my hindbrain than its order to drop the corruption charges against a mayor. I guess the AI safety thing is worse in practice but less shocking in terms of abstract conduct violations.
Specific things—especially people—feel more real than abstract threats?
Also, maybe instead of actual damage the intuitions reflect the perceived intention / integrity of the actor? Like, it is more plausible that there is a honest misunderstanding / difference of opinions on AI safety, than about protecting a corrupt mayor. Such intuition may make sense in general (even if not specifically in the case of AI safety), because misunderstandings can possibly be addressed by a dialog, but it doesn’t make much sense to talk to people participating in corruption—they are perfectly aware of what they are doing.
Yep, we chose to build digital “god” instead of building digital heaven. The second is relatively trivial to do safely, the first is only possible to do safely after building the second
Moral intuitions are odd. The current government’s gutting of the AI safety summit is upsetting, but somehow less upsetting to my hindbrain than its order to drop the corruption charges against a mayor. I guess the AI safety thing is worse in practice but less shocking in terms of abstract conduct violations.
Specific things—especially people—feel more real than abstract threats?
Also, maybe instead of actual damage the intuitions reflect the perceived intention / integrity of the actor? Like, it is more plausible that there is a honest misunderstanding / difference of opinions on AI safety, than about protecting a corrupt mayor. Such intuition may make sense in general (even if not specifically in the case of AI safety), because misunderstandings can possibly be addressed by a dialog, but it doesn’t make much sense to talk to people participating in corruption—they are perfectly aware of what they are doing.
Yep, we chose to build digital “god” instead of building digital heaven. The second is relatively trivial to do safely, the first is only possible to do safely after building the second