Sorry, I’m not too familiar with the community, so not sure if this question is about AI alignment in particular or risks more broadly. Assuming the latter: I think the most overlooked problem is politics. I worry about rich and powerful sociopaths being able to do evil without consequences or even without being detected (except by the victims, of course). We probably can’t do much about the existence of sociopaths themselves, but I think we can and should think about the best ways to increase transparency and reduce inequality. For what it’s worth, I’m a negative utilitarian.
I worry about rich and powerful sociopaths being able to do evil without consequences or even without being detected (except by the victims, of course).
Many methods used to avoid detection by general population also work on the victims, including:
hiding the evil deed or casting doubt on its existence
removing knoweledge of alternatives (silencing/redacting information about past and present alternatives), ending present alternatives
Sorry, I’m not too familiar with the community, so not sure if this question is about AI alignment in particular or risks more broadly. Assuming the latter: I think the most overlooked problem is politics. I worry about rich and powerful sociopaths being able to do evil without consequences or even without being detected (except by the victims, of course). We probably can’t do much about the existence of sociopaths themselves, but I think we can and should think about the best ways to increase transparency and reduce inequality. For what it’s worth, I’m a negative utilitarian.
The latter is correct, non-AI risks are welcome.
Reducing long-term risks from malevolent actors is relevant here.
Many methods used to avoid detection by general population also work on the victims, including:
hiding the evil deed or casting doubt on its existence
removing knoweledge of alternatives (silencing/redacting information about past and present alternatives), ending present alternatives
demonizing alternatives
guilt-tripping victims
gaslighting