The CIA has the mission to protect the constitution of the United States. In practice, the CIA constantly violates the constitution of the United States.
Defense contractors constantly push for global politics to go in a direction that military budgets go up and that often involves making the world a less safe place.
The equivalent for defense contractors being aligned to make money for their stakeholders would be for an NGO like MIRI being aligned for increasing their budget through donations. A lot of NGO’s are aligned in that way instead of being aligned for their mission.
Yes, but they don’t know how to hire other people to do that. Especially, they don’t know how to get people who come mainly because they are paid a lot of money to care more about things besides that money.
This appears to be a problem with the whole organization, rather than a secrecy problem per se. The push from defense contractors in particular is highly public. It looks like there are three problems to solve here:
Alignment of the org.
Effectiveness of the org.
Secrecy of the org.
There is clearly tension between these three, but just because they aren’t fully independent doesn’t mean they are mutually exclusive.
There is a precedent for doing secret work of high strategic importance, which is every intelligence agency and defense contractor ever.
The CIA has the mission to protect the constitution of the United States. In practice, the CIA constantly violates the constitution of the United States.
Defense contractors constantly push for global politics to go in a direction that military budgets go up and that often involves making the world a less safe place.
Neither of those fields is well-aligned.
Yeah, the CIA isn’t aligned. Defense contractors are quite aligned with the interests of their shareholders.
The equivalent for defense contractors being aligned to make money for their stakeholders would be for an NGO like MIRI being aligned for increasing their budget through donations. A lot of NGO’s are aligned in that way instead of being aligned for their mission.
I’m reasonably certain that the people currently in MIRI genuinely want to prevent the rise of unfriendly AI.
Yes, but they don’t know how to hire other people to do that. Especially, they don’t know how to get people who come mainly because they are paid a lot of money to care more about things besides that money.
This appears to be a problem with the whole organization, rather than a secrecy problem per se. The push from defense contractors in particular is highly public. It looks like there are three problems to solve here:
Alignment of the org.
Effectiveness of the org.
Secrecy of the org.
There is clearly tension between these three, but just because they aren’t fully independent doesn’t mean they are mutually exclusive.