Organizational structure is an alignment mechanism.
While I sympathize with the stated intentions, I just can’t wrap my head around the naivety. OpenAI corporate structure was a recipe for bad corporate governance. “We are the good guys here, the structure is needed to make others align with us.”- an organization where ethical people can rule as benevolent dictators is the same mistake committed socialists made when they had power.
If it was that easy, AI alignment would be solved by creating ethical AI committed to alignment and giving it as much power as possible.
Altruists are normal humans. Nothing changes priorities faster than large sums of money. Any mix of ideals and profit-making must be arranged in a way that concerns don’t mix. People in charge of ethics making life-changing money can’t be expected to make those hard ethics over money decisions.
Bad organizational structure puts well meaning humans like Sutskever repeatedly into position where he must choose between wast sums of money or his ethical commitments.
Organizational structure is an alignment mechanism.
While I sympathize with the stated intentions, I just can’t wrap my head around the naivety. OpenAI corporate structure was a recipe for bad corporate governance. “We are the good guys here, the structure is needed to make others align with us.”- an organization where ethical people can rule as benevolent dictators is the same mistake committed socialists made when they had power.
If it was that easy, AI alignment would be solved by creating ethical AI committed to alignment and giving it as much power as possible.
Altruists are normal humans. Nothing changes priorities faster than large sums of money. Any mix of ideals and profit-making must be arranged in a way that concerns don’t mix. People in charge of ethics making life-changing money can’t be expected to make those hard ethics over money decisions.
Bad organizational structure puts well meaning humans like Sutskever repeatedly into position where he must choose between wast sums of money or his ethical commitments.