In my model, Chevron and the US military are probably open to AI governance, because:
1 - they are institutions traditionally enmeshed in larger cooperative/rule-of-law systems, AND
2 - their leadership is unlikely to believe they can do AI ‘better’ than the larger AI community.
My worry is instead about criminal organizations and ‘anti-social’ states (e.g. North korea) because of #1, and big tech because of #2.
Because of location, EA can (and should) make decent connective with US big tech. I think the bigger challenge will be tech companies in other countries , especially China.
My co-blogger Devin saw this comment before I did, so these points are his. Just paraphrasing:
We can still do a lot without “coordinating” every player, and governance doesn’t mean we should be ham-fisted about it.
Furthermore, even just doing coordination/governance work with some of the major US tech companies (OpenAI, Google, Microsoft, Facebook) would be really good, since they tend to be ahead of the curve (as far as we know) with the relevant technologies.
Devin also noted that there could be tension between “we’re coordinating to all extend our AI development timelines somewhat so things aren’t rushing forward” and “OpenAI originally had a goal to develop aligned AI before anyone else developed unaligned AI”. However, I think this sort of thing is minor, and doing more governance now requires some flexibility anyway.
How do we deal with institutions that don’t want to be governed, say idk the Chevron corporation, North Korea, or the US military?
In my model, Chevron and the US military are probably open to AI governance, because: 1 - they are institutions traditionally enmeshed in larger cooperative/rule-of-law systems, AND 2 - their leadership is unlikely to believe they can do AI ‘better’ than the larger AI community.
My worry is instead about criminal organizations and ‘anti-social’ states (e.g. North korea) because of #1, and big tech because of #2.
Because of location, EA can (and should) make decent connective with US big tech. I think the bigger challenge will be tech companies in other countries , especially China.
My co-blogger Devin saw this comment before I did, so these points are his. Just paraphrasing:
We can still do a lot without “coordinating” every player, and governance doesn’t mean we should be ham-fisted about it.
Furthermore, even just doing coordination/governance work with some of the major US tech companies (OpenAI, Google, Microsoft, Facebook) would be really good, since they tend to be ahead of the curve (as far as we know) with the relevant technologies.
Devin also noted that there could be tension between “we’re coordinating to all extend our AI development timelines somewhat so things aren’t rushing forward” and “OpenAI originally had a goal to develop aligned AI before anyone else developed unaligned AI”. However, I think this sort of thing is minor, and doing more governance now requires some flexibility anyway.