I’ve been in DC for ~ the last 1.5y and I would say that DC AI policy has a good amount of momentum, I doubt it’s particularly visible on twitter but also it doesn’t seem like there are any hidden/secret missions or powerful coordination groups (if there are, I don’t know about it yet). I know ~10-20 people decently well here who work on AI policy full time or their work is motivated primarily by wanting better AI policy, and maybe ~100 who I have met once or twice but don’t see regularly or often; most such folks have been working on this stuff since before 2022; they all have fairly normal-seeming thinktank- or government-type jobs.
They don’t mostly spend time on LW (although certainly a few of them do). Many do spend time on Twitter, and they do read lots of AI related takes from LW-influenced folks. They have meetup groups related to AI policy. I guess it looks pretty much as I was expecting before I came here. Happy to answer further questions that don’t identify specific people, just because I don’t know how many of them want to be pointed-at on LW.
Thank you for the reply. This has been an important takeaway from this post: There are significant groups (or at least informal networks) doing meaningful work that don’t congregate primarily on LW or Twitter. As I said on another comment—that is encouraging! I wish this was more explicit knowledge within LW—it might give things more of a sense of hope around here.
The first question that comes to mind: Is there any sense of direction on policy proposals that might actually have a chance of getting somewhere? Something like: “Regulating card production” has momentum or anything like that?
Are policy proposals floating around even the kind that would not-kill-everyone? or is it more “Mundane Utility” type stuff, to steal the Zvi term.
Your question is coming from within a frame (I’ll call it the “EY+LW frame”) that I believe most of the DC people do not heavily share, so it is kind of hard to answer directly. But yes, to attempt an answer, I’ve seen quite a lot of interest (and direct policy successes) in reducing AI chips’ availability and production in China (eg via both CHIPS act and export controls), which is a prerequisite for US to exert more regulatory oversight of AI production and usage. I think the DC folks seem fairly well positioned to give useful inputs into further AI regulation as well.
So in short, they are generally unconcerned with existential risks? I’ve spoken with some staff and I get the sense they do not believe it will impact them personally.
Mild disagree: I do think x-risk is a major concern, but seems like people around DC tend to put 0.5-10% probability mass on extinction rather than the 30%+ that I see around LW. This lower probability causes them to put a lot more weight on actions that have good outcomes in the non extinction case. The EY+LW frame has a lot more stated+implied assumptions about uselessness of various types of actions because of such high probability on extinction.
I’ve been in DC for ~ the last 1.5y and I would say that DC AI policy has a good amount of momentum, I doubt it’s particularly visible on twitter but also it doesn’t seem like there are any hidden/secret missions or powerful coordination groups (if there are, I don’t know about it yet). I know ~10-20 people decently well here who work on AI policy full time or their work is motivated primarily by wanting better AI policy, and maybe ~100 who I have met once or twice but don’t see regularly or often; most such folks have been working on this stuff since before 2022; they all have fairly normal-seeming thinktank- or government-type jobs.
They don’t mostly spend time on LW (although certainly a few of them do). Many do spend time on Twitter, and they do read lots of AI related takes from LW-influenced folks. They have meetup groups related to AI policy. I guess it looks pretty much as I was expecting before I came here. Happy to answer further questions that don’t identify specific people, just because I don’t know how many of them want to be pointed-at on LW.
Thank you for the reply. This has been an important takeaway from this post: There are significant groups (or at least informal networks) doing meaningful work that don’t congregate primarily on LW or Twitter. As I said on another comment—that is encouraging! I wish this was more explicit knowledge within LW—it might give things more of a sense of hope around here.
The first question that comes to mind: Is there any sense of direction on policy proposals that might actually have a chance of getting somewhere? Something like: “Regulating card production” has momentum or anything like that?
Are policy proposals floating around even the kind that would not-kill-everyone? or is it more “Mundane Utility” type stuff, to steal the Zvi term.
Your question is coming from within a frame (I’ll call it the “EY+LW frame”) that I believe most of the DC people do not heavily share, so it is kind of hard to answer directly. But yes, to attempt an answer, I’ve seen quite a lot of interest (and direct policy successes) in reducing AI chips’ availability and production in China (eg via both CHIPS act and export controls), which is a prerequisite for US to exert more regulatory oversight of AI production and usage. I think the DC folks seem fairly well positioned to give useful inputs into further AI regulation as well.
So in short, they are generally unconcerned with existential risks? I’ve spoken with some staff and I get the sense they do not believe it will impact them personally.
Mild disagree: I do think x-risk is a major concern, but seems like people around DC tend to put 0.5-10% probability mass on extinction rather than the 30%+ that I see around LW. This lower probability causes them to put a lot more weight on actions that have good outcomes in the non extinction case. The EY+LW frame has a lot more stated+implied assumptions about uselessness of various types of actions because of such high probability on extinction.