There are some writing issues here that make it difficult to evaluate the ideas presented purely on their merits. In particular, the argument for 99% extinction is given a lot of space relative to the post as a whole, where it should really be a bullet point that links to where this case is made elsewhere (or if it is not made adequately elsewhere, as a new post entirely). Meanwhile, the value of disruptive protest is left to the reader to determine.
As I understand the issue, the case for barricading AI rests on: 1. Safety doesn’t happen by default a) AI labs are not on track to achieve “alignment” as commonly considered by safety researchers. b) Those standards may be over-optimistic—link to Substrate Needs Convergence, arguments by Yampolskiy, etc. c) Even if the conception of safety assumed by the AI labs is right, it is not clear that their utopic vision for the future is actually good. 2. Advocacy, not just technical work, is needed for AI safety a) See above b) Market incentives are misaligned c) Policy (and culture) matters 3. Disruptive actions, not just working within civil channels, is needed for effective advocacy. a) Ways that working entirely within ordinary democratic channels can get delayed or derailed b) Benefits of disruptive actions, separate from or in synergy with other forms of advocacy c) Plan for how StopAI’s specific choice of disruptive actions effectively plays to the above benefits d) Moral arguments, if not already implied
As I understand the issue, the case for barricading AI rests on:
Great list! Basically agreeing with the claims under 1. and the structure of what needs to be covered under 2.
Meanwhile, the value of disruptive protest is left to the reader to determine.
You’re right. Usually when people hear about a new organisation on the forum, they expect some long write-up of the theory of change and the considerations around what to prioritise.
I don’t think I have time right now for writing a neat public write-up. This is just me being realistic – Sam and I are both swamped in terms of handling our work and living situations.
So the best I can do is point to examples where civil disobedience has worked (eg. Just Stop Oil demands, Children’s March) and then discuss our particular situation (how the situatiojn is similar and different, who are important stakeholders, what are our demands, what are possible effective tactics in this context).
In particular, the argument for 99% extinction is given a lot of space relative to the post as a whole,
Ha, fair enough. The more rigorously I tried to write out the explanation, the more space it took.
There are some writing issues here that make it difficult to evaluate the ideas presented purely on their merits. In particular, the argument for 99% extinction is given a lot of space relative to the post as a whole, where it should really be a bullet point that links to where this case is made elsewhere (or if it is not made adequately elsewhere, as a new post entirely). Meanwhile, the value of disruptive protest is left to the reader to determine.
As I understand the issue, the case for barricading AI rests on:
1. Safety doesn’t happen by default
a) AI labs are not on track to achieve “alignment” as commonly considered by safety researchers.
b) Those standards may be over-optimistic—link to Substrate Needs Convergence, arguments by Yampolskiy, etc.
c) Even if the conception of safety assumed by the AI labs is right, it is not clear that their utopic vision for the future is actually good.
2. Advocacy, not just technical work, is needed for AI safety
a) See above
b) Market incentives are misaligned
c) Policy (and culture) matters
3. Disruptive actions, not just working within civil channels, is needed for effective advocacy.
a) Ways that working entirely within ordinary democratic channels can get delayed or derailed
b) Benefits of disruptive actions, separate from or in synergy with other forms of advocacy
c) Plan for how StopAI’s specific choice of disruptive actions effectively plays to the above benefits
d) Moral arguments, if not already implied
Great list! Basically agreeing with the claims under 1. and the structure of what needs to be covered under 2.
You’re right. Usually when people hear about a new organisation on the forum, they expect some long write-up of the theory of change and the considerations around what to prioritise.
I don’t think I have time right now for writing a neat public write-up. This is just me being realistic – Sam and I are both swamped in terms of handling our work and living situations.
So the best I can do is point to examples where civil disobedience has worked (eg. Just Stop Oil demands, Children’s March) and then discuss our particular situation (how the situatiojn is similar and different, who are important stakeholders, what are our demands, what are possible effective tactics in this context).
Ha, fair enough. The more rigorously I tried to write out the explanation, the more space it took.