I’m concerned with the ethics. Is it wrong to doom speak to strangers? Is that the most effective thing here? I’d be lying if I said I was fine, but would it be best to tell them I’m “mildly concerned”?
How do convey these grave emotions I have while maximally getting the people around me to care about mitigating AI risk?
Should I compromise on truth and downplay my concerns if that will get someone to care more? Should I expect people to be more receptive to the message of AI risk if I’m mild about it?
Why do you care if people around you, who presumably have lives to live, care about AI risk? It’s not a problem like AIDS or groundwater pollution, where individual carefulness is needed to make a difference. In those cases, telling everybody about the problem is important, because it will prevent them having unprotected sex, or dumping used motor oil in their backyard. Unaligned AGI is a problem like nuclear war or viral gain-of-function research, where a few people work on the problem pretty much full time. If you want to increase the population of such people, that’s fine, but telling your mother-in-law that the world is doomed isn’t going to help.
Why do I care if the people around me care about AI risk?
1. when AI is going to rule we’d like the people to somehow have some power I reckon. I mean creating any superintelligence is a powergrab. Making one in secret is quite hostile, shouldn’t people get a say or at least insight in what their future holds?
2. Nobody still really knows what we’d like the superint to do. I think an ML researcher is as capable of voicing their desires for the future as an artist. The field surely can benefit from interdisciplinary approaches.
3. As with nuclear war, I’m sure politicians will care more when the people care more. AI governance is a big point. Convincing AI devs to not make the superint seems easier when a big percentage of humanity is pressuring them not to do it.
4. Maybe this also extends to international relations. Seeing that the people of a democratic country care about the safety, makes the ventures from that country seem more reliable.
5. I get bummed out when nobody knows what I’m talking about.
I’m concerned with the ethics.
Is it wrong to doom speak to strangers? Is that the most effective thing here? I’d be lying if I said I was fine, but would it be best to tell them I’m “mildly concerned”?
How do convey these grave emotions I have while maximally getting the people around me to care about mitigating AI risk?
Should I compromise on truth and downplay my concerns if that will get someone to care more? Should I expect people to be more receptive to the message of AI risk if I’m mild about it?
Why do you care if people around you, who presumably have lives to live, care about AI risk? It’s not a problem like AIDS or groundwater pollution, where individual carefulness is needed to make a difference. In those cases, telling everybody about the problem is important, because it will prevent them having unprotected sex, or dumping used motor oil in their backyard. Unaligned AGI is a problem like nuclear war or viral gain-of-function research, where a few people work on the problem pretty much full time. If you want to increase the population of such people, that’s fine, but telling your mother-in-law that the world is doomed isn’t going to help.
Why do I care if the people around me care about AI risk?
1. when AI is going to rule we’d like the people to somehow have some power I reckon.
I mean creating any superintelligence is a powergrab. Making one in secret is quite hostile, shouldn’t people get a say or at least insight in what their future holds?
2. Nobody still really knows what we’d like the superint to do. I think an ML researcher is as capable of voicing their desires for the future as an artist. The field surely can benefit from interdisciplinary approaches.
3. As with nuclear war, I’m sure politicians will care more when the people care more. AI governance is a big point. Convincing AI devs to not make the superint seems easier when a big percentage of humanity is pressuring them not to do it.
4. Maybe this also extends to international relations. Seeing that the people of a democratic country care about the safety, makes the ventures from that country seem more reliable.
5. I get bummed out when nobody knows what I’m talking about.