I tentatively agree but “people realizing it’s more dangerous than nukes” has potential negative consequences too — an arms race is the default outcome of such national security threats/opportunities. I’ve recently been trying to think about different memes about AI and their possible effects… it’s possible that memes like “powerful AI is fragile” could get the same regulation and safety work with less arms racing.
How about “AI is like summoning a series of increasingly powerful demons/aliens and trying to make them do what we want by giving them various punishments and rewards?”
Consequences (in expectation) if widely accepted: very good.
Compressibility: poor (at least, good compressions are not obvious).
Probability of (a compressed version) becoming widely accepted or Respectable Opinion: moderately low due to weirdness. Less weird explanations of why AI might not do what we want would be more Respectable and acceptable.
Leverage (i.e., increase in that probability from increased marginal effort to promote that meme): uncertain.
I disagree about compressibility; Elon said “AI is summoning the demon” and that’s a five-word phrase that seems to have been somewhat memorable and memetically fit. I think if we had a good longer piece of content that expressed the idea that lots of people could read/watch/play then that would probably be enough.
What do you think sensible AI safety regulation would entail?
I don’t know, I haven’t thought much about it. I’d love it if people realized it’s more dangerous than nukes and treated it accordingly.
I tentatively agree but “people realizing it’s more dangerous than nukes” has potential negative consequences too — an arms race is the default outcome of such national security threats/opportunities. I’ve recently been trying to think about different memes about AI and their possible effects… it’s possible that memes like “powerful AI is fragile” could get the same regulation and safety work with less arms racing.
How about “AI is like summoning a series of increasingly powerful demons/aliens and trying to make them do what we want by giving them various punishments and rewards?”
Consequences (in expectation) if widely accepted: very good.
Compressibility: poor (at least, good compressions are not obvious).
Probability of (a compressed version) becoming widely accepted or Respectable Opinion: moderately low due to weirdness. Less weird explanations of why AI might not do what we want would be more Respectable and acceptable.
Leverage (i.e., increase in that probability from increased marginal effort to promote that meme): uncertain.
I disagree about compressibility; Elon said “AI is summoning the demon” and that’s a five-word phrase that seems to have been somewhat memorable and memetically fit. I think if we had a good longer piece of content that expressed the idea that lots of people could read/watch/play then that would probably be enough.