This shows again that people are generally aware of potential risks but either do not take them seriously or don’t see why risks from AI are the rule rather than an exception.
Possible third category: people who take them seriously and understand why they’re the rule, but believe that anyone who has a chance at AI will likely have the same understanding and approach their work accordingly.
(i.e.: “SIAI just publishes shallow papers dressing up basic concepts about AI in technical language, while spreading a fearmongering caricature of reckless AI developers” or something like that.)
So rather than making people aware that there are risks you have to tell them what are the risks.
...and afterward, convince them that they didn’t already know what you told them, or failing that, at least convince them that it’s possible for smart people to deny it.
Edit: timtyler is one advocate of the “come on, AI developers know what they’re doing!” view.
I wouldn’t say that—and I don’t think I was saying anything like that in the referenced comments.
I do think that humans accidentally dropping the reins is pretty unlikely—though not so unlikely that we don’t need to concern ourselves with the possibility.
Of course, even without accidents, there is plenty for us to be concerned about.
Possible third category: people who take them seriously and understand why they’re the rule, but believe that anyone who has a chance at AI will likely have the same understanding and approach their work accordingly.
(i.e.: “SIAI just publishes shallow papers dressing up basic concepts about AI in technical language, while spreading a fearmongering caricature of reckless AI developers” or something like that.)
...and afterward, convince them that they didn’t already know what you told them, or failing that, at least convince them that it’s possible for smart people to deny it.
Edit: Inaccurate statement trimmed.
I wouldn’t say that—and I don’t think I was saying anything like that in the referenced comments.
I do think that humans accidentally dropping the reins is pretty unlikely—though not so unlikely that we don’t need to concern ourselves with the possibility.
Of course, even without accidents, there is plenty for us to be concerned about.