To be honest, I don’t believe this story the way he tells it and I don’t expect many people outside our community would be persuaded. To be clear, there are versions of this story I can believe, but I haven’t heard anyone tell it in a persuasive way.
(Actually, scratch that: I think Hollywood already told this story, several times, usually without nanotech being a crux, and quite persuasively. I think if you ask regular people, their objection to the possibility of the robopocalypse is usually long timelines and not the fundamental problem of humans losing control. In fact I think most people, even techno-optimists, agree that we are doomed to lose control.)
I think I should have said “lose control eventually.” I’m becoming more optimistic that AIs are easy to align. Maybe you can get GPT-4 to say the n-word with an optimized prompt, but for normal usage, it’s not exactly a 4channer.
To be honest, I don’t believe this story the way he tells it and I don’t expect many people outside our community would be persuaded. To be clear, there are versions of this story I can believe, but I haven’t heard anyone tell it in a persuasive way.
(Actually, scratch that: I think Hollywood already told this story, several times, usually without nanotech being a crux, and quite persuasively. I think if you ask regular people, their objection to the possibility of the robopocalypse is usually long timelines and not the fundamental problem of humans losing control. In fact I think most people, even techno-optimists, agree that we are doomed to lose control.)
Well, if you agree that humans are bound to lose control, what do you disagree with?
I think I should have said “lose control eventually.” I’m becoming more optimistic that AIs are easy to align. Maybe you can get GPT-4 to say the n-word with an optimized prompt, but for normal usage, it’s not exactly a 4channer.