“Do I think that one ought to feel a sense of urgency about AI right now? Well, that’s a weird way of thinking about it, and I get stuck on the “one ought to feel” part—is it ever true that you should feel a certain way? I have the sense that this is the road to Crazytown.”
If the room is on fire, one ought to feel at least mildly concerned. If the room has a significant chance of being set on fire, one ought to feel somewhat less concerned but still not entirely okay with the prospect of a fiery death. It seems clear that one ought to be worried about future events to a degree proportional to their likelihood and adverse effects, or else face a greater chance of knowing about but ignoring a significant danger.
“Do I think that one ought to feel a sense of urgency about AI right now? Well, that’s a weird way of thinking about it, and I get stuck on the “one ought to feel” part—is it ever true that you should feel a certain way? I have the sense that this is the road to Crazytown.”
If the room is on fire, one ought to feel at least mildly concerned. If the room has a significant chance of being set on fire, one ought to feel somewhat less concerned but still not entirely okay with the prospect of a fiery death. It seems clear that one ought to be worried about future events to a degree proportional to their likelihood and adverse effects, or else face a greater chance of knowing about but ignoring a significant danger.