But by the time narrow AI becomes pervasive, it’s also likely that people will possess much more of the technical understanding needed to comprehend the threat that AGI possesses.
Or perhaps it’s the contrary: pervasive narrow AI fosters an undue sense of security. People become comfortable via familiarity, whether it’s justified or not. This morning I was peering down a 50 foot cliff, half way up, suspended by nothing but a half inch wide rope. No fear, no hesitation, perfect familiarity. Luckily, due to knowledge of numerous deaths of past climbers I can maintain a conscious alertness to safety and stave off complacency. But in the case of AI, what overt catastrophes will similarly stave off complacency toward existential risk short of an existential catastrophe itself?
Or perhaps it’s the contrary: pervasive narrow AI fosters an undue sense of security. People become comfortable via familiarity, whether it’s justified or not. This morning I was peering down a 50 foot cliff, half way up, suspended by nothing but a half inch wide rope. No fear, no hesitation, perfect familiarity. Luckily, due to knowledge of numerous deaths of past climbers I can maintain a conscious alertness to safety and stave off complacency. But in the case of AI, what overt catastrophes will similarly stave off complacency toward existential risk short of an existential catastrophe itself?