I’m not sure I’m following… do you honestly think, that the cost of openly working on self-improving AGI and openly making statements along the lines of “we need to get this AI exactly right, or else we’ll probably kill every man, woman and child on this planet” will be marginal in -say- 30 years, once the majority of people no longer views AGI as the product of a loony imagination but an actual possibility due to advances in robotics and narrow AI all around them? Don’t you think open development of AGI would draw massive media attention once the public is surrounded and accustomed to all kinds of robots and narrow AI’s?
Why this optimism about how reasonable people will react to our notion of self-improving AGI, am I somehow missing something profound from my model of reality? I still expect people to be crazy, religious and irrational in 30 years and the easiest way of dealing with that would simply be to not arouse their attention. Now that most people perceive us as as hopeless sci-fi nerds (at best) and AGI still seems at least 500 years away in their mind, of course I’m all for being open and drawing in people and funding—but do you expect such an open approach to work (without interference by the public or politics) until the very completion of a godlike AGI? I severely doubt that, and I find it surprising that this is somehow perceived as a wildly marginal concern. As if it’s not even worth thinking about… why is that?
I’m not sure I’m following… do you honestly think, that the cost of openly working on self-improving AGI and openly making statements along the lines of “we need to get this AI exactly right, or else we’ll probably kill every man, woman and child on this planet” will be marginal in -say- 30 years, once the majority of people no longer views AGI as the product of a loony imagination but an actual possibility due to advances in robotics and narrow AI all around them? Don’t you think open development of AGI would draw massive media attention once the public is surrounded and accustomed to all kinds of robots and narrow AI’s?
Why this optimism about how reasonable people will react to our notion of self-improving AGI, am I somehow missing something profound from my model of reality? I still expect people to be crazy, religious and irrational in 30 years and the easiest way of dealing with that would simply be to not arouse their attention. Now that most people perceive us as as hopeless sci-fi nerds (at best) and AGI still seems at least 500 years away in their mind, of course I’m all for being open and drawing in people and funding—but do you expect such an open approach to work (without interference by the public or politics) until the very completion of a godlike AGI? I severely doubt that, and I find it surprising that this is somehow perceived as a wildly marginal concern. As if it’s not even worth thinking about… why is that?