The risk that it simply ends up being owned by the few who create it leading thus to a total concentration of the productive power of humanity isn’t immaterial, in fact it looks like the default outcome.
Yes, this is why I’ve been frustrated (and honestly aghast, given timelines) at the popular focus on AI doom and paperclips rather than the fact that this is the default (if not nigh-unavoidable) outcome of AGI/ASI, even if “alignment” gets solved. Comparisons with industrialization and other technological developments are specious because none of them had the potential to do anything close to this.
I think the doom narrative is still worth bringing up because this is what these people are risking for all of us in the pursuit of essentially conquering the world and/or personal immortality. That’s the level of insane supervillainy that this whole situation actually translates to. Just because they don’t think they’ll fail doesn’t mean they’re not likely to.
I’m also disappointed that the political left is dropping the ball so hard on opposing AI, turning to either contradictory “it’s really stupid, just a stochastic parrot, and also threatens our jobs somehow” statements, or focusing on details of its behaviour. There’s probably something deeper to say about capitalists openly making a bid to turn labour itself into capital.
Yes, this is why I’ve been frustrated (and honestly aghast, given timelines) at the popular focus on AI doom and paperclips rather than the fact that this is the default (if not nigh-unavoidable) outcome of AGI/ASI, even if “alignment” gets solved. Comparisons with industrialization and other technological developments are specious because none of them had the potential to do anything close to this.
I think the doom narrative is still worth bringing up because this is what these people are risking for all of us in the pursuit of essentially conquering the world and/or personal immortality. That’s the level of insane supervillainy that this whole situation actually translates to. Just because they don’t think they’ll fail doesn’t mean they’re not likely to.
I’m also disappointed that the political left is dropping the ball so hard on opposing AI, turning to either contradictory “it’s really stupid, just a stochastic parrot, and also threatens our jobs somehow” statements, or focusing on details of its behaviour. There’s probably something deeper to say about capitalists openly making a bid to turn labour itself into capital.