Yup. These precise points were also the main argument of my other post on a post-AGI world, the benevolence of the butcher.
Also due to the AI discourse I’ve actually ended up learning more about the original Luddites and, hear hear, they actually weren’t the fanatical, reactionary anti-technology ignorant peasants that popular history mainly portrays them as. They were mostly workers who were angry about the way the machines were being used, not to make labour easier and safer, but to squeeze more profit out of less skilled workers to make lower quality products which in the end left almost everyone involved worse off except for the ones who owned the factories. That’s I think something we can relate to even now, and I’d say is even more important in the case of AGI. The risk that it simply ends up being owned by the few who create it leading thus to a total concentration of the productive power of humanity isn’t immaterial, in fact it looks like the default outcome.
The risk that it simply ends up being owned by the few who create it leading thus to a total concentration of the productive power of humanity isn’t immaterial, in fact it looks like the default outcome.
Yes, this is why I’ve been frustrated (and honestly aghast, given timelines) at the popular focus on AI doom and paperclips rather than the fact that this is the default (if not nigh-unavoidable) outcome of AGI/ASI, even if “alignment” gets solved. Comparisons with industrialization and other technological developments are specious because none of them had the potential to do anything close to this.
I think the doom narrative is still worth bringing up because this is what these people are risking for all of us in the pursuit of essentially conquering the world and/or personal immortality. That’s the level of insane supervillainy that this whole situation actually translates to. Just because they don’t think they’ll fail doesn’t mean they’re not likely to.
I’m also disappointed that the political left is dropping the ball so hard on opposing AI, turning to either contradictory “it’s really stupid, just a stochastic parrot, and also threatens our jobs somehow” statements, or focusing on details of its behaviour. There’s probably something deeper to say about capitalists openly making a bid to turn labour itself into capital.
Yup. These precise points were also the main argument of my other post on a post-AGI world, the benevolence of the butcher.
Also due to the AI discourse I’ve actually ended up learning more about the original Luddites and, hear hear, they actually weren’t the fanatical, reactionary anti-technology ignorant peasants that popular history mainly portrays them as. They were mostly workers who were angry about the way the machines were being used, not to make labour easier and safer, but to squeeze more profit out of less skilled workers to make lower quality products which in the end left almost everyone involved worse off except for the ones who owned the factories. That’s I think something we can relate to even now, and I’d say is even more important in the case of AGI. The risk that it simply ends up being owned by the few who create it leading thus to a total concentration of the productive power of humanity isn’t immaterial, in fact it looks like the default outcome.
Yes, this is why I’ve been frustrated (and honestly aghast, given timelines) at the popular focus on AI doom and paperclips rather than the fact that this is the default (if not nigh-unavoidable) outcome of AGI/ASI, even if “alignment” gets solved. Comparisons with industrialization and other technological developments are specious because none of them had the potential to do anything close to this.
I think the doom narrative is still worth bringing up because this is what these people are risking for all of us in the pursuit of essentially conquering the world and/or personal immortality. That’s the level of insane supervillainy that this whole situation actually translates to. Just because they don’t think they’ll fail doesn’t mean they’re not likely to.
I’m also disappointed that the political left is dropping the ball so hard on opposing AI, turning to either contradictory “it’s really stupid, just a stochastic parrot, and also threatens our jobs somehow” statements, or focusing on details of its behaviour. There’s probably something deeper to say about capitalists openly making a bid to turn labour itself into capital.