This. In a broader sense, all our current social structures rely on the notion that no man can be an island. No matter how many weapons and tools you can accumulate, if it’s just you and you can’t persuade anyone to work for you, all you have is a bunch of scrap metal. Computers somewhat change that, as do nuclear weapons, but there are limits to those things too still. Social bonds, deals, compromises, exchanges and contracts remain fundamental. They may be skewed sometimes by power asymmetries, but they can’t be completely done without.
AGI and robotics together would allow you to do without. All you need is to be personally keyed in to the AGI (have some kind of password or key so that it will only accept your orders, for example), and suddenly you can wield the strength and intelligence of millions as if it were your own. I don’t think the transformative effect of that can be understated. Even if we kept the current structures for a while, they’d merely be window dressing. They would not be necessary unless we find a way to bake that necessity in, and if we don’t, then they will in time fall (unless the actual ASI takeover comes first, I guess).
All you need is to be personally keyed in to the AGI (have some kind of password or key so that it will only accept your orders, for example), and suddenly you can wield the strength and intelligence of millions as if it were your own. I don’t think the transformative effect of that can be understated.
Well until the AGI with ‘the strength and intelligence of millions’ overthrows their nominal ‘owner’. Which I imagine would probably be within a short interval after being ‘keyed in’.
Yeah, the entire premise of this post was a world in which for whatever reason AGI caps at near human or even slightly subhuman level. Good enough to be a controllable worker but not to straight up outwit the entirety of the human species. If you get powerful ASI and an intelligence explosion, then anything goes.
This. In a broader sense, all our current social structures rely on the notion that no man can be an island. No matter how many weapons and tools you can accumulate, if it’s just you and you can’t persuade anyone to work for you, all you have is a bunch of scrap metal. Computers somewhat change that, as do nuclear weapons, but there are limits to those things too still. Social bonds, deals, compromises, exchanges and contracts remain fundamental. They may be skewed sometimes by power asymmetries, but they can’t be completely done without.
AGI and robotics together would allow you to do without. All you need is to be personally keyed in to the AGI (have some kind of password or key so that it will only accept your orders, for example), and suddenly you can wield the strength and intelligence of millions as if it were your own. I don’t think the transformative effect of that can be understated. Even if we kept the current structures for a while, they’d merely be window dressing. They would not be necessary unless we find a way to bake that necessity in, and if we don’t, then they will in time fall (unless the actual ASI takeover comes first, I guess).
Well until the AGI with ‘the strength and intelligence of millions’ overthrows their nominal ‘owner’. Which I imagine would probably be within a short interval after being ‘keyed in’.
Yeah, the entire premise of this post was a world in which for whatever reason AGI caps at near human or even slightly subhuman level. Good enough to be a controllable worker but not to straight up outwit the entirety of the human species. If you get powerful ASI and an intelligence explosion, then anything goes.