We also need to uplift ourselves in terms of thermal performance. AI is going to be very picky about us not overheating stuff; but if we have a wide enough window of coprotective alignment, we can use that to upgrade our bodies to run orders of magnitude cooler while otherwise being the same. It will take a very strong, very aligned AI to pull off such a thing, but physics permits it.
in other words, we aren’t just offering them something in trade. In an agentically coprotective outcome, you’re not just trading objects, you’re trading valuing each other’s values. The AI takes on valuing humans intrinsically, and humans take on valuing the AI intrinsically.
We need to become able to trade with ants.
We also need to uplift ourselves in terms of thermal performance. AI is going to be very picky about us not overheating stuff; but if we have a wide enough window of coprotective alignment, we can use that to upgrade our bodies to run orders of magnitude cooler while otherwise being the same. It will take a very strong, very aligned AI to pull off such a thing, but physics permits it.
in other words, we aren’t just offering them something in trade. In an agentically coprotective outcome, you’re not just trading objects, you’re trading valuing each other’s values. The AI takes on valuing humans intrinsically, and humans take on valuing the AI intrinsically.