If we want hamburgers & the AI can make them much more efficiently than we can, why wouldn’t we just willingly give our resources to the AI so that it can make hamburgers? Resisting the AI would be dangerous for us depending on the AI’s military capabilities & the AI trying to overpower us could be dangerous for the AI as well.
The thing about nations is that they can externalize the costs & consolidate the benefits of invading a country—the politicians & corporations that benefit from the invasion don’t have to fight & die in the battles—that’s what poor young men & women are for; nor do they pay for the costs of the military supplies—that’s what taxes & debt are for.
There’s no scarcity of air. If the AI can turn air into hamburgers, I don’t think the resources contained in my body would be the AI’s preferred source of energy given that they will be more costly to extract (I will fight to keep them) & contain less energy overall than many other potential sources. If the AI can turn air into hamburgers, it could just leave the earth & convert the core of a huge star into hamburgers instead.
If we want hamburgers & the AI can make them much more efficiently than we can, why wouldn’t we just willingly give our resources to the AI so that it can make hamburgers?
If your preferences are maximised by you being turned into a hamburger then by all means do so.
I think we need to clarify how God-like this hypothetical AI is. If the AI is not very God-like, then trying to turn humans into hamburgers could be very costly for it. If we made the AI, maybe we could make a competing AI to resist it or use some backdoor built into the AI’s programming to pull the plug. At the very least, we could launch missiles at it.
If the AI is very God-like, then there are more resource rich sources than human beings it could easily obtain. It’d be sort of like humans gathering up all of the horses for transportation when we already have cars & planes.
If we want hamburgers & the AI can make them much more efficiently than we can, why wouldn’t we just willingly give our resources to the AI so that it can make hamburgers? Resisting the AI would be dangerous for us depending on the AI’s military capabilities & the AI trying to overpower us could be dangerous for the AI as well.
The thing about nations is that they can externalize the costs & consolidate the benefits of invading a country—the politicians & corporations that benefit from the invasion don’t have to fight & die in the battles—that’s what poor young men & women are for; nor do they pay for the costs of the military supplies—that’s what taxes & debt are for.
Because “resources” means things like clothing, air, water, electricity, and the minerals contained in your body.
There’s no scarcity of air. If the AI can turn air into hamburgers, I don’t think the resources contained in my body would be the AI’s preferred source of energy given that they will be more costly to extract (I will fight to keep them) & contain less energy overall than many other potential sources. If the AI can turn air into hamburgers, it could just leave the earth & convert the core of a huge star into hamburgers instead.
If your preferences are maximised by you being turned into a hamburger then by all means do so.
I think we need to clarify how God-like this hypothetical AI is. If the AI is not very God-like, then trying to turn humans into hamburgers could be very costly for it. If we made the AI, maybe we could make a competing AI to resist it or use some backdoor built into the AI’s programming to pull the plug. At the very least, we could launch missiles at it.
If the AI is very God-like, then there are more resource rich sources than human beings it could easily obtain. It’d be sort of like humans gathering up all of the horses for transportation when we already have cars & planes.