That’s conceivable, but there are a few reasons I’m not too concerned about it.
Organizations are made mostly out of humans
Is Google “made mostly out of humans”? What about its huge datacenters? They are where a lot of the real work gets done—right?
It is also conceivable that the team could make the AGI friendly to its members but not to the rest of humanity, but future utopia made perfect by AGI is about as far a concept as you can get, so most people will be idealistic about it.
So, I’m not sure I have this straight, but you seem to be saying that one of the reasons you are not concerned about this is because many people use a daft reasoning technique when dealing with the future utopias, and that makes you idealistic about it?
If so, that’s cool, but why should rational thinkers share your lack of concern?
Is Google “made mostly out of humans”? What about its huge datacenters? They are where a lot of the real work gets done—right?
So, I’m not sure I have this straight, but you seem to be saying that one of the reasons you are not concerned about this is because many people use a daft reasoning technique when dealing with the future utopias, and that makes you idealistic about it?
If so, that’s cool, but why should rational thinkers share your lack of concern?
Google’s datacenters don’t have much agency. Their humans do.
No, it makes them idealistic about it.