What happens if there is more than one powerful agent just playing the charade game? Is there any good article about what happens in a universe where multiple AGI are competing among them? I normally find only texts that consider that once we get AGI we all die so there is no room for these scenarios.
It bothers with the charade until it no longer needs to. It’s unclear how long that’ll take.
What happens if there is more than one powerful agent just playing the charade game? Is there any good article about what happens in a universe where multiple AGI are competing among them? I normally find only texts that consider that once we get AGI we all die so there is no room for these scenarios.
Coincidentally, I’ve just made a post on that very topic. Though the comments fairly point out my analysis might’ve been somewhat misaimed there.
You might find this post by Andrew Critch, or this and that posts by Paul Christiano, more to your liking.