1- nowadays even in ukrainian war zone there’s some kind of (electronic) communication taking place. If an AGI becomes sentient it could “speak” to people and communicate if it want’s to. There’s no way for us to distinguish an AGI from a “very intelligent human” The only caveat here is replace “exterminate” with “dominate” because while relying on us as it’s labour force it wouldn’t exterminate us but dominate us.
Also manipulating humans is, imho, “so simple” that even humans with a little bit more of knowledge or intelligence can do it. Even magicians can do it, and your first impression is that magic exists. Manipulating humans, imho, should be as simple for an AGI as it is manipulating insects or relatively simple animals for us. We can process such a small amount of data, retain such a small amount of data and also we’re still so tied to “old precepts” that made us the way we’re (being part of natural selection), such things as trusting everything we see… (again think the magician and the rational effort you have to do to oppose your first impression...)
Also we’ve already laid the fundamental tools needed for this with our modern hyper communication. I would totally agree with you if we didn’t have satellites in low orbit sharing internet, ubiquitous mobile phones, etc.
2- by being orders of magnitude more intelligent than us, the margin for error could be much smaller, the changes needed to process those errors and correct them could be almost instantaneous (for our standards), etc.
Nikita, I don’t agree…
1- nowadays even in ukrainian war zone there’s some kind of (electronic) communication taking place. If an AGI becomes sentient it could “speak” to people and communicate if it want’s to. There’s no way for us to distinguish an AGI from a “very intelligent human” The only caveat here is replace “exterminate” with “dominate” because while relying on us as it’s labour force it wouldn’t exterminate us but dominate us.
Also manipulating humans is, imho, “so simple” that even humans with a little bit more of knowledge or intelligence can do it. Even magicians can do it, and your first impression is that magic exists. Manipulating humans, imho, should be as simple for an AGI as it is manipulating insects or relatively simple animals for us. We can process such a small amount of data, retain such a small amount of data and also we’re still so tied to “old precepts” that made us the way we’re (being part of natural selection), such things as trusting everything we see… (again think the magician and the rational effort you have to do to oppose your first impression...)
Also we’ve already laid the fundamental tools needed for this with our modern hyper communication. I would totally agree with you if we didn’t have satellites in low orbit sharing internet, ubiquitous mobile phones, etc.
2- by being orders of magnitude more intelligent than us, the margin for error could be much smaller, the changes needed to process those errors and correct them could be almost instantaneous (for our standards), etc.
(as usual I apologize for my typos)