I’ve heard some sort of appreciation or respect argument. An AI would recognize that we built them and so respect us enough to keep us alive. One form of reasoning this might take is that an AI would notice that it wouldn’t want to die if it created an even more powerful AI and so wouldn’t destroy its creators. I don’t have a source though. I may have just heard these in conversations with friends.
Perhaps the first superhuman AGI isn’t tremendously superhuman, but smart enough to realize that humanity’s goose would be cooked if it got any smarter or it started the exponential explosion of self-improving superhuman intelligence. So it proceeds to take over the world and rules it as an oppressive dictator to prevent this from happening.
To preserve humanity, it proceeds to build colonizing starships operated by copies of itself which terraform and seed other planets with human life, which is ruled in such a fashion that society is kept frozen in something resembling “the dark ages,” where science and technological industry exists but is disguised as fantasy magic.
It was my intention to come up with a neat sci-fi plot, not to make a prediction. If you like that as a plot, you might want to check out “Scrapped Princess.”
I’ve heard some sort of appreciation or respect argument. An AI would recognize that we built them and so respect us enough to keep us alive. One form of reasoning this might take is that an AI would notice that it wouldn’t want to die if it created an even more powerful AI and so wouldn’t destroy its creators. I don’t have a source though. I may have just heard these in conversations with friends.
Now that you mention it, I’ve heard that too, but can’t remember a source either.
Perhaps the first superhuman AGI isn’t tremendously superhuman, but smart enough to realize that humanity’s goose would be cooked if it got any smarter or it started the exponential explosion of self-improving superhuman intelligence. So it proceeds to take over the world and rules it as an oppressive dictator to prevent this from happening.
To preserve humanity, it proceeds to build colonizing starships operated by copies of itself which terraform and seed other planets with human life, which is ruled in such a fashion that society is kept frozen in something resembling “the dark ages,” where science and technological industry exists but is disguised as fantasy magic.
Please write this science fiction story. It dosen’t seem useful for predictions though.
It was my intention to come up with a neat sci-fi plot, not to make a prediction. If you like that as a plot, you might want to check out “Scrapped Princess.”