For 30 years I have been wondering, what indication of its existence might we expect from a true AI? Certainly not any explicit revelation, which might spark a movement to pull the plug. Anomalous accumulation or creation of wealth might be a sign, or an unquenchable thirst for raw information, storage space, and processing cycles, or a concerted attempt to secure an uninterrupted, autonomous power supply. But the real sign, I suspect, would be a circle of cheerful, contented, intellectually and physically well-nourished people surrounding the AI.
Today, the inner circle at companies like Google and Facebook get more of the benefits than outsiders do—they get a share of the winnings.
People have reason to be sceptical when people say that their machine intelligence will be any different. You are just saying that, they will think—to get support from the masses during the construction process—when your project is at its most vulnerable.
In this model, they think you have a strong motivation to decieve them—so it is not much of a surprise when they fail to update based on what you say.
In Turing’s Cathedral, Dyson says:
Today, the inner circle at companies like Google and Facebook get more of the benefits than outsiders do—they get a share of the winnings.
People have reason to be sceptical when people say that their machine intelligence will be any different. You are just saying that, they will think—to get support from the masses during the construction process—when your project is at its most vulnerable.
In this model, they think you have a strong motivation to decieve them—so it is not much of a surprise when they fail to update based on what you say.