I would add that all but the very worst versions of “human takeover” are much more recoverable than most versions of “AI takeover.” And until and unless the human-in-charge makes sufficiently significant changes to their own biology and neurology that I’m not sure the term “human” still applies, they are susceptible to many more (and better understood) processes for changing their minds and morals.
In other words: I don’t want to end up in the human-takeover world, but I can imagine plausible future histories where that scenario gives way to an eventually-good outcome, in a way that seems much less likely for AI-takeover worlds.
I’m sure they would. And some of those ways ASI can help would include becoming immortal, replacing relationships with other humans things like that. But compared to an ASI, it is easier for a human to die, to have their mind changed by outside influences, and to place intrinsic value on the whole range of things humans care about including other people.
I would add that all but the very worst versions of “human takeover” are much more recoverable than most versions of “AI takeover.” And until and unless the human-in-charge makes sufficiently significant changes to their own biology and neurology that I’m not sure the term “human” still applies, they are susceptible to many more (and better understood) processes for changing their minds and morals.
In other words: I don’t want to end up in the human-takeover world, but I can imagine plausible future histories where that scenario gives way to an eventually-good outcome, in a way that seems much less likely for AI-takeover worlds.
Why are they more recoverable? Seems like a human who seized power would seek asi advice on how to cement their power
I’m sure they would. And some of those ways ASI can help would include becoming immortal, replacing relationships with other humans things like that. But compared to an ASI, it is easier for a human to die, to have their mind changed by outside influences, and to place intrinsic value on the whole range of things humans care about including other people.