There are several endgame scenarios for evolution:
We create misaligned AI and go extinct along with the rest of the biosphere — a catastrophic failure for evolution.
We create aligned AI and proceed into a glorious transhuman future where everyone is either a cyborg, an uploaded mind, or a nanobot swarm with no trace of DNA — another catastrophic failure for evolution.
We create aligned AI and proceed into a glorious transhuman future, but some people choose to remain “natural” for nostalgic reasons. I don’t think we can extrapolate transhuman ethics to determine whether this will happen.
From the POV of evolution, it’s as if we initiated ASI and thought, “Well, it hasn’t killed us yet.”
Yes, because for most of the evolved lineages at the time, their values of gene preservation were suddenly zeroed. The later increase in diversity doesn’t change that that’s a big dip
Hardly catastrophic if it was a dip followed by a great increase in diversity&complexity. More akin to a dip during a cyclic learning rate shift that partially resets the board to jump the system out of a local equilibrium.
There are several endgame scenarios for evolution:
We create misaligned AI and go extinct along with the rest of the biosphere — a catastrophic failure for evolution.
We create aligned AI and proceed into a glorious transhuman future where everyone is either a cyborg, an uploaded mind, or a nanobot swarm with no trace of DNA — another catastrophic failure for evolution.
We create aligned AI and proceed into a glorious transhuman future, but some people choose to remain “natural” for nostalgic reasons. I don’t think we can extrapolate transhuman ethics to determine whether this will happen.
From the POV of evolution, it’s as if we initiated ASI and thought, “Well, it hasn’t killed us yet.”
Was creating photosynthesis and destroying most of the biosphere with oxygen a “catastrophic failure for evolution”?
Yes, because for most of the evolved lineages at the time, their values of gene preservation were suddenly zeroed. The later increase in diversity doesn’t change that that’s a big dip
Hardly catastrophic if it was a dip followed by a great increase in diversity&complexity. More akin to a dip during a cyclic learning rate shift that partially resets the board to jump the system out of a local equilibrium.
What of scenarios where both organic life and ‘AI’ go ‘extinct’? e.g. a gamma ray burst, really big asteroid impact, etc...