If Neanderthals could have created a well aligned agent,far more powerful than themselves, they would still be around and we, almost certainly, would not. The mereset possibility of creating super human, self improving, AGI is a total philosophical game changer. My personal interest is in the interaction between longtermism and the Fermi paradox—Any such AGIs actions are likely to be dominated by the need to prevail over any alien AGI that it ever encounters as such an encounter is almost certain to end one or the other.
If Neanderthals could have created a well aligned agent,far more powerful than themselves, they would still be around and we, almost certainly, would not.
The mereset possibility of creating super human, self improving, AGI is a total philosophical game changer.
My personal interest is in the interaction between longtermism and the Fermi paradox—Any such AGIs actions are likely to be dominated by the need to prevail over any alien AGI that it ever encounters as such an encounter is almost certain to end one or the other.