I think one of the problems with UFAI isn’t just human extinction, or even future human suffering. It’s that some kinds of UFAI (the paperclip-maximizer comes to mind) could take over our entire future light cone. preventing any future intelligent life (Earth-originating or otherwise) from evolving and finding a better path.
Eight years late reply, but oh well.
I think one of the problems with UFAI isn’t just human extinction, or even future human suffering. It’s that some kinds of UFAI (the paperclip-maximizer comes to mind) could take over our entire future light cone. preventing any future intelligent life (Earth-originating or otherwise) from evolving and finding a better path.