I can’t imagine any person I would want to talk to more than I want to contain a UFAI so it doesn’t destroy the world. And since this particular AI is trying to bribe me with a simulation, about the best outcome I’d expect going forward is that it drops everyone in to utopia-simulations, which I tend to view as being patently against the whole idea of a FAI.
Also, any AI that has that much insight in to me is going to just be intrinsically terrifying, since it means it probably has me completely “hacked” in a few more sentences.
In short, it’s exactly the sort of AI where I value my commitment to destroying AIs, because it means I won’t hesitate to go “Creepy! Destroyed!”
I can’t imagine any person I would want to talk to more than I want to contain a UFAI so it doesn’t destroy the world. And since this particular AI is trying to bribe me with a simulation, about the best outcome I’d expect going forward is that it drops everyone in to utopia-simulations, which I tend to view as being patently against the whole idea of a FAI.
Also, any AI that has that much insight in to me is going to just be intrinsically terrifying, since it means it probably has me completely “hacked” in a few more sentences.
In short, it’s exactly the sort of AI where I value my commitment to destroying AIs, because it means I won’t hesitate to go “Creepy! Destroyed!”