My problem with this argument is that the AIs which will accept your argument can be Pascal’s Mugged in general, which means they will never take over the world. It’s less “Sane rational agents will ignore this type of threat/trade” and more “Agents which consistently accept this type of argument will die instantly when others learn to exploit it”.
My problem with this argument is that the AIs which will accept your argument can be Pascal’s Mugged in general, which means they will never take over the world. It’s less “Sane rational agents will ignore this type of threat/trade” and more “Agents which consistently accept this type of argument will die instantly when others learn to exploit it”.