Here is an intuition pump: you see a baby who got hold of his dad’s suitcase nuke and is about to destroy the city. Do you prevent him from pushing the button, even by lethal means? If the answer is yes, then consider Richard’s original question, and confirm that the differences in the two situations stand up to reverse your decision.
On the one hand, yes; on the other hand, I do think I take the risks from UFAI seriously, and have some relevant experience and skill, but still wouldn’t participate in a paramilitary operation against a GAI researcher.
edit: On reflection, this is due to my confidence in my ability to correctly predict the end of the world, and the problem of multiplying low probabilities by large utilities.
On reflection, this is due to my confidence in my ability to correctly predict the end of the world, and the problem of multiplying low probabilities by large utilities.
Here is an intuition pump: you see a baby who got hold of his dad’s suitcase nuke and is about to destroy the city. Do you prevent him from pushing the button, even by lethal means? If the answer is yes, then consider Richard’s original question, and confirm that the differences in the two situations stand up to reverse your decision.
On the one hand, yes; on the other hand, I do think I take the risks from UFAI seriously, and have some relevant experience and skill, but still wouldn’t participate in a paramilitary operation against a GAI researcher.
edit: On reflection, this is due to my confidence in my ability to correctly predict the end of the world, and the problem of multiplying low probabilities by large utilities.
You mean lack of confidence, right?