If our corrupted hardware can’t be trusted to compute the consequences in a specific case, it probably also can’t be trusted to compute the consequences of a general rule. All our derivations of deontological rules will be tilted in the direction of self interest or tribalism or unexamined disgust responses, not some galaxy-brained evaluation of the consequences of applying the rule to all possible situations.
Russell conjugation: I have deontological guardrails, you have customs, he has ancient taboos.
If our corrupted hardware can’t be trusted to compute the consequences in a specific case, it probably also can’t be trusted to compute the consequences of a general rule. All our derivations of deontological rules will be tilted in the direction of self interest or tribalism or unexamined disgust responses, not some galaxy-brained evaluation of the consequences of applying the rule to all possible situations.
Russell conjugation: I have deontological guardrails, you have customs, he has ancient taboos.
[edit: related Scott post which I endorse in spite of what I said above: https://slatestarcodex.com/2014/02/23/in-favor-of-niceness-community-and-civilization/]