10^100 intelligent people terminally prefer that 1 person is tortured. Preference utilitarianism says “do the torture”. My moral instinct says “no, it’s still wrong, no matter how many people prefer it”.
Yet your moral instinct is perfectly fine with having a justice system that puts innocent people in jail with a greater than 1 in 10^100 error rate.
Yet your moral instinct is perfectly fine with having a justice system that puts innocent people in jail with a greater than 1 in 10^100 error rate.
Sure, on instrumental grounds for consequentialist reasons. Not a terminal preference.