Perfect rationality is, by definition, perfect and can never go wrong, for if it went wrong, it would not be perfect rationality. But none of us is perfect. When an imperfect person comes into contact with this ultimate solvent of unexamined beliefs, the ways they could go wrong outnumber the ways they could go right.
“There is no such thing as morality, therefore I can lie and steal all I like and you’re a chump if you don’t!” “There is no afterlife, therefore all is meaningless and I should just cut my throat now! Or yours! It doesn’t matter!” “Everything that people say is self-serving lies and if you say you don’t agree you’re just another self-serving liar!” “At last, I see the truth, while everyone else is just another slave of the Matrix!”
That last is a hazard on any path to enlightenment, rationalistic or otherwise. Belief in one’s own enlightenment—even an accurate one—provides a fully general counterargument to anyone else: they’re not as enlightened.
ETA: Those aren’t actual quotations, but I’m not making them up out of thin air. On the first, compare pjeby’s recent description of black-hat PUAs. On the second, a while back (but I can’t find the actual messages) someone here was arguing that unless he could live forever, nothing could matter to him. On the third, black-hat PUAs and people seeing status games at the root of all interaction are going that way. On the last, as I said above, this is a well-known hazard on many paths. There’s even an xkcd on the subject.
Perfect rationality can still go wrong. Consider for example a perfectly rational player playing the Monty Hall game. The rational thing to do is to switch doors. But that can still turn out to be wrong. A perfectly rational individual can still be wrong.
Perfect rationality is, by definition, perfect and can never go wrong, for if it went wrong, it would not be perfect rationality. But none of us is perfect. When an imperfect person comes into contact with this ultimate solvent of unexamined beliefs, the ways they could go wrong outnumber the ways they could go right.
“There is no such thing as morality, therefore I can lie and steal all I like and you’re a chump if you don’t!” “There is no afterlife, therefore all is meaningless and I should just cut my throat now! Or yours! It doesn’t matter!” “Everything that people say is self-serving lies and if you say you don’t agree you’re just another self-serving liar!” “At last, I see the truth, while everyone else is just another slave of the Matrix!”
That last is a hazard on any path to enlightenment, rationalistic or otherwise. Belief in one’s own enlightenment—even an accurate one—provides a fully general counterargument to anyone else: they’re not as enlightened.
ETA: Those aren’t actual quotations, but I’m not making them up out of thin air. On the first, compare pjeby’s recent description of black-hat PUAs. On the second, a while back (but I can’t find the actual messages) someone here was arguing that unless he could live forever, nothing could matter to him. On the third, black-hat PUAs and people seeing status games at the root of all interaction are going that way. On the last, as I said above, this is a well-known hazard on many paths. There’s even an xkcd on the subject.
Perfect rationality can still go wrong. Consider for example a perfectly rational player playing the Monty Hall game. The rational thing to do is to switch doors. But that can still turn out to be wrong. A perfectly rational individual can still be wrong.
The rational thing to do might be to look behind the doors, but in any case, perfect rationality is not perfect omniscience.