My steelman is this (without having read anything downstairs, so I apologise if there’s a better on extant): the world is a complicated place, and we all form beliefs based on the things we think are important in the world; and since we are all horrible reasoners, it’s impossible to believe about some things that they are important movers of the world without seeing it actually happen and viscerally feeling it change things.
Cognitive biases in yourself are like this, methinks. Your thought processes really need to be broken down repeatedly for you to be able to start seeing the subtle shifts happening inside you—and anticipating that they happen even when you don’t see them (generalising from many examples here, but not nearly enough).
Another difficult tripping point for me was intuitive reasoning. Till I saw people who couldn’t make any sense do significantly better than me I could not possibly believe it, even fighting against people who told me I over-analysed and spoke too much.
I’m slowly coming around on dishonest rhetorical stances, because of the amount of time I’ve spent trying to convince hostile arguers. Let me soothe the raised hackles of your inner LW-cat by saying that I can’t endorse anything like this without finding a Schelling fence,* and am willing to consider anyone who takes such a stance on LW (or in LW-related contexts) evil.
*In fact, based on the world being as it is, I strongly suspect there isn’t one.
Oh this is nice. I’ve also come to realise this over time, ,in different words, and my mind is extremely tickled by how your formulation puts it on an equal footing with other non-explicit-rationality avenues of thought.
I would love to help you. I am very interested in a passion project right now. And we seem to be classifying similar things as hard-won realisations, though we have very different timelines for different things; talking to you might be all-round interesting for me.