5 second level for evidence as soldiers
Notice that all your evidence favors your belief; or Notice the anger/resentment/fear when coming across evidence against your belief.
Pause and remember that
beliefs are just expectations and truth is a measure of how accurate your expectations are
evidence is not for or against a belief, it is a flow of probability between expectations
Feel aversion to not internalizing all the evidence, to not letting reality constrain your expectations (beliefs)
Make an bayesian calculation, incrementally incorporating all the evidence, so that your expectations (beliefs) are accurate (true).
A recent example for me comes from reading The Nurture Assumption and Selfish Reasons to Have more Kids.
I noticed I was really convinced by a lot of evidence in favor of the view that parental influence is less important than I thought.
My beliefs were being updated, but only by evidence in one direction—in favor of the hypothesis.
Not wanting to be inaccurate about the best way to raise children I searched google scholar for twin/adoption studies and criticisms.
I updated by beliefs based on the criticisms of the studies and I now feel confident in my expectations about parental influence.
Exercises include picking a belief (maybe one you recently acquired from a convincing friend) and researching all arguments for and against the belief. Write down your expectations before the research. As you research compare the research to your expectations and update your expectations as you go (I actually mean writing down so others can read it what you actually expect). Repeat. Eventually pick beliefs you have held for a long time and are a part of your identity (after practicing on recent beliefs that matter less).
Exercise: Pretend you are your evil alter ego when analyzing the reasons for your rationalization. What would your alter ego say about your rationalization? Your alter ego will probably come up with some selfish, lazy or just plain silly reasons for your rationalization. Once you have this list see the section on how to accept the truth.