It’s the most basic rationalist skill there is, in my opinion, but for some reason it’s not much talked about here. I call it “thinking like the universe” as opposed to “thinking like a human”. It means you remove yourself from the picture, you forget all about your favourite views and you stop caring about the implications of your answer since those should not impact the truth of the matter, and describe the situation in purely factual terms. You don’t follow any specific chain of logic towards finding an answer: You instead allow the answer to naturally flow from the facts.
It means you don’t ask “which facts argue in favour of my view and which against?”, but “what are the facts?” It means you don’t ask “What is my hypothesis?”, you ask “which hypotheses flow naturally from the facts?” It means you don’t ask “What do I believe?” but “what would an intelligent person believe given these facts?” It means you don’t ask “which hypothesis do I believe is true?”, but “how does the probability mass naturally divide itself over competing hypotheses based on the evidence?” It means you don’t ask “How can I test this hypothesis?” but “Which test would maximally distinguish between competing hypotheses?” It means you never ever ask who has the “burden of proof”.
And so on and so forth. I see it as the most fundamental skill because it allows you to ask the right questions, and if you start with the wrong question it really doesn’t matter what you do with it afterwards.
The primary thing I seem to do is to remind myself to care about the right things. I am irrelevant. My emotions are irrelevant. Truth is not influenced by what I want to be true. I am frequently amazed by the degree with which my emotions are influenced by subconscious beliefs. For example I notice that the people who make me most angry when they’re irrational are the ones I respect the most. People who get offended usually believe at some level that they are entitled to being offended. People who are bad at getting to the truth of a matter usually care more about how they feel than about what is actually true. (This is related to the fundamental optimization problem: The truth will always sound less truthful than the most truthful sounding falsehood.) Noticing that kind of thing is often more effective than trying to control emotions the hard way.
Secondly, you want to pay attention to your thoughts as much as possible. This is just meditation, really. If you become conscious of your thoughts, you gain a degree of control over them. Notice what you think, when you think it, and why. If a question makes you angry, don’t just suppress the anger, ask yourself why.
For the rest it’s just about cultivating a habit of asking the right questions. Never ask yourself what you think, since the universe doesn’t care what you think. Instead say “Velorien believes X: How much does this increase the probability of X?”.
The truth will always sound less truthful than the most truthful sounding falsehood.
This needs to be on posters and T-shirts if it isn’t already. Is it a well-known principle?
Thank you for the explanation. This overall idea (of the relationship between belief and reality, and the fact that it only goes one way) is in itself not new to me, but your perspective on it is, and I hope it will help me develop my ability to think objectively.
Also thanks for the music video. Shame I can’t upvote you multiple times.
This needs to be on posters and T-shirts if it isn’t already. Is it a well-known principle?
Sadly not. I keep meaning to post an article about this, but it’s really hard to write an article about a complex subject in such a way that people really get it (especially if the reader has little patience/charity), so I keep putting it off until I have the time to make it perfect. I have some time this weekend though, so maybe...
I think the Fundamental Optimization Problem is the biggest problem humanity has right now and it explains everything that’s wrong with society: It represents the fact that doing what’s good will always feel less good than doing what feels good, people who optimize for altruism will always be seen as more selfish than people who optimize for being seen as altruistic, the people who get in power will always be the ones whose skills are optimized for getting in power and not for knowing what to do once they get there, and people who yell about truth the most are the biggest liars. It’s also why “no good deed goes unpunished”. Despite what Yoda claims, the dark side really is stronger.
Unfortunately there’s no good post about this on LW AFAIK, but Yvain’s post about Moloch is related and is really good (and really long).
Also thanks for the music video. Shame I can’t upvote you multiple times.
Your attitude makes me happy, thank you. :)
It’s the most basic rationalist skill there is, in my opinion, but for some reason it’s not much talked about here. I call it “thinking like the universe” as opposed to “thinking like a human”. It means you remove yourself from the picture, you forget all about your favourite views and you stop caring about the implications of your answer since those should not impact the truth of the matter, and describe the situation in purely factual terms. You don’t follow any specific chain of logic towards finding an answer: You instead allow the answer to naturally flow from the facts.
It means you don’t ask “which facts argue in favour of my view and which against?”, but “what are the facts?”
It means you don’t ask “What is my hypothesis?”, you ask “which hypotheses flow naturally from the facts?”
It means you don’t ask “What do I believe?” but “what would an intelligent person believe given these facts?”
It means you don’t ask “which hypothesis do I believe is true?”, but “how does the probability mass naturally divide itself over competing hypotheses based on the evidence?”
It means you don’t ask “How can I test this hypothesis?” but “Which test would maximally distinguish between competing hypotheses?”
It means you never ever ask who has the “burden of proof”.
And so on and so forth. I see it as the most fundamental skill because it allows you to ask the right questions, and if you start with the wrong question it really doesn’t matter what you do with it afterwards.
I think I understand now, thank you.
Do you follow any specific practices in order to internalise this approach, or do you simply endeavour to apply it whenever you remember?
The primary thing I seem to do is to remind myself to care about the right things. I am irrelevant. My emotions are irrelevant. Truth is not influenced by what I want to be true. I am frequently amazed by the degree with which my emotions are influenced by subconscious beliefs. For example I notice that the people who make me most angry when they’re irrational are the ones I respect the most. People who get offended usually believe at some level that they are entitled to being offended. People who are bad at getting to the truth of a matter usually care more about how they feel than about what is actually true. (This is related to the fundamental optimization problem: The truth will always sound less truthful than the most truthful sounding falsehood.) Noticing that kind of thing is often more effective than trying to control emotions the hard way.
Secondly, you want to pay attention to your thoughts as much as possible. This is just meditation, really. If you become conscious of your thoughts, you gain a degree of control over them. Notice what you think, when you think it, and why. If a question makes you angry, don’t just suppress the anger, ask yourself why.
For the rest it’s just about cultivating a habit of asking the right questions. Never ask yourself what you think, since the universe doesn’t care what you think. Instead say “Velorien believes X: How much does this increase the probability of X?”.
Bertrand Russel gets it right, of course
This needs to be on posters and T-shirts if it isn’t already. Is it a well-known principle?
Thank you for the explanation. This overall idea (of the relationship between belief and reality, and the fact that it only goes one way) is in itself not new to me, but your perspective on it is, and I hope it will help me develop my ability to think objectively.
Also thanks for the music video. Shame I can’t upvote you multiple times.
Sadly not. I keep meaning to post an article about this, but it’s really hard to write an article about a complex subject in such a way that people really get it (especially if the reader has little patience/charity), so I keep putting it off until I have the time to make it perfect. I have some time this weekend though, so maybe...
I think the Fundamental Optimization Problem is the biggest problem humanity has right now and it explains everything that’s wrong with society: It represents the fact that doing what’s good will always feel less good than doing what feels good, people who optimize for altruism will always be seen as more selfish than people who optimize for being seen as altruistic, the people who get in power will always be the ones whose skills are optimized for getting in power and not for knowing what to do once they get there, and people who yell about truth the most are the biggest liars. It’s also why “no good deed goes unpunished”. Despite what Yoda claims, the dark side really is stronger.
Unfortunately there’s no good post about this on LW AFAIK, but Yvain’s post about Moloch is related and is really good (and really long).
Aww shucks. ^_^