Most of science is actually done by induction—To come up with something worth testing, a scientist needs to do lots of sound induction first or borrow an idea from someone who already used induction. This is because induction is the only way to reliably find candidate hypotheses which deserve attention. Examples of bad ways to find hypotheses include finding something interesting or surprising to believe in and then pinning all your hopes on that thing turning out to be true.
Relenquishment – “That which can be destroyed by the truth should be.” -P. C. Hodgell
Lightness – follow the evidence wherever it leads
Evenness – resist selective skepticism; use reason, not rationalization
Argument – do not avoid arguing; strive for exact honesty; fairness does not mean balancing yourself evenly between propositions
Empiricism – knowledge is rooted in empiricism and its fruit is prediction; argue what experiences to anticipate, not which beliefs to profess
Simplicity – is virtuous in belief, design, planning, and justification; ideally: nothing left to take away, not nothing left to add
Humility – take actions, anticipate errors; do not boast of modesty; no one achieves perfection
Perfectionism – seek the answer that is perfectly right – do not settle for less
Precision – the narrowest statements slice deepest; don’t walk but dance to the truth
Scholarship – absorb the powers of science
[The void] (the nameless virtue) – “More than anything, you must think of carrying your map through to reflecting the territory.”
Oops—Theories must be bold and expose themselves to falsification; be willing to commit the heroic sacrifice of giving up your own ideas when confronted with contrary evidence; play nice in your arguments; try not to deceive yourself; and other fuzzy verbalisms. It is better to say oops quickly when you realize a mistake. The alternative is stretching out the battle with yourself over years.
Explaining vs. explaining away – Explaining something does not subtract from its beauty. It in fact heightens it. Through understanding it, you gain greater awareness of it. Through understanding it, you are more likely to notice its similarities and interrelationships with others things. Through understanding it, you become able to see it not only on one level, but on multiple. In regards to the delusions which people are emotionally attached to, that which can be destroyed by the truth should be.
Ugh field—Pavlovian conditioning can cause humans to unconsciously flinch from even thinking about a serious personal problem they have. We call it an “ugh field”. The ugh field forms a self-shadowing blind spot covering an area desperately in need of optimization.
Privileging the question—questions that someone has unjustifiably brought to your attention in the same way that a privileged hypothesis unjustifiably gets brought to your attention. Examples are: should gay marriage be legal? Should Congress pass stricter gun control laws? Should immigration policy be tightened or relaxed? The problem with privileged questions is that you only have so much attention to spare. Attention paid to a question that has been privileged funges against attention you could be paying to better questions. Even worse, it may not feel from the inside like anything is wrong: you can apply all of the epistemic rationality in the world to answering a question like “should Congress pass stricter gun control laws?” and never once ask yourself where that question came from and whether there are better questions you could be answering instead.
Something to protect—The Art must have a purpose other than itself, or it collapses into infinite recursion.
Take joy in the merely real – If you believe that science coming to know about something places it into the dull catalogue of common things, then you’re going to be disappointed in pretty much everything eventually —either it will turn out not to exist, or even worse, it will turn out to be real. Another way to think about it is that if the magical and mythical were common place they would be merely real. If dragons were common, but zebras were a rare legendary creature then there’s a certain sort of person who would ignore dragons, who would never bother to look at dragons, and chase after rumors of zebras. The grass is always greener on the other side of reality. If we cannot take joy in the merely real, our lives shall be empty indeed.
Complexity of value—the thesis that human values have high Kolmogorov complexity and so cannot be summed up or compressed into a few simple rules. It includes the idea of fragility of value which is the thesis that losing even a small part of the rules that make up our values could lead to results that most of us would now consider as unacceptable.
Egan’s law—“It all adds up to normality.” — Greg Egan. The purpose of a theory is to add up to observed reality, rather than something else. Science sets out to answer the question “What adds up to normality?” and the answer turns out to be Quantum mechanics adds up to normality. A weaker extension of this principle applies to ethical and meta-ethical debates, which generally ought to end up explaining why you shouldn’t eat babies, rather than why you should.
Emotion—Contrary to the stereotype, rationality doesn’t mean denying emotion. When emotion is appropriate to the reality of the situation, it should be embraced; only when emotion isn’t appropriate should it be suppressed.
Litany of Gendlin – “What is true is already so. Owning up to it doesn’t make it worse. Not being open about it doesn’t make it go away. And because it’s true, it is what is there to be interacted with. Anything untrue isn’t there to be lived. People can stand what is true, for they are already enduring it.” —Eugene Gendlin
Litany of Tarski – “If the box contains a diamond, I desire to believe that the box contains a diamond; If the box does not contain a diamond, I desire to believe that the box does not contain a diamond; Let me not become attached to beliefs I may not want. “ —The Meditation on Curiosity
Magic—What seems to humans like a simple explanation, sometimes isn’t at all. In our own naturalistic, reductionist universe, there is always a simpler explanation. Any complicated thing that happens, happens because there is some physical mechanism behind it, even if you don’t know the mechanism yourself (which is most of the time). There is no magic.
Words can be wrong – There are many ways that words can be wrong it is for this reason that we should avoid arguing by definition. Instead, to facilitate communication we can taboo and reduce: we can replace the symbol with the substance and talk about facts and anticipations, not definitions.
Some more:
Shut up and multiply- the ability to trust the math even when it feels wrong
Most of science is actually done by induction—To come up with something worth testing, a scientist needs to do lots of sound induction first or borrow an idea from someone who already used induction. This is because induction is the only way to reliably find candidate hypotheses which deserve attention. Examples of bad ways to find hypotheses include finding something interesting or surprising to believe in and then pinning all your hopes on that thing turning out to be true.
Twelve virtues of rationality
Curiosity – the burning itch
Relenquishment – “That which can be destroyed by the truth should be.” -P. C. Hodgell
Lightness – follow the evidence wherever it leads
Evenness – resist selective skepticism; use reason, not rationalization
Argument – do not avoid arguing; strive for exact honesty; fairness does not mean balancing yourself evenly between propositions
Empiricism – knowledge is rooted in empiricism and its fruit is prediction; argue what experiences to anticipate, not which beliefs to profess
Simplicity – is virtuous in belief, design, planning, and justification; ideally: nothing left to take away, not nothing left to add
Humility – take actions, anticipate errors; do not boast of modesty; no one achieves perfection
Perfectionism – seek the answer that is perfectly right – do not settle for less
Precision – the narrowest statements slice deepest; don’t walk but dance to the truth
Scholarship – absorb the powers of science
[The void] (the nameless virtue) – “More than anything, you must think of carrying your map through to reflecting the territory.”
Oops—Theories must be bold and expose themselves to falsification; be willing to commit the heroic sacrifice of giving up your own ideas when confronted with contrary evidence; play nice in your arguments; try not to deceive yourself; and other fuzzy verbalisms. It is better to say oops quickly when you realize a mistake. The alternative is stretching out the battle with yourself over years.
Explaining vs. explaining away – Explaining something does not subtract from its beauty. It in fact heightens it. Through understanding it, you gain greater awareness of it. Through understanding it, you are more likely to notice its similarities and interrelationships with others things. Through understanding it, you become able to see it not only on one level, but on multiple. In regards to the delusions which people are emotionally attached to, that which can be destroyed by the truth should be.
Ugh field—Pavlovian conditioning can cause humans to unconsciously flinch from even thinking about a serious personal problem they have. We call it an “ugh field”. The ugh field forms a self-shadowing blind spot covering an area desperately in need of optimization.
Privileging the question—questions that someone has unjustifiably brought to your attention in the same way that a privileged hypothesis unjustifiably gets brought to your attention. Examples are: should gay marriage be legal? Should Congress pass stricter gun control laws? Should immigration policy be tightened or relaxed? The problem with privileged questions is that you only have so much attention to spare. Attention paid to a question that has been privileged funges against attention you could be paying to better questions. Even worse, it may not feel from the inside like anything is wrong: you can apply all of the epistemic rationality in the world to answering a question like “should Congress pass stricter gun control laws?” and never once ask yourself where that question came from and whether there are better questions you could be answering instead.
Something to protect—The Art must have a purpose other than itself, or it collapses into infinite recursion.
Take joy in the merely real – If you believe that science coming to know about something places it into the dull catalogue of common things, then you’re going to be disappointed in pretty much everything eventually —either it will turn out not to exist, or even worse, it will turn out to be real. Another way to think about it is that if the magical and mythical were common place they would be merely real. If dragons were common, but zebras were a rare legendary creature then there’s a certain sort of person who would ignore dragons, who would never bother to look at dragons, and chase after rumors of zebras. The grass is always greener on the other side of reality. If we cannot take joy in the merely real, our lives shall be empty indeed.
Complexity of value—the thesis that human values have high Kolmogorov complexity and so cannot be summed up or compressed into a few simple rules. It includes the idea of fragility of value which is the thesis that losing even a small part of the rules that make up our values could lead to results that most of us would now consider as unacceptable.
Egan’s law—“It all adds up to normality.” — Greg Egan. The purpose of a theory is to add up to observed reality, rather than something else. Science sets out to answer the question “What adds up to normality?” and the answer turns out to be Quantum mechanics adds up to normality. A weaker extension of this principle applies to ethical and meta-ethical debates, which generally ought to end up explaining why you shouldn’t eat babies, rather than why you should.
Emotion—Contrary to the stereotype, rationality doesn’t mean denying emotion. When emotion is appropriate to the reality of the situation, it should be embraced; only when emotion isn’t appropriate should it be suppressed.
Litany of Gendlin – “What is true is already so. Owning up to it doesn’t make it worse. Not being open about it doesn’t make it go away. And because it’s true, it is what is there to be interacted with. Anything untrue isn’t there to be lived. People can stand what is true, for they are already enduring it.” —Eugene Gendlin
Litany of Tarski – “If the box contains a diamond, I desire to believe that the box contains a diamond; If the box does not contain a diamond, I desire to believe that the box does not contain a diamond; Let me not become attached to beliefs I may not want. “ —The Meditation on Curiosity
Magic—What seems to humans like a simple explanation, sometimes isn’t at all. In our own naturalistic, reductionist universe, there is always a simpler explanation. Any complicated thing that happens, happens because there is some physical mechanism behind it, even if you don’t know the mechanism yourself (which is most of the time). There is no magic.
Words can be wrong – There are many ways that words can be wrong it is for this reason that we should avoid arguing by definition. Instead, to facilitate communication we can taboo and reduce: we can replace the symbol with the substance and talk about facts and anticipations, not definitions.