Scientific Evidence, Legal Evidence, Rational Evidence
Suppose that your good friend, the police commissioner, tells you in strictest confidence that the crime kingpin of your city is Wulky Wilkinsen. As a rationalist, are you licensed to believe this statement? Put it this way: if you go ahead and insult Wulky, I’d call you foolhardy. Since it is prudent to act as if Wulky has a substantially higher-than-default probability of being a crime boss, the police commissioner’s statement must have been strong Bayesian evidence.
Our legal system will not imprison Wulky on the basis of the police commissioner’s statement. It is not admissible as legal evidence. Maybe if you locked up every person accused of being a crime boss by a police commissioner, you’d initially catch a lot of crime bosses, and relatively few people the commissioner just didn’t like. But unrestrained power attracts corruption like honey attracts flies: over time, you’d catch fewer and fewer real crime bosses (who would go to greater lengths to ensure anonymity), and more and more innocent victims.
This does not mean that the police commissioner’s statement is not rational evidence. It still has a lopsided likelihood ratio, and you’d still be a fool to insult Wulky. But on a social level, in pursuit of a social goal, we deliberately define “legal evidence” to include only particular kinds of evidence, such as the police commissioner’s own observations on the night of April 4th. All legal evidence should ideally be rational evidence, but not the other way around. We impose special, strong, additional standards before we anoint rational evidence as “legal evidence.”
As I write this sentence at 8:33 p.m., Pacific time, on August 18th, 2007, I am wearing white socks. As a rationalist, are you licensed to believe the previous statement? Yes. Could I testify to it in court? Yes. Is it a scientific statement? No, because there is no experiment you can perform yourself to verify it. Science is made up of generalizations which apply to many particular instances, so that you can run new real-world experiments which test the generalization, and thereby verify for yourself that the generalization is true, without having to trust anyone’s authority. Science is the publicly reproducible knowledge of humankind.
Like a court system, science as a social process is made up of fallible humans. We want a protected pool of beliefs that are especially reliable. And we want social rules that encourage the generation of such knowledge. So we impose special, strong, additional standards before we canonize rational knowledge as “scientific knowledge,” adding it to the protected belief pool. Is a rationalist licensed to believe in the historical existence of Alexander the Great? Yes. We have a rough picture of ancient Greece, untrustworthy but better than maximum entropy. But we are dependent on authorities such as Plutarch; we cannot discard Plutarch and verify everything for ourselves. Historical knowledge is not scientific knowledge.
Is a rationalist licensed to believe that the Sun will rise on September 18th, 2007? Yes—not with absolute certainty, but that’s the way to bet.1 Is this statement, as I write this essay on August 18th, 2007, a scientific belief?
It may seem perverse to deny the adjective “scientific” to statements like “The Sun will rise on September 18th, 2007.” If Science could not make predictions about future events—events which have not yet happened—then it would be useless; it could make no prediction in advance of experiment. The prediction that the Sun will rise is, definitely, an extrapolation from scientific generalizations. It is based upon models of the Solar System that you could test for yourself by experiment.
But imagine that you’re constructing an experiment to verify prediction #27, in a new context, of an accepted theory Q. You may not have any concrete reason to suspect the belief is wrong; you just want to test it in a new context. It seems dangerous to say, before running the experiment, that there is a “scientific belief” about the result. There is a “conventional prediction” or “theory Q’s prediction.” But if you already know the “scientific belief” about the result, why bother to run the experiment?
You begin to see, I hope, why I identify Science with generalizations, rather than the history of any one experiment. A historical event happens once; generalizations apply over many events. History is not reproducible; scientific generalizations are.
Is my definition of “scientific knowledge” true? That is not a well-formed question. The special standards we impose upon science are pragmatic choices. Nowhere upon the stars or the mountains is it written that p < 0.05 shall be the standard for scientific publication. Many now argue that 0.05 is too weak, and that it would be useful to lower it to 0.01 or 0.001.
Perhaps future generations, acting on the theory that science is the public, reproducible knowledge of humankind, will only label as “scientific” papers published in an open-access journal. If you charge for access to the knowledge, is it part of the knowledge of humankind? Can we fully trust a result if people must pay to criticize it?
For myself, I think scientific practice would be better served by the dictum that only open, public knowledge counts. But however we choose to define “science,” information in a $20,000/year closed-access journal will still count as Bayesian evidence; and so too, the police commissioner’s private assurance that Wulky is the kingpin.
1 Pedants: interpret this as the Earth’s rotation and orbit remaining roughly constant relative to the Sun.
- Newcomb’s Problem and Regret of Rationality by Jan 31, 2008, 7:36 PM; 152 points) (
- Value of Information: Four Examples by Nov 22, 2011, 11:02 PM; 137 points) (
- What Bayesianism taught me by Aug 12, 2013, 6:59 AM; 114 points) (
- A summary of every “Highlights from the Sequences” post by Jul 15, 2022, 11:01 PM; 97 points) (
- Building Phenomenological Bridges by Dec 23, 2013, 7:57 PM; 95 points) (
- You’re Entitled to Arguments, But Not (That Particular) Proof by Feb 15, 2010, 7:58 AM; 88 points) (
- To Spread Science, Keep It Secret by Mar 28, 2008, 5:47 AM; 84 points) (
- 3 Levels of Rationality Verification by Mar 15, 2009, 5:19 PM; 84 points) (
- Faster Than Science by May 20, 2008, 12:19 AM; 77 points) (
- Bayesian Mindset by Dec 21, 2021, 7:54 PM; 73 points) (EA Forum;
- Eutopia is Scary by Jan 12, 2009, 5:28 AM; 65 points) (
- Curating “The Epistemic Sequences” (list v.0.1) by Jul 23, 2022, 10:17 PM; 65 points) (
- Commentary On “The Abolition of Man” by Jul 15, 2019, 6:56 PM; 64 points) (
- Changing Your Metaethics by Jul 27, 2008, 12:36 PM; 63 points) (
- Evidence under Adversarial Conditions by Jan 9, 2023, 4:21 PM; 57 points) (
- Many Worlds, One Best Guess by May 11, 2008, 8:32 AM; 52 points) (
- May 27, 2012, 11:11 PM; 50 points) 's comment on The rational rationalist’s guide to rationally using “rational” in rational post titles by (
- A summary of every “Highlights from the Sequences” post by Jul 15, 2022, 11:05 PM; 47 points) (EA Forum;
- Decoherence is Falsifiable and Testable by May 7, 2008, 7:54 AM; 47 points) (
- Goodhart Taxonomy: Agreement by Jul 1, 2018, 3:50 AM; 44 points) (
- Transitive Tolerance Means Intolerance by Aug 14, 2021, 5:52 PM; 39 points) (
- Is Molecular Nanotechnology “Scientific”? by Aug 20, 2007, 4:11 AM; 39 points) (
- A Suggested Reading Order for Less Wrong [2011] by Jul 8, 2011, 1:40 AM; 38 points) (
- Why Quantum? by Jun 4, 2008, 5:34 AM; 36 points) (
- Rational vs. Scientific Ev-Psych by Jan 4, 2008, 7:01 AM; 35 points) (
- Sep 10, 2012, 7:20 AM; 31 points) 's comment on How to Convince Me That 2 + 2 = 3 by (
- An unofficial “Highlights from the Sequences” tier list by Sep 5, 2022, 2:07 PM; 29 points) (
- What is the right phrase for “theoretical evidence”? by Nov 1, 2020, 8:43 PM; 24 points) (
- Dec 20, 2021, 6:02 PM; 23 points) 's comment on Law of No Evidence by (
- Help us Optimize the Contents of the Sequences eBook by Sep 19, 2013, 4:31 AM; 18 points) (
- Applying Bayesian Analysis to History (post idea) by Oct 8, 2011, 2:25 AM; 17 points) (
- Jul 28, 2012, 8:15 AM; 17 points) 's comment on Is Politics the Mindkiller? An Inconclusive Test by (
- Map and Territory: Summary and Thoughts by Dec 5, 2020, 8:21 AM; 16 points) (
- Nov 18, 2020, 10:35 PM; 16 points) 's comment on Open & Welcome Thread – November 2020 by (
- Rationality Reading Group: Part C: Noticing Confusion by Jun 18, 2015, 1:01 AM; 15 points) (
- Aug 14, 2011, 5:43 PM; 15 points) 's comment on Take heed, for it is a trap by (
- Aug 1, 2020, 10:46 PM; 13 points) 's comment on AllAmericanBreakfast’s Shortform by (
- Aug 24, 2011, 6:38 PM; 12 points) 's comment on Help Fund Lukeprog at SIAI by (
- May 14, 2021, 3:15 PM; 11 points) 's comment on Zvi’s Law of No Evidence by (
- Jan 23, 2010, 2:09 AM; 11 points) 's comment on Normal Cryonics by (
- Jan 1, 2012, 7:32 PM; 10 points) 's comment on Rationality quotes January 2012 by (
- “Life Experience” as a Conversation-Halter by Mar 18, 2010, 7:39 PM; 10 points) (
- Aug 24, 2011, 10:21 PM; 10 points) 's comment on Help Fund Lukeprog at SIAI by (
- Sep 20, 2022, 5:18 PM; 9 points) 's comment on Twitter Polls: Evidence is Evidence by (
- May 19, 2008, 5:06 AM; 9 points) 's comment on Changing the Definition of Science by (
- Why Do We Believe by Feb 17, 2023, 8:58 PM; 9 points) (
- Jun 27, 2011, 12:42 PM; 8 points) 's comment on Discussion: Yudkowsky’s actual accomplishments besides divulgation by (
- Jan 13, 2024, 12:29 AM; 7 points) 's comment on Luck based medicine: my resentful story of becoming a medical miracle by (
- [SEQ RERUN] Scientific Evidence, Legal Evidence, Rational Evidence by Jul 27, 2011, 3:05 AM; 7 points) (
- Aug 29, 2023, 6:52 AM; 6 points) 's comment on Eliezer Yudkowsky Is Frequently, Confidently, Egregiously Wrong by (EA Forum;
- Feb 15, 2021, 9:41 PM; 6 points) 's comment on Heuristic: Replace “No Evidence” with “No Reason” by (
- Aug 12, 2011, 9:29 PM; 6 points) 's comment on Anthropics Does Not Work LIke That by (
- Jul 25, 2013, 3:15 AM; 6 points) 's comment on Why Eat Less Meat? by (
- Nov 27, 2020, 6:36 PM; 6 points) 's comment on Please steelman the accusations of election fraud by (
- Asking for a name for a symptom of rationalization by Jan 7, 2023, 6:34 PM; 6 points) (
- Aug 29, 2023, 6:47 AM; 5 points) 's comment on Eliezer Yudkowsky Is Frequently, Confidently, Egregiously Wrong by (
- May 21, 2024, 6:07 PM; 4 points) 's comment on Deference for Bayesians by (EA Forum;
- Jan 14, 2011, 11:48 PM; 4 points) 's comment on Note on Terminology: “Rationality”, not “Rationalism” by (
- May 30, 2023, 1:27 AM; 4 points) 's comment on Sentience matters by (
- Oct 1, 2007, 3:36 PM; 4 points) 's comment on Rationalization by (
- Jan 23, 2010, 1:22 PM; 4 points) 's comment on Normal Cryonics by (
- May 19, 2021, 8:59 PM; 4 points) 's comment on There is no No Evidence by (
- Jan 8, 2010, 11:51 AM; 3 points) 's comment on Open Thread: January 2010 by (
- May 30, 2023, 1:36 AM; 3 points) 's comment on Sentience matters by (
- Oct 8, 2023, 5:57 AM; 3 points) 's comment on Sam Altman’s sister claims Sam sexually abused her by (
- Nov 7, 2011, 5:28 AM; 3 points) 's comment on 2011 Less Wrong Census / Survey by (
- Feb 15, 2010, 11:15 PM; 3 points) 's comment on You’re Entitled to Arguments, But Not (That Particular) Proof by (
- Oct 18, 2011, 12:33 AM; 2 points) 's comment on Open thread, October 2011 by (
- Oct 17, 2011, 2:39 PM; 2 points) 's comment on Open thread, October 2011 by (
- Mar 18, 2010, 7:31 PM; 2 points) 's comment on Open Thread: January 2010 by (
- Dec 1, 2012, 2:46 PM; 2 points) 's comment on Open Thread, December 1-15, 2012 by (
- Apr 3, 2023, 10:43 AM; 2 points) 's comment on Exposure to Lizardman is Lethal by (
- Aug 5, 2011, 12:34 PM; 2 points) 's comment on On the unpopularity of cryonics: life sucks, but at least then you die by (
- Nov 16, 2017, 11:58 PM; 2 points) 's comment on Less Wrong Lacks Representatives and Paths Forward by (
- Sep 19, 2014, 1:39 AM; 2 points) 's comment on What are your contrarian views? by (
- Dec 9, 2012, 7:03 PM; 2 points) 's comment on How to Avoid the Conflict Between Feminism and Evolutionary Psychology? by (
- Mar 14, 2013, 6:30 AM; 1 point) 's comment on Don’t Get Offended by (
- Mar 27, 2013, 6:59 AM; 1 point) 's comment on Don’t Get Offended by (
- Jul 16, 2012, 5:03 PM; 1 point) 's comment on An Intuitive Explanation of Solomonoff Induction by (
- Oct 25, 2011, 1:16 AM; 1 point) 's comment on Rationality Quotes October 2011 by (
- Jun 26, 2013, 11:27 PM; 1 point) 's comment on Open Thread, June 16-30, 2013 by (
- Meetup : West LA Meetup 07-26-2011 by Jul 22, 2011, 9:07 PM; 1 point) (
- Mar 27, 2013, 9:18 PM; 0 points) 's comment on Don’t Get Offended by (
- May 27, 2009, 7:49 PM; 0 points) 's comment on Dissenting Views by (
- Oct 7, 2013, 11:58 PM; 0 points) 's comment on The best 15 words by (
- Sep 23, 2011, 4:30 AM; 0 points) 's comment on [LINK] Cognitive Biases in Sports: The Irrationality of Coaches, Commentators and Fans by (
- Jan 10, 2010, 10:39 PM; 0 points) 's comment on The Amanda Knox Test: How an Hour on the Internet Beats a Year in the Courtroom by (
- Jan 1, 2012, 6:19 PM; 0 points) 's comment on Welcome to Less Wrong! (2012) by (
- Alice and Bob is debating on a technique. Alice says Bob should try it before denying it. Is it a fallacy or something similar? by Mar 17, 2024, 8:01 PM; 0 points) (
- May 21, 2009, 2:26 AM; 0 points) 's comment on Positive Bias Test (C++ program) by (
- Aug 29, 2023, 2:38 PM; 0 points) 's comment on Eliezer Yudkowsky Is Frequently, Confidently, Egregiously Wrong by (
- Jul 7, 2010, 8:27 AM; 0 points) 's comment on Cryonics Wants To Be Big by (
- Oct 4, 2011, 11:36 AM; 0 points) 's comment on Bayesian analysis under threat in British courts by (
- May 2, 2012, 2:31 AM; 0 points) 's comment on Request for feedback: paper on fine-tuning and the multiverse hypothesis by (
- Sep 17, 2017, 4:36 PM; 0 points) 's comment on LW 2.0 Strategic Overview by (
- Sep 25, 2015, 2:11 AM; -1 points) 's comment on The Temptation to Bubble by (
- Oct 13, 2012, 4:25 PM; -1 points) 's comment on The Fabric of Real Things by (
- Is LessWrong dead without Cox’s theorem? by Sep 4, 2021, 5:45 AM; -2 points) (
- Apr 12, 2015, 6:10 PM; -2 points) 's comment on Is my theory on why censorship is wrong correct? by (
- Oct 21, 2012, 2:50 AM; -2 points) 's comment on Stuff That Makes Stuff Happen by (
- Oct 13, 2012, 8:59 PM; -2 points) 's comment on The Fabric of Real Things by (
- Jan 29, 2012, 12:06 PM; -10 points) 's comment on HPMOR: What could’ve been done better? by (
Hmmm, well there is an endogeneity problem in that the believability of the police commissioner’s statement depends on the degree to which it constitutes legal evidence. To the extent it constitutes legal evidence, it may be less believable precisely because this give police commissioners power that they may be exercising in corrupt and power-hungry ways. A statement that cannot be seen to potentially provide some personal gain to the person making it presumably has greater credibility.
Although it is almost always the case, I can imagine legal evidence that is not necessarily scientific. The problem in my mind is precisely this bad memory of witnesses problem. I guess we have to say that an eye witness account, under oath, is “scientific.” It certain is legal evidence, although potentially challangeable by countervailing testimony or evidence. However, a scientist might be more willing to be skeptical, e.g. all those alien encounter accounts that are being discussed in other postings.
BTW, in regard to an earlier thread by Eliezer, of course “norm” does have various mathematical meanings, including the length of a vector (or multi-dimensional equivalent of “absolute value”), and there is the process of “renormalization” in algebra, which has some importance in several theories of physics. However, I remain unconvinced that any of these play an important role in establishing the earlier argument.
I’m not sure the phrase “closed access” is a fair epithet to use against mainstream scientific journals. Even if they charge $20,000/year, most scientists have access to them via their institutional library, and there aren’t many scientists who wouldn’t send you a copy of their article if you asked for it. In many fields, the articles are available on the web after they appear in the journals. And if none of those apply to a particular article, you can probably visit a university library and read it there.
I’m not trying to deny that open access would be better, but it’s not as if the scientific journals are trying to maintain a secretive cabal; they’re doing a good job of spreading information among the involved professionals. The fact that there are more people interested these days means that open access would be more valuable than before.
It’s still science, even if it’s expensive to get access to the academy.
The word “science” has a wide positive association, and it seems you want to be stingy with this word “science” and use its positive association to reward what you see as good behavior. But once people realize this is how you are trying to use the word, it may not have the effect you hope for.
Would a paper describing data on a particular supernovae not be general enough to be science by your definition? Should those papers not have appeared in astronomy journals?
Robin, I would say that the data on a particular supernova is “scientific evidence” because, as used, it’s evidence you can use to form scientific generalizations about supernovae. The process of science does require doing particular experiments. But that such-and-such supernova was observed by such-and-such telescope to do this-and-whatnot is a historical truth, not a scientific truth—you can’t verify it for yourself.
Indeed, the notion that “scientific evidence” is a deliberate social choice seems dangerous, and that’s why it’s important to pair it with the dictum that Bayesian evidence is objective and that all scientific evidence must be Bayesian evidence, i.e., it’s not all up for grabs.
But, having said this, it seems to me that the cry “That isn’t science!” has hurt more than it’s helped, historically speaking, precisely because people do think there’s an objective standard of science “out there” which their opponents are wilfully disobeying, as if science were Bayesian probability theory. So I think that it will indeed help to reframe the debate around the idea of “scientific standards” as an artificial social construct, used to achieve social ends, but still subject to the overriding mathematical constraints of Bayesian rationality.
It is better to have an explicit debate about social utility then to have a definition-fight framed as beliefs about what science really is. I am making a social-utility argument for openness as part of the rightful definition of science. I must expose this argument openly and let people criticize it, without charging them $30.
To the extent it constitutes legal evidence, it may be less believable precisely because this give police commissioners power that they may be exercising in corrupt and power-hungry ways.
You need to consider costs as well. The cost of a legal statment is much higher, in that the commissioner faces perjury charges if he utters a lie in court. But most importantly of all, is expected to back up his statement with solid evidence or a solid story of how he came to believe that X is a kingpin (both of which increase the chance of him being found out, if he is indeed lying).
This is pretty much the next frontier for Wikimedia: make proper free content licenses the normal and expected thing.
(See, that’s the power of a really good mission statement: everything you really want unpacks directly from it.)
All the kinds of knowledge you describe are subclasses of rational knowledge. Is there irrational knowledge?
According to classical philosophy (e.g. Aristotle), sense knowledge is knowledge, but knowledge of a kind which does not depend on a rational faculty. One could call that irrational, a-rational, non-rational, pre-rational, etc., depending on the how one has sliced up the phenomenology.
Believe stuff for crazy reasons (biased instincts, poor processing of data, etc). That’s irrational knowledge—even if it happens to be wrong.
I was thinking more something like ethics.
That could perhaps be called arational knowledge. The preference-like component of ethics, morals or desires which you have just because you have them.
But is it something you wish to have, should have, should keep (in this particular form)? Nothing evades the judgment.
I personally do—but it isn’t even an (absolute) human universal much less a logically necessary preference.
An agent could plausibly intrinsically value keeping all of their preferences/ethics/morals exactly as they are, in which case such an agent can be expected to believe that they should keep them. They may also instrumentally value keeping them if it helps them to achieve/live by/etc their preferences/ethics/etc. The moment they discover a better way to achieve preferences or live by ethics than by maintaining the representation in themselves the instrumental consideration no longer applies.
So? This doesn’t impact imd’s consideration at all. A rock that doesn’t evade the judgement is still a rock and arational knowledge would not cease to be arational knowledge just because it does not evade judgement.
The periodic table of elements isn’t cited in contemporary chemistry literature. ‘Self-fulfilling prophecy’ isn’t cited in psychological literature. It’s called ‘obliteration by incorporation’.
This creates a barrier to entry to science for the public. It creates a burden on people to go to universities, to cover the tacit knowledge and gaps that they don’t have in textbooks. Is any academic paper science then?
Can we fix this?
Is “how to play the piano” part of the public, reproducible pool of knowledge of humankind?
I don’t understand what the danger is. It seems just true that there is a scientific belief about the result in this case.
I can see immediately two reasons, namely because
scientific beliefs can be wrong, and
the only way to strengthened scientific beliefs is by experiments that could have falsified them.
I think it would be worth rewriting this article, because it creates a clear field for disputes about definitions. “Scientific” can have both the meaning of directly experimentally proven, and the meaning of what science allows rather than prohibits. I don’t know what word would be better to use for “included in the pool of protected knowledge of mankind”, maybe “engineer”. But this seems to me a very big minus within the framework of protected rational articles, when our language, and therefore our thinking, becomes fuzzy. Can moderators do something?