Perpetual Motion Beliefs
Yesterday’s post concluded:
To form accurate beliefs about something, you really do have to observe it. It’s a very physical, very real process: any rational mind does “work” in the thermodynamic sense, not just the sense of mental effort… So unless you can tell me which specific step in your argument violates the laws of physics by giving you true knowledge of the unseen, don’t expect me to believe that a big, elaborate clever argument can do it either.
One of the chief morals of the mathematical analogy between thermodynamics and cognition is that the constraints of probability are inescapable; probability may be a “subjective state of belief”, but the laws of probability are harder than steel.
People learn under the traditional school regimen that the teacher tells you certain things, and you must believe them and recite them back; but if a mere student suggests a belief, you do not have to obey it. They map the domain of belief onto the domain of authority, and think that a certain belief is like an order that must be obeyed, but a probabilistic belief is like a mere suggestion.
They look at a lottery ticket, and say, “But you can’t prove I won’t win, right?” Meaning: “You may have calculated a low probability of winning, but since it is a probability, it’s just a suggestion, and I am allowed to believe what I want.”
Here’s a little experiment: Smash an egg on the floor. The rule that says that the egg won’t spontaneously reform and leap back into your hand is merely probabilistic. A suggestion, if you will. The laws of thermodynamics are probabilistic, so they can’t really be laws, the way that “Thou shalt not murder” is a law… right?
So why not just ignore the suggestion? Then the egg will unscramble itself… right?
It may help to think of it this way—if you still have some lingering intuition that uncertain beliefs are not authoritative:
In reality, there may be a very small chance that the egg spontaneously reforms. But you cannot expect it to reform. You must expect it to smash. Your mandatory belief is that the egg’s probability of spontaneous reformation is ~0. Probabilities are not certainties, but the laws of probability are theorems.
If you doubt this, try dropping an egg on the floor a few decillion times, ignoring the thermodynamic suggestion and expecting it to spontaneously reassemble, and see what happens. Probabilities may be subjective states of belief, but the laws governing them are stronger by far than steel.
I once knew a fellow who was convinced that his system of wheels and gears would produce reactionless thrust, and he had an Excel spreadsheet that would prove this—which of course he couldn’t show us because he was still developing the system. In classical mechanics, violating Conservation of Momentum is provably impossible. So any Excel spreadsheet calculated according to the rules of classical mechanics must necessarily show that no reactionless thrust exists—unless your machine is complicated enough that you have made a mistake in the calculations.
And similarly, when half-trained or tenth-trained rationalists abandon their art and try to believe without evidence just this once, they often build vast edifices of justification, confusing themselves just enough to conceal the magical steps.
It can be quite a pain to nail down where the magic occurs—their structure of argument tends to morph and squirm away as you interrogate them. But there’s always some step where a tiny probability turns into a large one—where they try to believe without evidence—where they step into the unknown, thinking, “No one can prove me wrong”.
Their foot naturally lands on thin air, for there is far more thin air than ground in the realms of Possibility. Ah, but there is an (exponentially tiny) amount of ground in Possibility, and you do have an (exponentially tiny) probability of hitting it by luck, so maybe this time, your foot will land in the right place! It is merely a probability, so it must be merely a suggestion.
The exact state of a glass of boiling-hot water may be unknown to you—indeed, your ignorance of its exact state is what makes the molecules’ kinetic energy “heat”, rather than work waiting to be extracted like the momentum of a spinning flywheel. So the water might cool down your hand instead of heating it up, with probability ~0.
Decide to ignore the laws of thermodynamics and stick your hand in anyway, and you’ll get burned.
“But you don’t know that!”
I don’t know it with certainty, but it is mandatory that I expect it to happen. Probabilities are not logical truths, but the laws of probability are.
“But what if I guess the state of the boiling water, and I happen to guess correctly?”
Your chance of guessing correctly by luck, is even less than the chance of the boiling water cooling your hand by luck.
“But you can’t prove I won’t guess correctly.”
I can (indeed, must) assign extremely low probability to it.
“That’s not the same as certainty, though.”
Hey, maybe if you add enough wheels and gears to your argument, it’ll turn warm water into electricity and ice cubes! Or, rather, you will no longer see why this couldn’t be the case.
“Right! I can’t see why couldn’t be the case! So maybe it is!”
Another gear? That just makes your machine even less efficient. It wasn’t a perpetual motion machine before, and each extra gear you add makes it even less efficient than that.
Each extra detail in your argument necessarily decreases the joint probability. The probability that you’ve violated the Second Law of Thermodynamics without knowing exactly how, by guessing the exact state of boiling water without evidence, so that you can stick your finger in without getting burned, is, necessarily, even less than the probability of sticking in your finger into boiling water without getting burned.
I say all this, because people really do construct these huge edifices of argument in the course of believing without evidence. One must learn to see this as analogous to all the wheels and gears that fellow added onto his reactionless drive, until he finally collected enough complications to make a mistake in his Excel spreadsheet.
- Feature Selection by (1 Nov 2021 0:22 UTC; 319 points)
- Message Length by (20 Oct 2020 5:52 UTC; 134 points)
- Righting a Wrong Question by (9 Mar 2008 13:00 UTC; 128 points)
- Privileging the Hypothesis by (29 Sep 2009 0:40 UTC; 125 points)
- Where Recursive Justification Hits Bottom by (8 Jul 2008 10:16 UTC; 123 points)
- Zombies! Zombies? by (4 Apr 2008 9:55 UTC; 114 points)
- Zombies Redacted by (2 Jul 2016 20:16 UTC; 94 points)
- If Many-Worlds Had Come First by (10 May 2008 7:43 UTC; 89 points)
- Shell games by (19 Mar 2023 10:43 UTC; 85 points)
- GAZP vs. GLUT by (7 Apr 2008 1:51 UTC; 77 points)
- Possibility and Could-ness by (14 Jun 2008 4:38 UTC; 66 points)
- Searching for Bayes-Structure by (28 Feb 2008 22:01 UTC; 63 points)
- Many Worlds, One Best Guess by (11 May 2008 8:32 UTC; 51 points)
- Algorithmic Intent: A Hansonian Generalized Anti-Zombie Principle by (14 Jul 2020 6:03 UTC; 50 points)
- The Generalized Anti-Zombie Principle by (5 Apr 2008 23:16 UTC; 49 points)
- The So-Called Heisenberg Uncertainty Principle by (23 Apr 2008 6:36 UTC; 39 points)
- Zombie Responses by (5 Apr 2008 0:42 UTC; 31 points)
- Mirrors and Paintings by (23 Aug 2008 0:29 UTC; 29 points)
- But What’s Your *New Alignment Insight,* out of a Future-Textbook Paragraph? by (7 May 2022 3:10 UTC; 26 points)
- The Weighted Majority Algorithm by (12 Nov 2008 23:19 UTC; 23 points)
- Contaminated by Optimism by (6 Aug 2008 0:26 UTC; 22 points)
- Why No *Interesting* Unaligned Singularity? by (20 Apr 2022 0:34 UTC; 12 points)
- 's comment on The Most Important Thing You Learned by (27 Feb 2009 23:02 UTC; 11 points)
- Rationality Reading Group: Part O: Lawful Truth by (2 Dec 2015 23:30 UTC; 8 points)
- [SEQ RERUN] Perpetual Motion Beliefs by (13 Feb 2012 4:58 UTC; 8 points)
- 's comment on Welcome to Less Wrong! (2012) by (29 May 2012 6:47 UTC; 3 points)
- 's comment on Harry Potter and the Methods of Rationality discussion thread, part 11 by (24 Mar 2012 15:58 UTC; 2 points)
- 's comment on purplelight’s Shortform by (1 Feb 2022 2:33 UTC; 1 point)
- 's comment on The Mystery of the Haunted Rationalist by (2 Oct 2009 18:35 UTC; 1 point)
- 's comment on No One Knows Stuff by (12 May 2009 12:59 UTC; 1 point)
- 's comment on Religious and Rational? by (10 Feb 2016 14:58 UTC; 0 points)
there are so many beautiful things about this post. i have only a smallish idea what you are talking about a good deal of the time, but i can easily understand this: “To form accurate beliefs about something, you really do have to observe it.”
your posts here have helped solidify this for me. this is true, i feel strongly, for all great art, for reliable science, and for joy in living. observation is everything.
this sentence: “One of the chief morals of the mathematical analogy between thermodynamics and cognition is that the constraints of probability are inescapable; probability may be a “subjective state of belief”, but the laws of probability are harder than steel.”
man. this is one of those sentences i’ll be meditating on for a while. god that’s a good one. just simply as a piece of writing, that is nice work. i’m going to put it on a t-shirt or something. maybe a bumper sticker, see how many accidents i can cause on the way home...
Reading today’s fare is a bit like eating unflavored oatmeal. :-)
It seems to me that the person who can read this and understand it, already knows it.
But the person who does not know it, cannot understand it and will be frustrated by reading it.
I’m not sure what your intention is with the whole series of posts, but if you’d like to enligthen the muggles, the trick is to explain it in a concise, striking, unusual, easily understood, entertaining manner.
Of course, that takes genius. :-)
But otherwise you are writing primarily for people who already know it.
In yet other words: some of your posts, I will forward to my wife. Others, I won’t. This one is one of the latter.
Interesting stuff about the preservation of phase space volume, though. I appreciate it, I previously knew nothing about that.
I would be interested in seeing you talk about belief and probability in cases where the deck is not quite so stacked as it is in your thermodynamic examples. The principles should be the same, but I imagine your argument will be less tractable. No?
I thought this post was actually very easy to follow. It actually gave me the vocab I needed to settle scores of arguments with dumbarse religious types who say daft things like “Evolution is only a religion” and “You can’t PROVE that blah blah blah magic fairy dust blah blah blah blah”.
I love that. “I don’t know it with certainty—that’s because of your ridiculous understanding of what ‘certainty’ means—but it is mandatory that I expect it to happen.”
Cheers.
hang on—they don’t say “evolution is only a religion” they say “Evolution is only a theory”.
....dumbarse atheistic types who don’t proofread their own rantings....
Well the incarcerated* Kent Hovind did used to say that evolution is a religion. But I never heard him saying it was “just” a religion.
*HAD to include that
I have to point out that Kent Hovind is in prison for tax evasion, not for being wrong about evolution (though I’m sure he’d like you to think that!).
I’ve actually met the man, I went to a Christian school as a child and he was a guest speaker at more than one assembly. It’s only years later that I realize how ignorant and intentionally blind to the facts he is, and that his arguments rested entirely on straw men and a misunderstanding of the evidence. It slowed my understanding of science by at least five years, maybe more, and I’m more than just a little pissed about that.
It wasn’t until I saw japanese mud-skippers in a nature show a few years ago that it really clicked—one of his slams against evolution was “why don’t you see fish crawling out of the water?” Well, there you go. 100% fish, living on land—they crawl into mud periodically to breath, pretty cool really. Their front fins are even elongated and act more like fingerless arms than paddles. I wouldn’t be surprised if there were a hundred other similar species of fish out there.
When you realize that the theory of evolution has been accurately guiding biologists’ expectations for life in bizarre places, and archaeologists’ and paleontologists’ expectations for artifacts and fossils, for many decades, it becomes clear who was right and who was wrong, just as a matter of practical application. It can be hard to see this when you’ve been taught to dismiss evolution out of hand, though, and Hovind’s intellectually bankrupt arguments give you a fake foundation on which to base such dismissal, so long as you don’t question it too much.
Walking catfish—they actually just sort of slither, but they can locomote.
I would be interested in seeing you talk about belief and probability in cases where the deck is not quite so stacked as it is in your thermodynamic examples.
Okay: It’s less stacked for lottery tickets than thermodynamics, and it’s less stacked for roulette wheels than lottery tickets.
If you stick your fingers in the game anyway, it is mandatory to expect your fingers to get toasted, with not quite as extreme a probability.
The principles should be the same, but I imagine your argument will be less tractable. No?
The principles are exactly the same, and the real force of the argument is exactly unchanged. But to the unenlightened ones the argument seems to have less emotional force, and they do indeed try to ignore the laws of probability, and the expected proportion of them burn their hands.
Reading this post is like dancing on a couch, a superficial appearance of truth but true only tautologically.
Reading this post is like dancing on a couch: awesome.
What kind of couch do you have?!!
I’m guessing he’s making a Tom Cruise reference, unless it’s an expression I’ve never heard of before.
What do you think the relation between the mental category of “certainty” and probability is?
For the primitive it is not true that “the sun will rise with 100% certainty”—it is simply “certain that the sun will rise.” What’s more, I think these statements are -not equivalent-.
For the “educated westerner” it is true that “the sun will rise with certainty very close to 100%, given some assumptions about the nature of the universe in earth’s neighborhood.” Certainty is not a necessity any longer.
My claim would be that, for most, heuristic descriptions of possibility/probability and an understanding of the mathematical laws or probability are absolutely disjoint. The reason that you can even think about low probability events is not mere knowledge—you must actually switch the context in which you are framing the problem—you must “step back” and examine the lottery in the context of theory in which you (rightly) believe.
What I’m saying here is that arguing against -heuristic descriptions- with -actual probabilities- (even if just approximations) is like arguing against a shaman’s perception of the weather with modern supercomputer-driven approximations. You have to consider that people have an investment in their heuristic descriptions—to leave them would be like to leave a nice warm place which makes you happy (most of the time) but might have some nagging problems (e.g. playing the lottery).
Ya dig?
the ep. dealmaker said: “I would be interested in seeing you talk about belief and probability in cases where the deck is not quite so stacked as it is in your thermodynamic examples.”
It seems reasonable for a financial analyst to understand that the lottery and coin flipping aren’t “stacked”.
Hmm, what else could he mean...
Perhaps he means something like the weather.
New rule for the lottery: every time you play but don’t win, stick your hand in a pan of hot water!
I favor taking energy from earth rotation. Put a horizontal gyroscope across a circular track around the North Pole, and let the earth rotate under it. Take energy from the relative motion.
I suspect the real problem with the lottery is that people are familiar with the amounts of money necessary to purchase a ticket and recognize that it won’t bring them much happiness or satisfaction… but they’re not familiar with the amounts of money typically given away in a lottery jackpot, and they imagine that it will make them much, much happier than it is actually likely too.
Even people who know that the lottery has a negative expected financial value buy tickets. They’ll accept a resource loss if it leads to greater utility, and people tend to perceive the slim chance of winning lots of money to be sufficiently valuable that they’ll take an expected loss to have the chance.
The irrationality comes not from dismissing the statistical loss of money, but from believing that winning offers much greater utility than it will.
I suspect the people who suspect a real problem with the lottery have never played it.
I don’t play regularly, or at all anymore. I can actually count on one hand the number of times I have, but in all those occasions the primary joy from that was not the possibility that I might become more wealthy. It was because it was fun to engage with my peers in a group discussion of “What If.”
From what I have witnessed, this seemed to be a popular activity: the discussion of fantasy. This didn’t mean that anyone had any illusions about the possibility of winning. I can do that math.
Simply viewing it as a probability game ignores a motivation: it’s fun to dream. And it’s fun to do so together. “What would you get?” “Who would you give money to?” “Would you quit right away or give two-weeks’ notice?” and so on.
Of course, because I only bought lottery tickets with people who bought lottery tickets with me means that my sample is biased towards those who bought them with me. And that I bought lottery tickets.
Edit: Just a note that the “What If” game need not be a social activity. Obviously.
You may find a waste of hope interesting. Like taryneast suggests, everyone plays the “what if?” game- what matters is what you play it about. “What if Brad Pitt leaves Angelina Jolie for me?” is a less profitable question to think about than “What if I talk to the cute guy at the coffee shop?”. And since you only think about one or two of those questions at a time, there is a real trade-off involved with planning for the first instead of the second.
The “what if” game can be played even if you don’t buy the ticket.
What’s more, there’s another “what if” game that you’re neglecting… that’s the “what if I invest this money in something actually achievable here and now?”
This is the game that investors and entrepreneurs play, and if you actually put money into the end-result of that game you have a higher expected payoff than that with the “lottery ticket what if” game
“I favor taking energy from earth rotation. Put a horizontal gyroscope across a circular track around the North Pole, and let the earth rotate under it. Take energy from the relative motion.”
The energy to put it there will come out of your allowance.
A more practical way to take energy from the rotations of the earth-moon system is to exploit the tides...
gyroscope
That was actually a joke. Though people would be hard-pressed to guess what happens if you try it.
Gyroscopes are very unintuitive, because people intuitively but incorrectly think that pushing on something changes its position, a mistake that gyroscopes bring out.
Explain the violation to the Second Law of Thermodynamics a Concentrated Solar Panel creates during irs operation? Explain the violation to the Second Law of Thermodynamics a Geothermal vent creates during its operation?
If you can explain them then you can explain the violation to the Second Law of Thermodynamics a Concentrated Solar Generating plant has and a Geothermal generating Plant has when they use zero fuel and produce a usable energy output. if you can not then you have a demonstration that the Second Law of Thermodynamics does not state that perpetual motion is impossible. By the way the wording of the Secodn Law of Thermodynamics does not say anything about perpetual motion, nor does it state that energy can not be gained from the environment. Stop making a stupid assumption and showing yourself to be biased in that assumption. Your assumption does not follow logic.
“” Smash an egg on the floor. The rule that says that the egg won’t spontaneously reform and leap back into your hand is merely probabilistic. A suggestion, if you will. The laws of thermodynamics are probabilistic, so they can’t really be laws, the way that “Thou shalt not murder” is a law… right?”″
The instant the egg smashes energy is converted into sound and heat etc so it is IMPOSSIBLE that the egg will reform because that would be in violation with conservation of energy!prob = 0
So why not just ignore the suggestion? Then the egg will unscramble itself… right?
It may help to think of it this way—if you still have some lingering intuition that uncertain beliefs are not authoritative:
“”In reality, there may be a very small chance that the egg spontaneously reforms. “”
wrong this is actually impossible due to conservation of energy! So your point is invalid!
you do not need to observe somthing in order for it to be the truth
eg
a god exists.. percentage chance < or = 100% as the concept is not redicules and no evidence for or against a god existing exists!
It is logical that if a god did exist that he would have wisdom beyond us
thus there is no reason to believe we have to see him for him to exist
and their is no reason why his existance has to seem logical
you are the one making the assumptions if you assume we need evidence and or proof!
The example of solar panels and geothermal energy does not invalidate the second law of thermodynamics as both processes obey it. It can be experimentally proven that only a certain percentage of the heat energy in those examples is converted into electrical energy and that agrees well with the second law of thermodynamics as it is lower than the maximum predicted.
What I don’t agree with is the fact that most emphasize the so called strong form of the theorem that states that it is impossible to covert ambient thermal energy into work. While it is true that no exceptions have been found yet it is in fact not discounted by the weak version of the theorem i.e. the one that is based on statistical arguments.
Such statements causes a bias in the scientific community that could lead to any discoveries in that area to be ignored, and is as such not desirable to have, in first year physics textbooks especially. As they are based on a lack of physical proof instead of being based upon a known and accepted theoretical framework.
How do you distinguish between principles as solid as the conservation laws vs. the commonly held belief (recently established as wrong) that adults don’t have significant neuroplasticity?
Which ones seem to have stupidly huge amounts of evidence, lower complexity, deeper ties to the rest of our theories/models of reality, etc?
ie, the usual way: downgrade based on complexity (more complex assumptions = lower probability), upgrade based on huge amounts of evidence, etc.
Or do I misunderstand your question?
No, you understood me correctly.
The problem is a result of confusing consensus with knowledge.
And that’s a really easy mistake to make—it isn’t as though there’s a handy index to how much evidence there is for commonly held beliefs.
I hope there will be handy indexes once we’ve accumulated enough accurate beliefs, widely.
It doesn’t help that our most accurate beliefs (e.g. the standard model of physics) are some of the most difficult to understand, or that beliefs with lots of evidence (e.g. evolution, the age of Earth) are not widely held.
This is gold.
“The rule that says that the egg won’t spontaneously reform and leap back into your hand is merely probabilistic.”
This example requires a level of education that doesn’t match my belief of the expected audience of this post.
The low importance in the distinction between mathematical certainty and realistic likelihood is valid, but involving quantum probability kills the post for me.
The example doesn’t require quantum physics. Just ordinary classical mechanics.
My point still holds. Most people, myself included, don’t have a belief that an egg will spontaneously reform according any laws of physics. To use it as an example of the difference between certainty and likelihood is ineffective.
If it were something too open to debate, it would take away from the point.
The point is as stated. There is a non-zero probability it will happen, so you shouldn’t use “certain”, but any reasonable person will act on the belief it isn’t going to happen.
If he used religion, which is also extremely unlikely to be correct, it would distract from the point.
This looks like a valuable special case of scope insensitivity.
A time to turn off advocatus diaboli and really *be* a clever (hopefully) skeptic… One could say that there is still a difference between probabilities so high/low that you can use ~1/~0 writings and probable but not THAT probable situations such as 98:2 (there is the obvious question of threshold but please bear with me here). You suggest about the same course of actions for, say, a scientific theory of the first and the second type while I believe that the first type is to be in practice equated to the 1⁄0 and thus called (quasi-)deterministic whereas the second is probably wrong unless you can find a (quasi-)deterministic explanation for the rogue 2 (and thus change the theory) - so in that sense there is no longer place for intrinsically non-deterministic theories like quantum theory.
One may respond that some intrinsically non-deterministic theories do *work* (whether we are speaking of statistics or quantum theory) - but it is a difficult question whether that means they are true or that they are close to an (unknown) deterministic theory. Do we have actual reasons *besides* “working” to believe world is non-(quasi-)deterministic? Threshold uncertainty may be one—but then the unknown deterministic theory may derive the threshold itself so that the uncertainty is only a property of our wrong map.
I don’t think that Eliezer would disagree with this.
As I understand it, he generally argues for following the numbers and in this post he tries to bind the reader’s emotions to reality: He gives examples that make it emotionally clear that it already is in our interest to follow the numbers (‘hot water need not *necessarily* burn you, but you correctly do not count on this. Getting burned is bad’) and forces one to contrast this realisation with examples where common intuition/behaviour doesn’t follow the numbers (‘you do not *necessarily* loose money in a lottery, but you are mistaken to count on this. Loosing money is bad’).
Addendum: and besides Bell’s theorem. Every time I’m convinced by it (and it happened three times in my life, including one three days ago) an hour or a day later I notice I’m confused—confused enough to deconvince myself even though I still don’t know what is wrong.
From what I understand, the Many Worlds interpretation of quantum physics is deterministic—everything possible does happen. It only seems probabilistic from inside one of the worlds. You can’t predict the outcome of a quantum event, since different instances of you will observe all possible outcomes. Take with a grain of salt, since Many Words is unproven (possibly unprovable?) and my understanding is surface level at best.
On the macro level, a coin toss of a fair coin becomes predictable if you have perfect knowledge and enough computational power. The point of probabilities and statistics is that they give us the rules for mapmaking with imperfect knowledge and limited computational power.
In short, a deterministic universe doesn’t lead to certainty in our maps—hence “probability may be a “subjective state of belief”, but the laws of probability are harder than steel.”
A common reaction to QM is that it doesn’t matter since quantum randomness will never manifest itself at the macroscopic level—that is, in the world of sticks and stones we can see with the naked eye. An appeal is usually made to the “law of large numbers”, according to which random fluctuations at the atomic (or lower level) will cancel each other out in a macroscopic object, so that what is seen is an averaged-out behaviour that is fairly predictable.
Something like this must be happening in some cases, assuming QM is a correct description of the micro-world, or there would not even be an appearance of a deterministic macro-world. Since deterministic classical physics is partially correct, there must be a mechanism that makes the QM micro-world at least approximate to the classical description.
However, it it were the case that all macroscopic objects behaved in a 100% deterministic fashion, there would be no evidence for QM in the first place—since all scientific apparatus is in the macro-world ! A geiger-counter is able to amplify the impact of a single particle into an audible click. Richard Feynman suggested that if that wasn’t macroscopic enough, you could always amplify the signal further and use it to set off a stick of dynamite! It could be objected that these are artificial situations. However, because there is a well-known natural mechanism that could do the same job: critical dependence on initial conditions, or classical chaos.
Oops! Beautiful. Your comment described my implicit assumptions probably better than I could, before showing me the error in my thinking. I will have to try and accept the consequences of QM on a deeper level. “It all adds up to normality” is a weak consolation, if you happen to be far from the median after all. It’s also becoming blindingly obvious I should finally just sit down and read Feynman.
Huh. The universe is non-deterministic after all. Like, for real. I knew May was going way too peacefully.
Edit: Forgot to say: Thank you for that!