You can call me Witzvo. My determination of whether I’m a “rationalist” is waiting on data to be supplied by your responses. I found HPMOR hilarious and insightful (I was hooked from the first chapter which so beautifully juxtaposed a rationalist child with all-too-realistic adults), and lurked some for a while. I have one previous post which I doubt ever got read. To be critical, my general impression of the discussions here is that they are self-congratulatory, smarter than they are wise, and sometimes obsessed with philosophically meaningful but not terribly urgent debates. However, I do value the criteria by which karma is obtained. And I saw some evidence of responses being actually based on the merits of an argument presented, which is commendable. Also, Eliezer should be commended for sticking his neck out so far and so often.
I was born into a sect of Christianity that is heretical in various ways, but notably in that they believe that God is operating all for the (eventual) good of mankind, and that we will all be saved (e.g. no eternal Hell). I remain agnostic. Talk about non-falsifiability and Occam’s razor all you like, but a Bayesian doesn’t abandon the possibilities to which he assigns prior mass without evidence, and even then the posterior mass generally just drops towards 0, not all the way. Still, my life is basically secular; I don’t think there’s an important observable difference in how I live my life from how an atheist lives, and that’s pretty much the end of the matter for me. Oh, perhaps I have times of weakness, but who doesn’t?
I have formal training in statistics. I am very sympathetic to the Savage / de Finetti schools of subjective Bayesianism, but if I had to name my philosophy of science I’d call it Boxian, after George Box (c.f. http://www.jstor.org/stable/2982063; I highly recommend this paper AND the discussion. Sorry about the pay walls).
I find the Solomonoff/Kolmogorov/AIXI ideas fascinating and inspiring. I aspire to compute for example, (a computationally bounded approximation to) the normal forms of (a finite subsequence of) a countable sequence of de Bruijn lambda terms and go from there. I do not see any lurking existential crisis in doing so.
In fact, maybe I’ve missed something, but I have not yet identified an actionable issue regarding one of the much-discussed existential crises. I do not participate much in the political system of my country or even see how that would help particularly except and unless through actual rational discussion and other action.
Well, the standard response to the whole ‘agnostic’ debate is that while probability is subjective, pobability theory is theorems: You and I are only ever allowed to assign credence according to the amount of evidence available, and the God hypothesis has little, so we believe little. This gives me the mathematical right to make the prediction “the Jeudo-Christian God does not exist” and expect to see evidence accordingly. We say ~God because that is what we expect.
Other than that, welcome to less wrong. If you have time to read a book draft significantly longer than The Lord of the Rings Trilogy, written in blog posts, I reccomend reading the sequences in chronological order (use the article navigation at the bottom).
Thank you for the chronological suggestion; I think that will help it to make sense.
I would comment that the consistency theory for posteriors only guarantees convergence to “the truth” WHEN the likelihood terms are capable of making distinctions between the different possible models. If data is unavailable that distinguishes them… no convergence, just stabilization to potentially different subjective posteriors supported on the indistinguishable set. Since all we care about is making decisions, this is usually a distinction with no difference, except if there is a future event to come where they will make different predictions.
Accordingly my “God hypothesis” posterior probability has not updated in a very long time. I am, for example, not aware of what evidence there exists AT ALL with which to update this prior, but I suppose this is just because my posterior mass, conditional on the God hypothesis, came to rest, long ago, on a very non-falsifiable, (arguably science-compatible) version of belief in God. I.e. belief in a God who “operates all in accord with His will”, but who also does this exactly through the naturalistic mechanisms that we see operating all the time and not through miraculous interventions. Or, to be more precise, another indistinguishable possibility is that God is perpetrating miraculous interventions continuously, and just consistently wills to do them in exactly the way that the true but unknown “laws of nature” predict. It remains possible that God could revoke this policy at some future time: this does not require much Kolmogorov complexity. I can rule out the ordinary miraculous part of the mass (“why did it happen? Because God wanted it that special way in this special case”) because it’s not predictive. Accordingly my posterior does not give me “the mathematical right” to assert God’s non-existence.
Indeed, unless posterior mass is actually 0, I don’t think this is a matter of “mathematical rights” anyway. We’re making decisions under uncertainty, and we have some model for what the loss is if we make a mistake. You have, for example, the right to, say, not believe in God but not want to talk about it anymore, and otherwise act in accord with your belief, but I don’t see how it gives you the right to assert God’s non-existence. Sometimes we assign mass 0 to some possibilities, effectively, because we are not perfectly rational Bayesians, either we’d never thought of those possibilities, or it was computationally expedient to ignore them. In either of these cases we have no such “right”.
If I had the misfortune to have my prior “initialized” by my environment somewhere with a “vengeful God” hypothesis, who waits in Secret to test if you are really “one of the chosen” faithful, I’d be in a more difficult predicament. Hopefully, if I’d been born in such a sect, they’d have had some other clearly falsifiable beliefs that come along with the dogmatic ride, so that I’d have a way to identify the error. The worrisome part here, I notice, is that my thinking is rather driven by how it was initialized.
Well, you are certainly a lot better at Bayesian Statistics than I am. But if I am to base my “physics-defying, benevolent, superintelligent sky wizard” hypothesis on evidence such as badly written holy books that look spuriously like hodge-podge culture dumps, the general religious disagreement, the continued non-answering of prayers, failure to divine simple mathematical or physical truths, and how science is significantly more productive, well… Every time a prayer goes unanswered I can theoretically update on it for a lower credence. Every conflicting holy scripture allegedly bequeathed by the divine, claiming to be the one truth is a major hit.
Meanwhile the hypothesis that what most people call religious experiences is located in the temporal lobe gains credence from every cognitive neuro-scientific study of it.
If you haven’t updated your credence of immortal physics defying super-intelligent friendly sky wizards in a while, I am going to tell you to look harder. The evidence is there. From what you state it seems that you might suffer from motivated cognition and belief hysteresis, so take this opportunity to get a feel on those so you might recognize them in the future.
Now, for the hypothesis of “immortal physics-defying wizard doing whatever makes the world seem normal” is strictly dominated by the hypothesis of “whatever makes the world seem normal”. That is Minimum Message Length/Solomonoff Induction right there.
But given that you already have Bayes down to a science, I don’t see why you should become a fine Lesswrongian in just a short time. Welcome to lesswrong.
It’s a straw dummy to say that I haven’t updated my priors about insert ridiculous thing here. Those are not the things I described having residual posterior mass on; my “sky wizard” is currently content to play by very different rules. As for the epi-phenomena of how a society embraces religion, or does not, I agree, this does suggest that it would be foolish to base one’s beliefs SOLELY on the “evidence” of the crowd as you grow up.
Also, incidentally, MML/Kolmogorov complexity and Solomonoff are not the same here. The former do not give a posterior on models, they select one model. The later could and would easily put posterior mass on multiple programs that were observationally the same up to the amount of data we have currently observed.
Consider the sequence of numbers: 1,2,3.
MML would (for most Turing machines anyway) select the program: next=old+1.
Solomonoff would have posterior mass on many other sequences (e.g. do a query on http://oeis.org/). It’d put most of it’s mass on that program, but leave nonzero mass on other programs, like one that computes this sequence, say: http://oeis.org/A006530, and if the next numbers reveals the sequence:
1, 2, 3, 2, 5, 3, 7, 2, 3, 5
Then you can bet that’s where a lot of the mass will shift.
… And the really subtle bit, that I don’t want you to miss, is that it doesn’t all shift there, it’s still not a point posterior. There’s still mass on:
That mass won’t go away for a LONG time (that is if the data keeps coming from http://oeis.org/A006530 for at least Googol/2 steps.
And there are many possibilities like this out there. Sure, they have less mass individually, but there ARE many of them. And some don’t even have appreciably less prior mass (under a Solomonoff prior and a “reasonable” Turing machine). Computability is a whole ’nother issue.
Hee! I sort of like the idea of immortal physics defying super-intelligent friendly sky wizards, actually. ”Hamlet, in love with the old man’s daughter, the old… man… thinks.”
Accordingly my “God hypothesis” posterior probability has not updated in a very long time. I am, for example, not aware of what evidence there exists AT ALL with which to update this prior, but I suppose this is just because my posterior mass, conditional on the God hypothesis, came to rest, long ago, on a very non-falsifiable, (arguably science-compatible) version of belief in God. I.e. belief in a God who “operates all in accord with His will”, but who also does this exactly through the naturalistic mechanisms that we see operating all the time and not through miraculous interventions. Or, to be more precise, another indistinguishable possibility is that God is perpetrating miraculous interventions continuously, and just consistently wills to do them in exactly the way that the true but unknown “laws of nature” predict. It remains possible that God could revoke this policy at some future time: this does not require much Kolmogorov complexity.
What evidence was there in the first place to promote to your attention the hypothesis of a naturalistic god over no god at all? If you don’t have any particular evidence that favors a naturalistic god over no god, surely the hypothesis of no god requires less complexity.
A Bayesian might never abandon possibilities to which he or she assigns prior mass without new evidence, but in addition to evidence that shifts the posterior, one can also revise a belief on information that suggests that an inappropriate prior was assigned to begin with.
Well, I was raised on it. If one day your Mom says, “don’t touch the stove, it’ll hurt”, and voila she’s right, you start to think maybe you ought to pay attention to what they’re telling you some times, including when they talk about “God.” Theres no way to distinguish one form of advice from the other until you get more experience. On this basis many things are acquired by making inferences based on the actions of people around us as we are growing up. “Everyone is wearing pants. Hmm. I guess I should too” is a pretty good heuristic Bayesian argument for many things, and keeps us out of trouble in unfamiliar experiences more often than not [cite some darwin page on here].
If I hadn’t been raised that way, probably nothing would have promoted it to my attention.
Knowing more about the processes that actually gave rise to your parents’ pronouncements on religion, do you think you were right to assign as much weight of evidence to them as you originally did?
Ah. Well, you’ve got me there. I’ll think about it. Your comment makes me think, though, about a more general issue. Is there a name for a bias that can happen if you think about an issue multiple times and get more and more convinced by, what actually, is essentially only one piece of evidence?
Carl Sagan described himself as agnostic, and it’s a rational position to hold. As Sagan said:
“An atheist is someone who is certain that God does not exist, someone who has compelling evidence against the existence of God. I know of no such compelling evidence. Because God can be relegated to remote times and places and to ultimate causes, we would have to know a great deal more about the universe than we do now to be sure that no such God exists. To be certain of the existence of God and to be certain of the nonexistence of God seem to me to be the confident extremes in a subject so riddled with doubt and uncertainty as to inspire very little confidence indeed”.
However, I personally attach zero likelihood to anything like the Christian, Muslim, Jewish or Hindu god or gods existing. Technically I might be an agnostic, but I think “atheist” represents my outlook and belief system better. Then again, “a-theism” is defined in terms of what it doesn’t believe. I prefer to minimize talking about atheism, and talk about what I do believe in—science, rationality and a naturalistic worldview.
0 and 1 are not probabilities anyway, so refusing to call someone an atheist (or a theist) because they assign a non-zero (or ‘non-one’) probability to a god existing seems pointless to me, because then hardly anyone would count as atheist (or a theist). (It’s also a fallacy of gray, because assigning 0.1% probability to a god existing is not the same as assigning 99.9% probability to that.)
This kind of comment completely throws me off. I will have to read Eliezer’s arguments more carefully to see the meaning of these things further, but “0 and 1 are not probabilities”? What?! Under what mathematical model for Bayesianism is this true? I read “it’s more convenient to use odds when you’re doing Bayesian updates” and some discussion of the logistic transformation, some reasonable comments about finite changes under updating, and that MAYBE we should try to formulate a probability theory without 0 and 1, (resp. -inf, inf) to the title’s apparent claim: “0 and 1 are not probabilities”. Talk about a confusing non-sequitur. Same thing with the fallacy of gray. What? Eliezier rejects P(not A)=1-P(A) too?? I haven’t read that yet but whatever form of Bayesianism he ascribes too, it’s not a standard one mathematically.
EDIT: nevermind about the gray. I misread it. gray is just ignoring the difference between different probabilities., This applies to the word “agnostic” (i.e. are you a high agnostic or a low agnostic) but, then, nobody forced me to declare my probability numerically. I was just introducing where I fit in the usual spectrum. P({ of possibilities in which there is a God} | life)>1/100.
EDIT2: Thanks for the “gray” post. I liked this best: “If you say, “No one is perfect, but some people are less imperfect than others,” you may not gain applause; but for those who strive to do better, you have held out hope. No one is perfectly imperfect, after all.”
EDIT3: deleted a nonsense remark.
You can call me Witzvo. My determination of whether I’m a “rationalist” is waiting on data to be supplied by your responses. I found HPMOR hilarious and insightful (I was hooked from the first chapter which so beautifully juxtaposed a rationalist child with all-too-realistic adults), and lurked some for a while. I have one previous post which I doubt ever got read. To be critical, my general impression of the discussions here is that they are self-congratulatory, smarter than they are wise, and sometimes obsessed with philosophically meaningful but not terribly urgent debates. However, I do value the criteria by which karma is obtained. And I saw some evidence of responses being actually based on the merits of an argument presented, which is commendable. Also, Eliezer should be commended for sticking his neck out so far and so often.
I was born into a sect of Christianity that is heretical in various ways, but notably in that they believe that God is operating all for the (eventual) good of mankind, and that we will all be saved (e.g. no eternal Hell). I remain agnostic. Talk about non-falsifiability and Occam’s razor all you like, but a Bayesian doesn’t abandon the possibilities to which he assigns prior mass without evidence, and even then the posterior mass generally just drops towards 0, not all the way. Still, my life is basically secular; I don’t think there’s an important observable difference in how I live my life from how an atheist lives, and that’s pretty much the end of the matter for me. Oh, perhaps I have times of weakness, but who doesn’t?
I have formal training in statistics. I am very sympathetic to the Savage / de Finetti schools of subjective Bayesianism, but if I had to name my philosophy of science I’d call it Boxian, after George Box (c.f. http://www.jstor.org/stable/2982063; I highly recommend this paper AND the discussion. Sorry about the pay walls).
I find the Solomonoff/Kolmogorov/AIXI ideas fascinating and inspiring. I aspire to compute for example, (a computationally bounded approximation to) the normal forms of (a finite subsequence of) a countable sequence of de Bruijn lambda terms and go from there. I do not see any lurking existential crisis in doing so.
In fact, maybe I’ve missed something, but I have not yet identified an actionable issue regarding one of the much-discussed existential crises. I do not participate much in the political system of my country or even see how that would help particularly except and unless through actual rational discussion and other action.
I find far more profit in exploring ideas, such as say, Inventing on Principle (http://vimeo.com/36579366), or Incremental Learning in Inductive Programming (http://www.cogsys.wiai.uni-bamberg.de/aaip09/aaip09_submissions/incremental.pdf), either of which I would be happy to discuss.
I am also intellectually lonely.
That’s probably more than enough. Go on and tell me something less wrong.
Well, the standard response to the whole ‘agnostic’ debate is that while probability is subjective, pobability theory is theorems: You and I are only ever allowed to assign credence according to the amount of evidence available, and the God hypothesis has little, so we believe little. This gives me the mathematical right to make the prediction “the Jeudo-Christian God does not exist” and expect to see evidence accordingly. We say ~God because that is what we expect.
Other than that, welcome to less wrong. If you have time to read a book draft significantly longer than The Lord of the Rings Trilogy, written in blog posts, I reccomend reading the sequences in chronological order (use the article navigation at the bottom).
Thank you for the chronological suggestion; I think that will help it to make sense.
I would comment that the consistency theory for posteriors only guarantees convergence to “the truth” WHEN the likelihood terms are capable of making distinctions between the different possible models. If data is unavailable that distinguishes them… no convergence, just stabilization to potentially different subjective posteriors supported on the indistinguishable set. Since all we care about is making decisions, this is usually a distinction with no difference, except if there is a future event to come where they will make different predictions.
Accordingly my “God hypothesis” posterior probability has not updated in a very long time. I am, for example, not aware of what evidence there exists AT ALL with which to update this prior, but I suppose this is just because my posterior mass, conditional on the God hypothesis, came to rest, long ago, on a very non-falsifiable, (arguably science-compatible) version of belief in God. I.e. belief in a God who “operates all in accord with His will”, but who also does this exactly through the naturalistic mechanisms that we see operating all the time and not through miraculous interventions. Or, to be more precise, another indistinguishable possibility is that God is perpetrating miraculous interventions continuously, and just consistently wills to do them in exactly the way that the true but unknown “laws of nature” predict. It remains possible that God could revoke this policy at some future time: this does not require much Kolmogorov complexity. I can rule out the ordinary miraculous part of the mass (“why did it happen? Because God wanted it that special way in this special case”) because it’s not predictive. Accordingly my posterior does not give me “the mathematical right” to assert God’s non-existence.
Indeed, unless posterior mass is actually 0, I don’t think this is a matter of “mathematical rights” anyway. We’re making decisions under uncertainty, and we have some model for what the loss is if we make a mistake. You have, for example, the right to, say, not believe in God but not want to talk about it anymore, and otherwise act in accord with your belief, but I don’t see how it gives you the right to assert God’s non-existence. Sometimes we assign mass 0 to some possibilities, effectively, because we are not perfectly rational Bayesians, either we’d never thought of those possibilities, or it was computationally expedient to ignore them. In either of these cases we have no such “right”.
If I had the misfortune to have my prior “initialized” by my environment somewhere with a “vengeful God” hypothesis, who waits in Secret to test if you are really “one of the chosen” faithful, I’d be in a more difficult predicament. Hopefully, if I’d been born in such a sect, they’d have had some other clearly falsifiable beliefs that come along with the dogmatic ride, so that I’d have a way to identify the error. The worrisome part here, I notice, is that my thinking is rather driven by how it was initialized.
Well, you are certainly a lot better at Bayesian Statistics than I am. But if I am to base my “physics-defying, benevolent, superintelligent sky wizard” hypothesis on evidence such as badly written holy books that look spuriously like hodge-podge culture dumps, the general religious disagreement, the continued non-answering of prayers, failure to divine simple mathematical or physical truths, and how science is significantly more productive, well… Every time a prayer goes unanswered I can theoretically update on it for a lower credence. Every conflicting holy scripture allegedly bequeathed by the divine, claiming to be the one truth is a major hit.
Meanwhile the hypothesis that what most people call religious experiences is located in the temporal lobe gains credence from every cognitive neuro-scientific study of it.
If you haven’t updated your credence of immortal physics defying super-intelligent friendly sky wizards in a while, I am going to tell you to look harder. The evidence is there. From what you state it seems that you might suffer from motivated cognition and belief hysteresis, so take this opportunity to get a feel on those so you might recognize them in the future.
Now, for the hypothesis of “immortal physics-defying wizard doing whatever makes the world seem normal” is strictly dominated by the hypothesis of “whatever makes the world seem normal”. That is Minimum Message Length/Solomonoff Induction right there.
But given that you already have Bayes down to a science, I don’t see why you should become a fine Lesswrongian in just a short time. Welcome to lesswrong.
Thanks for mentioning belief hysteresis.
It’s a straw dummy to say that I haven’t updated my priors about insert ridiculous thing here. Those are not the things I described having residual posterior mass on; my “sky wizard” is currently content to play by very different rules. As for the epi-phenomena of how a society embraces religion, or does not, I agree, this does suggest that it would be foolish to base one’s beliefs SOLELY on the “evidence” of the crowd as you grow up.
Also, incidentally, MML/Kolmogorov complexity and Solomonoff are not the same here. The former do not give a posterior on models, they select one model. The later could and would easily put posterior mass on multiple programs that were observationally the same up to the amount of data we have currently observed.
Consider the sequence of numbers: 1,2,3. MML would (for most Turing machines anyway) select the program: next=old+1. Solomonoff would have posterior mass on many other sequences (e.g. do a query on http://oeis.org/). It’d put most of it’s mass on that program, but leave nonzero mass on other programs, like one that computes this sequence, say: http://oeis.org/A006530, and if the next numbers reveals the sequence: 1, 2, 3, 2, 5, 3, 7, 2, 3, 5 Then you can bet that’s where a lot of the mass will shift.
… And the really subtle bit, that I don’t want you to miss, is that it doesn’t all shift there, it’s still not a point posterior. There’s still mass on:
Use http://oeis.org/A006530 for the first Googol entries, and then, all zeros.
That mass won’t go away for a LONG time (that is if the data keeps coming from http://oeis.org/A006530 for at least Googol/2 steps.
And there are many possibilities like this out there. Sure, they have less mass individually, but there ARE many of them. And some don’t even have appreciably less prior mass (under a Solomonoff prior and a “reasonable” Turing machine). Computability is a whole ’nother issue.
If I understand what you mean, put a hyphen between “physics” and “defying”, because I had mis-parsed that the first time.
Hee!
I sort of like the idea of immortal physics defying super-intelligent friendly sky wizards, actually.
”Hamlet, in love with the old man’s daughter, the old… man… thinks.”
What evidence was there in the first place to promote to your attention the hypothesis of a naturalistic god over no god at all? If you don’t have any particular evidence that favors a naturalistic god over no god, surely the hypothesis of no god requires less complexity.
A Bayesian might never abandon possibilities to which he or she assigns prior mass without new evidence, but in addition to evidence that shifts the posterior, one can also revise a belief on information that suggests that an inappropriate prior was assigned to begin with.
Well, I was raised on it. If one day your Mom says, “don’t touch the stove, it’ll hurt”, and voila she’s right, you start to think maybe you ought to pay attention to what they’re telling you some times, including when they talk about “God.” Theres no way to distinguish one form of advice from the other until you get more experience. On this basis many things are acquired by making inferences based on the actions of people around us as we are growing up. “Everyone is wearing pants. Hmm. I guess I should too” is a pretty good heuristic Bayesian argument for many things, and keeps us out of trouble in unfamiliar experiences more often than not [cite some darwin page on here].
If I hadn’t been raised that way, probably nothing would have promoted it to my attention.
Knowing more about the processes that actually gave rise to your parents’ pronouncements on religion, do you think you were right to assign as much weight of evidence to them as you originally did?
Ah. Well, you’ve got me there. I’ll think about it. Your comment makes me think, though, about a more general issue. Is there a name for a bias that can happen if you think about an issue multiple times and get more and more convinced by, what actually, is essentially only one piece of evidence?
Well, there are various ways to double-count evidence, but that sounds a lot like the idea discussed in this post.
Thanks.
Carl Sagan described himself as agnostic, and it’s a rational position to hold. As Sagan said:
“An atheist is someone who is certain that God does not exist, someone who has compelling evidence against the existence of God. I know of no such compelling evidence. Because God can be relegated to remote times and places and to ultimate causes, we would have to know a great deal more about the universe than we do now to be sure that no such God exists. To be certain of the existence of God and to be certain of the nonexistence of God seem to me to be the confident extremes in a subject so riddled with doubt and uncertainty as to inspire very little confidence indeed”.
However, I personally attach zero likelihood to anything like the Christian, Muslim, Jewish or Hindu god or gods existing. Technically I might be an agnostic, but I think “atheist” represents my outlook and belief system better. Then again, “a-theism” is defined in terms of what it doesn’t believe. I prefer to minimize talking about atheism, and talk about what I do believe in—science, rationality and a naturalistic worldview.
0 and 1 are not probabilities anyway, so refusing to call someone an atheist (or a theist) because they assign a non-zero (or ‘non-one’) probability to a god existing seems pointless to me, because then hardly anyone would count as atheist (or a theist). (It’s also a fallacy of gray, because assigning 0.1% probability to a god existing is not the same as assigning 99.9% probability to that.)
This kind of comment completely throws me off. I will have to read Eliezer’s arguments more carefully to see the meaning of these things further, but “0 and 1 are not probabilities”? What?! Under what mathematical model for Bayesianism is this true? I read “it’s more convenient to use odds when you’re doing Bayesian updates” and some discussion of the logistic transformation, some reasonable comments about finite changes under updating, and that MAYBE we should try to formulate a probability theory without 0 and 1, (resp. -inf, inf) to the title’s apparent claim: “0 and 1 are not probabilities”. Talk about a confusing non-sequitur. Same thing with the fallacy of gray. What? Eliezier rejects P(not A)=1-P(A) too?? I haven’t read that yet but whatever form of Bayesianism he ascribes too, it’s not a standard one mathematically.
EDIT: nevermind about the gray. I misread it. gray is just ignoring the difference between different probabilities., This applies to the word “agnostic” (i.e. are you a high agnostic or a low agnostic) but, then, nobody forced me to declare my probability numerically. I was just introducing where I fit in the usual spectrum. P({ of possibilities in which there is a God} | life)>1/100. EDIT2: Thanks for the “gray” post. I liked this best: “If you say, “No one is perfect, but some people are less imperfect than others,” you may not gain applause; but for those who strive to do better, you have held out hope. No one is perfectly imperfect, after all.” EDIT3: deleted a nonsense remark.