Related: rationality includes using Occam’s Razor. Exactly which Razor we employ is in part determined empirically. If properties of your implied Razor are at odds with properties of empirically derived Razors, that may indicate a lack of rationality.
Metaphysical beliefs are still subject to the Razor. Right?
seconding timtyler and guysrinivasan—I think, but can’t prove, that you need an induction principle to reach the anti-religion conclusion. See especially Occam’s Razor and Inductive Bias. If someone wants to bullet point the reasons to accept an induction principle, that would be useful. Maybe I’ll take a stab later. It ties into Solomonoff induction among other things.
EDIT—I’ve put some bullet points below which state the case for induction to the best of my knowledge.
Finite agents have to accept an “inductive-ish” principle, because they can’t even process the infinitely many consistent theories which are longer than the number of computations they have in which to compute, and therefore they can’t even directly consider most of the long theories. Zooming out and viewing from the macro, this is extremely inductive-ish, though it doesn’t decide between two fairly short theories, like Christianity versus string theory.
Probabilities over all your hypotheses have to add to 1, and getting an extra bit of info allows you to rule out approximately half of the remaining consistent theories; therefore, your probability of a theory one bit longer being true ought to drop by that ratio. If your language is binary, this has the nice property that you can assign a 1-length hypothesis a probability of 1⁄2, a 2-length hypothesis a probability of 1⁄4, … an n -length hypothesis a probability of 1/(2^n)...and you notice that 1/2+1/4+1/8 + … + ~= 1. So the scheme fits pretty naturally.
Under various assumptions, an agent does only a constant factor worse using this induction assumption versus any other method, making this seem not only less than arbitrary, but arguably, “universal”.
Ultimately, we could be wrong and our universe may not actually obey the Occam Prior. It appears we don’t and can’t even in principle have a complete response to religionists who are using solipsistic arguments. For example, there could be a demon making these bullet points seem reasonable to your brain, while they are in fact entirely untrue. However, this does not appear to be a good reason not to use Occam’s razor.
Related to (2)--you can’t assign equal probability greater than 0 to each of the infinite number of theories consistent with your data, and still have your sums converge to 1 (because for any rational number R > 0, the sum of an infinite number of R’s will diverge). So, you have to discount some hypotheses relative to others, and induction looks to be the simplest way to do this (One could say of the previous sentence, “meta-occam’s razor supports occam’s razor”). The burden of proof is on the religionist to propose a plausible alternative mapping, since the Occam mapping appears to satisy the fairly stringent desiderata.
Further to (5), notice that to get the probability sum to converge to 1, and also to assign each of the infinite consistent hypotheses a probability greater than 0, most hypotheses need to have smaller probability than any fixed rational number. In fact, you need more than that, you actually need the probabilities to drop pretty fast, since 1⁄2 + 1⁄3 + 1⁄4 + …. + does not converge. On the other hand, you COULD have certain instances where you switch two theories around in their probability assignments (for example, you could arbitrarily say Christianity was more likely than string theory, even though Christianity is a longer theory), but for most of the theories, with increasing length you MUST drop your probability down towards 0 relatively fast to maintain the desiderata at all. To switch these probabilities only for particular theories you care about, while you also need and want to use the theory on other problems (including normal “common sense” intuitions, which are very well-explained by this framework), and you ALSO need to use it generally on this problem except for a few counter-examples you explicitly hard-code, seems incredibly contrived. You’re better off just to go with occam’s razor, unless some better alternative can be proposed.
I agree up to the first half of step 6, but I think the conclusion is wrong (or at least not justified from the argument). There are two different principles involved here:
A finite agent must use an “inductive-ish” prior with a finite complexity
One should use the simplest prior. (Occam’s Razor)
If every finite agent must use an “inductive-ish” prior, then there is no need to invoke or appeal to Occam’s Razor to explain or justify our own inductive tendencies, so Rob’s argument actually undercuts Occam’s Razor.
If we replace Occam’s Razor with the principle that every finite agent must use a prior with finite complexity, then one’s prior is just whatever it is, and not necessarily the simplest prior. There is no longer an argument against someone who says their prior assigns a greater weight to Christianity than to string theory. (In the second half of step 6, Rob says that’s “contrived”, but they could always answer “so what?”)
The anti-religion conclusion in my post was just an application of the definitions given for religion and rational.
Are you saying that you would modify the first definition of rational to include these other ways of knowing (Occam’s Razor and Inductive Bias), and that they can make conclusions about metaphysical things?
Oh, I see, these would be included under “logical reasoning”. The part I would modify is (1) whether some metaphysical beliefs are acceptable and (2) that they can be constrained by logical reasoning.
Are you saying that you would modify the first definition of rational to include these >> other ways of knowing (Occam’s Razor and Inductive Bias), and that they can
make conclusions about metaphysical things?
yes, I don’t think you can get far at all without an induction principle. We could make a meta-model of ourselves and our situation and prove we need induction in that model, if it helps people, but I think most people have the intuition already that nothing observational can be proven “absolutely”, that there are an infinite number of ways to draw curved lines connecting two points, etc. Basically, one needs induction to move beyond skeptical arguments and do anything here. We’re using induction implicitly in all or most of our applied reasoning, I think.
So: does induction come under “valid logical reasoning” or “mathematics”?
Related: rationality includes using Occam’s Razor. Exactly which Razor we employ is in part determined empirically. If properties of your implied Razor are at odds with properties of empirically derived Razors, that may indicate a lack of rationality.
Metaphysical beliefs are still subject to the Razor. Right?
seconding timtyler and guysrinivasan—I think, but can’t prove, that you need an induction principle to reach the anti-religion conclusion. See especially Occam’s Razor and Inductive Bias. If someone wants to bullet point the reasons to accept an induction principle, that would be useful. Maybe I’ll take a stab later. It ties into Solomonoff induction among other things.
EDIT—I’ve put some bullet points below which state the case for induction to the best of my knowledge.
Why to accept an inductive principle:
Finite agents have to accept an “inductive-ish” principle, because they can’t even process the infinitely many consistent theories which are longer than the number of computations they have in which to compute, and therefore they can’t even directly consider most of the long theories. Zooming out and viewing from the macro, this is extremely inductive-ish, though it doesn’t decide between two fairly short theories, like Christianity versus string theory.
Probabilities over all your hypotheses have to add to 1, and getting an extra bit of info allows you to rule out approximately half of the remaining consistent theories; therefore, your probability of a theory one bit longer being true ought to drop by that ratio. If your language is binary, this has the nice property that you can assign a 1-length hypothesis a probability of 1⁄2, a 2-length hypothesis a probability of 1⁄4, … an n -length hypothesis a probability of 1/(2^n)...and you notice that 1/2+1/4+1/8 + … + ~= 1. So the scheme fits pretty naturally.
Under various assumptions, an agent does only a constant factor worse using this induction assumption versus any other method, making this seem not only less than arbitrary, but arguably, “universal”.
Ultimately, we could be wrong and our universe may not actually obey the Occam Prior. It appears we don’t and can’t even in principle have a complete response to religionists who are using solipsistic arguments. For example, there could be a demon making these bullet points seem reasonable to your brain, while they are in fact entirely untrue. However, this does not appear to be a good reason not to use Occam’s razor.
Related to (2)--you can’t assign equal probability greater than 0 to each of the infinite number of theories consistent with your data, and still have your sums converge to 1 (because for any rational number R > 0, the sum of an infinite number of R’s will diverge). So, you have to discount some hypotheses relative to others, and induction looks to be the simplest way to do this (One could say of the previous sentence, “meta-occam’s razor supports occam’s razor”). The burden of proof is on the religionist to propose a plausible alternative mapping, since the Occam mapping appears to satisy the fairly stringent desiderata.
Further to (5), notice that to get the probability sum to converge to 1, and also to assign each of the infinite consistent hypotheses a probability greater than 0, most hypotheses need to have smaller probability than any fixed rational number. In fact, you need more than that, you actually need the probabilities to drop pretty fast, since 1⁄2 + 1⁄3 + 1⁄4 + …. + does not converge. On the other hand, you COULD have certain instances where you switch two theories around in their probability assignments (for example, you could arbitrarily say Christianity was more likely than string theory, even though Christianity is a longer theory), but for most of the theories, with increasing length you MUST drop your probability down towards 0 relatively fast to maintain the desiderata at all. To switch these probabilities only for particular theories you care about, while you also need and want to use the theory on other problems (including normal “common sense” intuitions, which are very well-explained by this framework), and you ALSO need to use it generally on this problem except for a few counter-examples you explicitly hard-code, seems incredibly contrived. You’re better off just to go with occam’s razor, unless some better alternative can be proposed.
Rob Zahra
I agree up to the first half of step 6, but I think the conclusion is wrong (or at least not justified from the argument). There are two different principles involved here:
A finite agent must use an “inductive-ish” prior with a finite complexity
One should use the simplest prior. (Occam’s Razor)
If every finite agent must use an “inductive-ish” prior, then there is no need to invoke or appeal to Occam’s Razor to explain or justify our own inductive tendencies, so Rob’s argument actually undercuts Occam’s Razor.
If we replace Occam’s Razor with the principle that every finite agent must use a prior with finite complexity, then one’s prior is just whatever it is, and not necessarily the simplest prior. There is no longer an argument against someone who says their prior assigns a greater weight to Christianity than to string theory. (In the second half of step 6, Rob says that’s “contrived”, but they could always answer “so what?”)
Rob, just make it a post.
The anti-religion conclusion in my post was just an application of the definitions given for religion and rational.
Are you saying that you would modify the first definition of rational to include these other ways of knowing (Occam’s Razor and Inductive Bias), and that they can make conclusions about metaphysical things?
Oh, I see, these would be included under “logical reasoning”. The part I would modify is (1) whether some metaphysical beliefs are acceptable and (2) that they can be constrained by logical reasoning.
yes, I don’t think you can get far at all without an induction principle. We could make a meta-model of ourselves and our situation and prove we need induction in that model, if it helps people, but I think most people have the intuition already that nothing observational can be proven “absolutely”, that there are an infinite number of ways to draw curved lines connecting two points, etc. Basically, one needs induction to move beyond skeptical arguments and do anything here. We’re using induction implicitly in all or most of our applied reasoning, I think.