I enjoyed this post. I think the dialogue in particular nicely highlights how underdetermined the phrase ‘becoming more Bayesian’ is, and that we need more research on what optimal reasoning in more computationally realistic environments would look like.
However, I think there are other (not explicitly stated) ways I think Bayesianism is helpful for actual human reasoners. I’ll list two:
I think the ingredients you get from Bayes’ theorem offer a helpful way of making more precise what updating should look like. Almost everyone will agree that we should take into account new evidence, but I think explicitly bearing in mind ‘okay, what’s the prior?‘, and ‘how likely is the evidence given the hypothesis?’, offers a helpful framework which allows us to update on new evidence in a way that’s more likely to make us calibrated.
Moreover, even thinking in terms of degrees of belief as subjective probabilities at all (and not just how to update them) is a pretty novel conceptual insight. I’ve spent plenty of time speaking to people with advanced degrees in philosophy, many of whom think by default in terms of disbelief/full belief, and don’t have a conception of anything like the framework of subjective probabilities.
Perhaps you agree with what I said above. But I think such points are worth stating explicitly, given that I think they’re pretty unfamiliar to most people, and constitute ways in which the Bayesian framework has generated novel insights about good epistemic behaviour.
Thanks for the comment :) I agree with your second point, and alluded to it by having Bob mention the importance of considering degrees of belief as probabilities. Perhaps I should make this point more strongly, but at the same time, it’s definitely not something that’s unique to bayesianism, and you could advocate for it on its own merits. I guess the historical context is relevant: were the original people who advocated for thinking of degrees of belief in probabilistic terms bayesians? I don’t know enough to answer that question.
I disagree with your first point. I think the basic framework—what did I use to believe, what have I learned, how have I changed my mind—is exactly that: basic. It doesn’t need to be justified in terms of Bayes, it was around far before that. Insofar as Bayes makes it more precise, it also makes it more inapplicable, because people adopt the parts of “precise Bayesian updates” that they agree with, but not all the others which I mention in the dialogue.
Maybe the qualitative components of Bayes’ theorem are, in some sense, pretty basic. If I think about how I would teach the basic qualitative concepts encoded by Bayes’ theorem (which we both agree are useful), I can’t think of a better way than through directly teaching Bayes’ theorem. That is the sense in which I think Bayes’ theorem offers a helpful precisification of these more qualitative concepts: it imposes a useful pedagogical structure into which we can neatly fit such principles.
You claim that the increased precision afforded by Bayesianism means that people end up ignoring the bits that don’t apply to us, so Bayesianism doesn’t really help us out much. I agree that, insofar as we use the formal Bayesian framework, we are ignoring certain bits. But I think that, by highlighting which bits do not apply to us, we gain a better understanding of why certain parts of our reasoning may be good or bad. For example, it forces us to confront why we think making predictions is good (as Bob points out, it allows us to avoid post-hoc rationalisation). This, I think, usefully steers our attention towards more pragmatic questions concerning the role that prediction plays in our epistemic lives, and away from more metaphysical questions about (for example) the real grounds for thinking prediction is an Epistemic Virtue.
So I think we might disagree on the empirical claim of how well we can teach such concepts without reliance on anything like Bayesianism. Perhaps we also have differing answers to the question: ‘does engaging with the formal Bayesian framework usefully draw our attention towards parts of our epistemic lives that matter?’ Does that sound right to you?
I enjoyed this post. I think the dialogue in particular nicely highlights how underdetermined the phrase ‘becoming more Bayesian’ is, and that we need more research on what optimal reasoning in more computationally realistic environments would look like.
However, I think there are other (not explicitly stated) ways I think Bayesianism is helpful for actual human reasoners. I’ll list two:
I think the ingredients you get from Bayes’ theorem offer a helpful way of making more precise what updating should look like. Almost everyone will agree that we should take into account new evidence, but I think explicitly bearing in mind ‘okay, what’s the prior?‘, and ‘how likely is the evidence given the hypothesis?’, offers a helpful framework which allows us to update on new evidence in a way that’s more likely to make us calibrated.
Moreover, even thinking in terms of degrees of belief as subjective probabilities at all (and not just how to update them) is a pretty novel conceptual insight. I’ve spent plenty of time speaking to people with advanced degrees in philosophy, many of whom think by default in terms of disbelief/full belief, and don’t have a conception of anything like the framework of subjective probabilities.
Perhaps you agree with what I said above. But I think such points are worth stating explicitly, given that I think they’re pretty unfamiliar to most people, and constitute ways in which the Bayesian framework has generated novel insights about good epistemic behaviour.
Thanks for the comment :) I agree with your second point, and alluded to it by having Bob mention the importance of considering degrees of belief as probabilities. Perhaps I should make this point more strongly, but at the same time, it’s definitely not something that’s unique to bayesianism, and you could advocate for it on its own merits. I guess the historical context is relevant: were the original people who advocated for thinking of degrees of belief in probabilistic terms bayesians? I don’t know enough to answer that question.
I disagree with your first point. I think the basic framework—what did I use to believe, what have I learned, how have I changed my mind—is exactly that: basic. It doesn’t need to be justified in terms of Bayes, it was around far before that. Insofar as Bayes makes it more precise, it also makes it more inapplicable, because people adopt the parts of “precise Bayesian updates” that they agree with, but not all the others which I mention in the dialogue.
Maybe the qualitative components of Bayes’ theorem are, in some sense, pretty basic. If I think about how I would teach the basic qualitative concepts encoded by Bayes’ theorem (which we both agree are useful), I can’t think of a better way than through directly teaching Bayes’ theorem. That is the sense in which I think Bayes’ theorem offers a helpful precisification of these more qualitative concepts: it imposes a useful pedagogical structure into which we can neatly fit such principles.
You claim that the increased precision afforded by Bayesianism means that people end up ignoring the bits that don’t apply to us, so Bayesianism doesn’t really help us out much. I agree that, insofar as we use the formal Bayesian framework, we are ignoring certain bits. But I think that, by highlighting which bits do not apply to us, we gain a better understanding of why certain parts of our reasoning may be good or bad. For example, it forces us to confront why we think making predictions is good (as Bob points out, it allows us to avoid post-hoc rationalisation). This, I think, usefully steers our attention towards more pragmatic questions concerning the role that prediction plays in our epistemic lives, and away from more metaphysical questions about (for example) the real grounds for thinking prediction is an Epistemic Virtue.
So I think we might disagree on the empirical claim of how well we can teach such concepts without reliance on anything like Bayesianism. Perhaps we also have differing answers to the question: ‘does engaging with the formal Bayesian framework usefully draw our attention towards parts of our epistemic lives that matter?’ Does that sound right to you?