When contrasting LW stuff and mainstream rationality, I think the reliance on thinking in probabilities is a big part of the difference. (“Thinking logically,” for the mainstream, seems to be mostly about logic of certainty.)
Yes, I think you’re right.
For the Bayesian, though, it makes sense to update in the direction of evo psych, even though it can’t be proven
Um, I’m not so sure about that. The main accusation against evolutionary psychology is that it’s nothing but a bunch of just-so stories, aka unfalsifiable post-hoc narratives. And a Bayesian update should be on the basis of evidence, not on the basis of an unverifiable explanation.
The main accusation against evolutionary psychology is that it’s nothing but a bunch of just-so stories, aka unfalsifiable post-hoc narratives.
It seems to me that if you think in terms of likelihoods, you look at a story and say “but the converse of this story has high enough likelihood that we can’t rule it out!” whereas if you think in terms of likelihood ratios, you say “it seems that this story is weakly more plausible than its converse.”
I’m thinking primarily of comments like this. I think it is a reasonable conclusion that anger seems to be a basic universal emotion because ancestors who had the ‘right’ level of anger reproduced more than those who didn’t. Boris just notes that it could be the case that anger is a byproduct of something else, but doesn’t note anything about the likelihood of anger being universal in a world where it is helpful (very high) and the likelihood of anger being universal in a world where it is neutral or unhelpful (very low). We can’t rule out anger being spurious, but asking to rule that out is mistaken, I think, because the likelihood ratio is so significant. It doesn’t make sense to bet against anger being reproductively useful in the ancestral environment (but I think it makes sense to assign a probability to that bet, even if it’s not obvious how one would resolve it).
It seems to me that if you think in terms of likelihoods, you look at a story and say “but the converse of this story has high enough likelihood that we can’t rule it out!” whereas if you think in terms of likelihood ratios, you say “it seems that this story is weakly more plausible than its converse.”
I have several problems with this line of reasoning. First, I am unsure what it means for a story to be true. It’s a story—it arranges a set of facts in a pattern pleasing to the human brain. Not contradicting any known facts is a very low threshold (see the Russell’s teapot), to call something “true” I’ll need more than that and if a story makes no testable predictions I am not sure on which basis I should evaluate its truth and what does it even mean.
Second, it seems to me that in such situations the likelihoods and so, necessarily, their ratios are very very fuzzy. My meta uncertainty—uncertainty about probabilities—is quite high. I might say “story A is weakly more plausible than story B” but my confidence in my judgment about plausibility is very low. This judgment might not be worth anything.
Third, likelihood ratios are good when you know you have a complete set of potential explanations. And you generally don’t. For open-ended problems the explanation “something else” frequently looks like the more plausible one, but again, the meta uncertainty is very high—not only you don’t know how uncertain you are, you don’t even know what you are uncertain about! Nassim Taleb’s black swans are precisely the beasties that appear out of “something else” to bite you in the ass.
First, I am unsure what it means for a story to be true.
Ah, by that I generally mean something like “the causal network N with a particular factorization F is the underlying causal representation of reality,” and so a particular experiment measures data and then we calculate “the aforementioned causal network would generate this data with probability P” for various hypothesized causal networks.
For situations where you can control at least one of the nodes, it’s easy to see how you can generate data useful for this. For situations where you only have observational data (like the history of human evolution, mostly), then it’s trickier to determine which causal network(s) is(are) best, but often still possible to learn quite a bit more about the underlying structure than is obvious at first glance.
So suppose we have lots of historical lives which are compressed down to two nodes, A which measures “anger” (which is integer-valued and non-negative, say) and C which measures “children” (which is also integer valued and non-negative). The story “anger is spurious” is the network where A and C don’t have a link between them, and the story “anger is reproductively useful” is the network where A->C and there is some nonzero value a^* of A which maximizes the expected value of C. If we see a relationship between A and C in the data, it’s possible that the relationship was generated by the “anger is spurious” network which said those variables were independent, but we can calculate the likelihoods and determine that it’s very very low, especially as we accumulate more and more data.
Third, likelihood ratios are good when you know you have a complete set of potential explanations. And you generally don’t.
Sure. But even if you’re only aware of two hypotheses, it’s still useful to use the LR to determine which to prefer; the supremacy of a third hidden hypothesis can’t swap the ordering of the two known hypotheses!
Nassim Taleb’s black swans are precisely the beasties that appear out of “something else” to bite you in the ass.
Yes, reversal effects are always possible, but I think that putting too much weight on this argument leads to Anton-Wilsonism (certainty is necessary but impossible). I think we do often have a good idea of what our meta uncertainty looks like in a lot of cases, and that’s generally enough to get the job done.
I have only glanced at Pearl’s work, not read it carefully, so my understanding of causal networks is very limited. But I don’t understand on the basis of which data will you construct the causal network for anger and children (and it’s actually more complicated because there are important society-level effects). In what will you “see a relationship between A and C”? On the basis of what will you be calculating the likelihoods?
In what will you “see a relationship between A and C”? On the basis of what will you be calculating the likelihoods?
Ideally, you would have some record. I’m not an expert in evo psych, so I can’t confidently say what sort of evidence they actually rely on. I was hoping more to express how I would interpret a story as a formal hypothesis.
I get the impression that a major technique in evolutionary psychology is making use of the selection effect due to natural selection: if you think that A is heritable, and that different values of A have different levels of reproductive usefulness, then in steady state the distribution of A in the population gives you information about the historic relationship between A and reproductive usefulness, without even measuring relationship between A and C in this generation. So you can ask the question “what’s the chance of seeing the cluster of human anger that we have if there’s not a relationship between A and reproduction?” and get answers that are useful enough to focus most of your attention on the “anger is reproductively useful” hypothesis.
Yes, I think you’re right.
Um, I’m not so sure about that. The main accusation against evolutionary psychology is that it’s nothing but a bunch of just-so stories, aka unfalsifiable post-hoc narratives. And a Bayesian update should be on the basis of evidence, not on the basis of an unverifiable explanation.
It seems to me that if you think in terms of likelihoods, you look at a story and say “but the converse of this story has high enough likelihood that we can’t rule it out!” whereas if you think in terms of likelihood ratios, you say “it seems that this story is weakly more plausible than its converse.”
I’m thinking primarily of comments like this. I think it is a reasonable conclusion that anger seems to be a basic universal emotion because ancestors who had the ‘right’ level of anger reproduced more than those who didn’t. Boris just notes that it could be the case that anger is a byproduct of something else, but doesn’t note anything about the likelihood of anger being universal in a world where it is helpful (very high) and the likelihood of anger being universal in a world where it is neutral or unhelpful (very low). We can’t rule out anger being spurious, but asking to rule that out is mistaken, I think, because the likelihood ratio is so significant. It doesn’t make sense to bet against anger being reproductively useful in the ancestral environment (but I think it makes sense to assign a probability to that bet, even if it’s not obvious how one would resolve it).
I have several problems with this line of reasoning. First, I am unsure what it means for a story to be true. It’s a story—it arranges a set of facts in a pattern pleasing to the human brain. Not contradicting any known facts is a very low threshold (see the Russell’s teapot), to call something “true” I’ll need more than that and if a story makes no testable predictions I am not sure on which basis I should evaluate its truth and what does it even mean.
Second, it seems to me that in such situations the likelihoods and so, necessarily, their ratios are very very fuzzy. My meta uncertainty—uncertainty about probabilities—is quite high. I might say “story A is weakly more plausible than story B” but my confidence in my judgment about plausibility is very low. This judgment might not be worth anything.
Third, likelihood ratios are good when you know you have a complete set of potential explanations. And you generally don’t. For open-ended problems the explanation “something else” frequently looks like the more plausible one, but again, the meta uncertainty is very high—not only you don’t know how uncertain you are, you don’t even know what you are uncertain about! Nassim Taleb’s black swans are precisely the beasties that appear out of “something else” to bite you in the ass.
Ah, by that I generally mean something like “the causal network N with a particular factorization F is the underlying causal representation of reality,” and so a particular experiment measures data and then we calculate “the aforementioned causal network would generate this data with probability P” for various hypothesized causal networks.
For situations where you can control at least one of the nodes, it’s easy to see how you can generate data useful for this. For situations where you only have observational data (like the history of human evolution, mostly), then it’s trickier to determine which causal network(s) is(are) best, but often still possible to learn quite a bit more about the underlying structure than is obvious at first glance.
So suppose we have lots of historical lives which are compressed down to two nodes, A which measures “anger” (which is integer-valued and non-negative, say) and C which measures “children” (which is also integer valued and non-negative). The story “anger is spurious” is the network where A and C don’t have a link between them, and the story “anger is reproductively useful” is the network where A->C and there is some nonzero value a^* of A which maximizes the expected value of C. If we see a relationship between A and C in the data, it’s possible that the relationship was generated by the “anger is spurious” network which said those variables were independent, but we can calculate the likelihoods and determine that it’s very very low, especially as we accumulate more and more data.
Sure. But even if you’re only aware of two hypotheses, it’s still useful to use the LR to determine which to prefer; the supremacy of a third hidden hypothesis can’t swap the ordering of the two known hypotheses!
Yes, reversal effects are always possible, but I think that putting too much weight on this argument leads to Anton-Wilsonism (certainty is necessary but impossible). I think we do often have a good idea of what our meta uncertainty looks like in a lot of cases, and that’s generally enough to get the job done.
I have only glanced at Pearl’s work, not read it carefully, so my understanding of causal networks is very limited. But I don’t understand on the basis of which data will you construct the causal network for anger and children (and it’s actually more complicated because there are important society-level effects). In what will you “see a relationship between A and C”? On the basis of what will you be calculating the likelihoods?
Ideally, you would have some record. I’m not an expert in evo psych, so I can’t confidently say what sort of evidence they actually rely on. I was hoping more to express how I would interpret a story as a formal hypothesis.
I get the impression that a major technique in evolutionary psychology is making use of the selection effect due to natural selection: if you think that A is heritable, and that different values of A have different levels of reproductive usefulness, then in steady state the distribution of A in the population gives you information about the historic relationship between A and reproductive usefulness, without even measuring relationship between A and C in this generation. So you can ask the question “what’s the chance of seeing the cluster of human anger that we have if there’s not a relationship between A and reproduction?” and get answers that are useful enough to focus most of your attention on the “anger is reproductively useful” hypothesis.