It doesn’t present or consider any evidence for the alternatives.
So, in the current version of the post (which is edited from the original) Roko goes thru the basic estimate of “probability of this type of virus, location, and timing” given spillover and lab leak, and discounts other evidence in this paragraph:
These arguments are fairly robust to details about specific minor pieces of evidence or analyses. Whatever happens with all the minor arguments about enzymes and raccoon dogs and geospatial clustering, you still have to explain how the virus found its way to the place that got the first BSL-4 lab and the top Google hits for “Coronavirus China”, and did so in slightly less than 2 years after the lifting of the moratorium on gain-of-function research. And I don’t see how you can explain that other than that covid-19 escaped from WIV or a related facility in Wuhan.
I don’t think that counts as presenting it, but I do think that counts as considering it. I think it’s fine to question whether or not the arguments are robust to those details—I think they generally are and have not been impressed by any particular argument in favor of zoonosis that I’ve seen, mostly because I don’t think they properly estimate the probability under both hypotheses[1]--but I don’t think it’s the case that Roko is clearly making procedural errors here. [It seems to me like you’re arguing he’s making procedural errors instead of just combing to the wrong conclusion / using the wrong numbers, and so I’m focusing on that as the more important point.]
If it’s not a lot of evidence
This is what numbers are for. Is “1000-1” a lot? Is it tremendous? Who cares about fuzzy words when the number 1000 is right there. (I happen to think 1000-1 is a lot but is not tremendous.)
For example, the spatial clustering analysis suggests that the first major transmission event was at the market. But does their model explicitly consider both “transfer from animal to many humans at the market” and “transfer from infected lab worker to many humans at the market” and estimate probabilities for both? I don’t think so, and I think that means it’s not yet in a state where it can be plugged into the full Bayesian analysis. I think you need to multiply the probability that it was from the lab times the first lab-worker superspreader event happening at the market and compare that to the probability that it was from an animal times the first animal-human superspreader event happening at the market, and then you actually have some useful numbers to compare.
I would describe that as dismissing counter-evidence out of hand; it’s trivially easy to answer the question as stated, even if you don’t believe that particular story. In any event, this seems like arguing over semantics. I think that accusing someone of a being responsible for several million deaths requires quite strong evidence, and that a pretty key component of presenting strong evidence is seriously addressing counter-arguments and counter-evidence. None of Roko’s posts do that.
[It seems to me like you’re arguing he’s making procedural errors instead of just combing to the wrong conclusion / using the wrong numbers, and so I’m focusing on that as the more important point.
Sure. For example, he’s making the exact procedural error you describe in your footnote, by failing to consider how likely the genetic evidence is under the lab leak hypothesis, or if any other cities would look suspicious as the starting location of a pandemic, etc. He’s failing to apply consistent levels of skepticism to sources. But the biggest issue, in my mind, is still just not giving the question the level of consideration it requires. (I’m drafting an actual post so more detailed object-level arguments can go there when I’m done).
This is what numbers are for. Is “1000-1” a lot? Is it tremendous? Who cares about fuzzy words when the number 1000 is right there. (I happen to think 1000-1 is a lot but is not tremendous.)
I’m not sure what the point of arguing about the definition of “tremendous” is. If I had written “a lot” instead of “a tremendous amount” would anything substantial change?
So, in the current version of the post (which is edited from the original) Roko goes thru the basic estimate of “probability of this type of virus, location, and timing” given spillover and lab leak, and discounts other evidence in this paragraph:
I don’t think that counts as presenting it, but I do think that counts as considering it. I think it’s fine to question whether or not the arguments are robust to those details—I think they generally are and have not been impressed by any particular argument in favor of zoonosis that I’ve seen, mostly because I don’t think they properly estimate the probability under both hypotheses[1]--but I don’t think it’s the case that Roko is clearly making procedural errors here. [It seems to me like you’re arguing he’s making procedural errors instead of just combing to the wrong conclusion / using the wrong numbers, and so I’m focusing on that as the more important point.]
This is what numbers are for. Is “1000-1” a lot? Is it tremendous? Who cares about fuzzy words when the number 1000 is right there. (I happen to think 1000-1 is a lot but is not tremendous.)
For example, the spatial clustering analysis suggests that the first major transmission event was at the market. But does their model explicitly consider both “transfer from animal to many humans at the market” and “transfer from infected lab worker to many humans at the market” and estimate probabilities for both? I don’t think so, and I think that means it’s not yet in a state where it can be plugged into the full Bayesian analysis. I think you need to multiply the probability that it was from the lab times the first lab-worker superspreader event happening at the market and compare that to the probability that it was from an animal times the first animal-human superspreader event happening at the market, and then you actually have some useful numbers to compare.
I would describe that as dismissing counter-evidence out of hand; it’s trivially easy to answer the question as stated, even if you don’t believe that particular story. In any event, this seems like arguing over semantics. I think that accusing someone of a being responsible for several million deaths requires quite strong evidence, and that a pretty key component of presenting strong evidence is seriously addressing counter-arguments and counter-evidence. None of Roko’s posts do that.
Sure. For example, he’s making the exact procedural error you describe in your footnote, by failing to consider how likely the genetic evidence is under the lab leak hypothesis, or if any other cities would look suspicious as the starting location of a pandemic, etc. He’s failing to apply consistent levels of skepticism to sources. But the biggest issue, in my mind, is still just not giving the question the level of consideration it requires. (I’m drafting an actual post so more detailed object-level arguments can go there when I’m done).
I’m not sure what the point of arguing about the definition of “tremendous” is. If I had written “a lot” instead of “a tremendous amount” would anything substantial change?