Quoting Less Wrong wiki: ” Hindsight bias is a tendency to overestimate the foreseeability of events that have actually happened. I.e., subjects given information about X, and asked to assign a probability that X will happen, assign much lower probabilities than subjects who are given the same information about X, are told that X actually happened, and asked to estimate the foreseeable probability of X. ”
Eliezer claims that he knows better than the experts. The event being foreseen is “my claim to know better than the experts pans out”. He’s pointing to a single instance of that, where it did indeed pan out, and using it to suggest that the event is relatively likely to happen in general. That’s a form of hindsight bias.
“I think it would be helpful to explicitly state how you’d expect it to be unrepresentative. ”
We know that there are areas where Eliezer claims to know better than the experts. We also know that the most prominent ones of those are not medical at all. There are tons of experts who deny LW-style AI danger, or say that cryonics is pointless, or that you don’t have to believe many worlds theory to be a competent physicist. So the answer is “those things are so far from SAD that I’d be surprised if there was any way they could be representative.”
I think both of the example that EY gives are cases where he was public about his position before the empirical evidence came in.
EY wrote on facebook about his project to build the mega lamp to help Brienne and was confident enough in it to convince her not to spent the winter outside of the US.
The example with the Japanese fiscal policy is also one where EY was public about his views before the empirical evidence was public.
That doesn’t help because there’s no baseline. How many times did he have public positions that didn’t pan out?
But the point is that “Eliezer knew better than the experts with respect to lamps” doesn’t imply “Eliezer knows better than the experts on typical LW topics about which Eliezer claims to know better than the experts”.
“Hindsight bias” seems like the wrong term”
Quoting Less Wrong wiki: ” Hindsight bias is a tendency to overestimate the foreseeability of events that have actually happened. I.e., subjects given information about X, and asked to assign a probability that X will happen, assign much lower probabilities than subjects who are given the same information about X, are told that X actually happened, and asked to estimate the foreseeable probability of X. ”
Eliezer claims that he knows better than the experts. The event being foreseen is “my claim to know better than the experts pans out”. He’s pointing to a single instance of that, where it did indeed pan out, and using it to suggest that the event is relatively likely to happen in general. That’s a form of hindsight bias.
“I think it would be helpful to explicitly state how you’d expect it to be unrepresentative. ”
We know that there are areas where Eliezer claims to know better than the experts. We also know that the most prominent ones of those are not medical at all. There are tons of experts who deny LW-style AI danger, or say that cryonics is pointless, or that you don’t have to believe many worlds theory to be a competent physicist. So the answer is “those things are so far from SAD that I’d be surprised if there was any way they could be representative.”
I think both of the example that EY gives are cases where he was public about his position before the empirical evidence came in.
EY wrote on facebook about his project to build the mega lamp to help Brienne and was confident enough in it to convince her not to spent the winter outside of the US.
The example with the Japanese fiscal policy is also one where EY was public about his views before the empirical evidence was public.
That doesn’t help because there’s no baseline. How many times did he have public positions that didn’t pan out?
But the point is that “Eliezer knew better than the experts with respect to lamps” doesn’t imply “Eliezer knows better than the experts on typical LW topics about which Eliezer claims to know better than the experts”.