Yeah, I should probably add a bit at the start or end of that section that everything in it is potentially selection effect. I don’t know how to look at the thing I’m curious about without that.
Thinking out loud: If you get a random selection of people from the Pushup Club and count how many pushups they can do, then do the same for general population, the difference could be selection effect. People who like doing pushups are more likely to go to pushup club in the first place, and more likely to stick with it. But I can’t realistically pay a bunch of Mechanical Turkers to hang out on LessWrong for six years and watch what happens. Presumably there’s some approach actual scientists have here, but I don’t know what it is. Suggestions welcome.
In the mean time I’m going to add a bit towards the start of the section warning of potential selection effects.
Yeah, I should probably add a bit at the start or end of that section that everything in it is potentially selection effect. I don’t know how to look at the thing I’m curious about without that.
Thinking out loud: If you get a random selection of people from the Pushup Club and count how many pushups they can do, then do the same for general population, the difference could be selection effect. People who like doing pushups are more likely to go to pushup club in the first place, and more likely to stick with it. But I can’t realistically pay a bunch of Mechanical Turkers to hang out on LessWrong for six years and watch what happens. Presumably there’s some approach actual scientists have here, but I don’t know what it is. Suggestions welcome.
In the mean time I’m going to add a bit towards the start of the section warning of potential selection effects.