So it looks like CFAR and the Guild both increase comfort in these skills. There’s two giant reasons not to trust this. First, this is self reported comfort levels, aka we’re basically measuring a vibe. Second, my sample size of CFAR goers and Guild of the Rose identifiers is like, a dozen people in the Yes category.
Zeroth, did they increase comfort or select for those already comfortable?
Yeah, I should probably add a bit at the start or end of that section that everything in it is potentially selection effect. I don’t know how to look at the thing I’m curious about without that.
Thinking out loud: If you get a random selection of people from the Pushup Club and count how many pushups they can do, then do the same for general population, the difference could be selection effect. People who like doing pushups are more likely to go to pushup club in the first place, and more likely to stick with it. But I can’t realistically pay a bunch of Mechanical Turkers to hang out on LessWrong for six years and watch what happens. Presumably there’s some approach actual scientists have here, but I don’t know what it is. Suggestions welcome.
In the mean time I’m going to add a bit towards the start of the section warning of potential selection effects.
Zeroth, did they increase comfort or select for those already comfortable?
Yeah, I should probably add a bit at the start or end of that section that everything in it is potentially selection effect. I don’t know how to look at the thing I’m curious about without that.
Thinking out loud: If you get a random selection of people from the Pushup Club and count how many pushups they can do, then do the same for general population, the difference could be selection effect. People who like doing pushups are more likely to go to pushup club in the first place, and more likely to stick with it. But I can’t realistically pay a bunch of Mechanical Turkers to hang out on LessWrong for six years and watch what happens. Presumably there’s some approach actual scientists have here, but I don’t know what it is. Suggestions welcome.
In the mean time I’m going to add a bit towards the start of the section warning of potential selection effects.