a weekend motivational retreat is unlikely to be effective at altering exercise
I agree about income and happiness, but I would expect CFAR to at least boost exercise, as (a) it doesn’t seem hard and (b) to be exactly the kind of thing CFAR is trying to do. I don’t know much about the specifics of the RCT with regard to statistical power, etc., however.
However, A lot of my questions in my previous comment weren’t aimed specifically at the current RCT, but at the bigger picture overall here. For example, if CFAR wasn’t putting high probability on having success with these three fronts, then why were they the dependent variables for the RCT? And what does CFAR put high probability of having success on? How do they plan on measuring that?
For example, if CFAR wasn’t putting high probability on having success with these three fronts, then why were they the dependent variables for the RCT?
We were not putting high probability on it—the RCT had few participants but a large number of questions, which we launched knowing full well that it was unlikely to tell us much and that most results would likely be negative (and that any results with e.g. p=.05 would probably be statistical flukes, given the number of comparisons), specifically so we could figure out which hypotheses to test more carefully later.
We’ll be continuing with small, not-bankruptingly-expensive tests this year. If a large targeted donation could be found, we could of course do more of this faster; if anyone’s interested they should talk to me. We’ll also be continuing to rapidly shift the curriculum as we get informal impressions/feedback from our workshops and from the continuing stream of new units that we try on volunteers, in response mostly to our intuitive impressions but also to more formal tests.
(The RCT is not an attempt to conform to an effective altruism ritual—if such ritual was imposed on CFAR’s structure without thinking carefully about what we’re actually trying to do, such attempts would probably do more harm than good to our mission, in the manner of Feynman’s “Cargo cult science”. The RCT is just a part of a much larger set of attempts to figure out how to create a effective, clear-thinking do-gooding—and to avoid deluding ourselves while we do this.)
I’m looking forward to talking with you on Skype—thanks for signing up for a timeslot—this’ll probably be easier to discuss in person.
I agree about income and happiness, but I would expect CFAR to at least boost exercise, as (a) it doesn’t seem hard and (b) to be exactly the kind of thing CFAR is trying to do. I don’t know much about the specifics of the RCT with regard to statistical power, etc., however.
However, A lot of my questions in my previous comment weren’t aimed specifically at the current RCT, but at the bigger picture overall here. For example, if CFAR wasn’t putting high probability on having success with these three fronts, then why were they the dependent variables for the RCT? And what does CFAR put high probability of having success on? How do they plan on measuring that?
We were not putting high probability on it—the RCT had few participants but a large number of questions, which we launched knowing full well that it was unlikely to tell us much and that most results would likely be negative (and that any results with e.g. p=.05 would probably be statistical flukes, given the number of comparisons), specifically so we could figure out which hypotheses to test more carefully later.
We’ll be continuing with small, not-bankruptingly-expensive tests this year. If a large targeted donation could be found, we could of course do more of this faster; if anyone’s interested they should talk to me. We’ll also be continuing to rapidly shift the curriculum as we get informal impressions/feedback from our workshops and from the continuing stream of new units that we try on volunteers, in response mostly to our intuitive impressions but also to more formal tests.
(The RCT is not an attempt to conform to an effective altruism ritual—if such ritual was imposed on CFAR’s structure without thinking carefully about what we’re actually trying to do, such attempts would probably do more harm than good to our mission, in the manner of Feynman’s “Cargo cult science”. The RCT is just a part of a much larger set of attempts to figure out how to create a effective, clear-thinking do-gooding—and to avoid deluding ourselves while we do this.)
I’m looking forward to talking with you on Skype—thanks for signing up for a timeslot—this’ll probably be easier to discuss in person.