For example, if CFAR wasn’t putting high probability on having success with these three fronts, then why were they the dependent variables for the RCT?
We were not putting high probability on it—the RCT had few participants but a large number of questions, which we launched knowing full well that it was unlikely to tell us much and that most results would likely be negative (and that any results with e.g. p=.05 would probably be statistical flukes, given the number of comparisons), specifically so we could figure out which hypotheses to test more carefully later.
We’ll be continuing with small, not-bankruptingly-expensive tests this year. If a large targeted donation could be found, we could of course do more of this faster; if anyone’s interested they should talk to me. We’ll also be continuing to rapidly shift the curriculum as we get informal impressions/feedback from our workshops and from the continuing stream of new units that we try on volunteers, in response mostly to our intuitive impressions but also to more formal tests.
(The RCT is not an attempt to conform to an effective altruism ritual—if such ritual was imposed on CFAR’s structure without thinking carefully about what we’re actually trying to do, such attempts would probably do more harm than good to our mission, in the manner of Feynman’s “Cargo cult science”. The RCT is just a part of a much larger set of attempts to figure out how to create a effective, clear-thinking do-gooding—and to avoid deluding ourselves while we do this.)
I’m looking forward to talking with you on Skype—thanks for signing up for a timeslot—this’ll probably be easier to discuss in person.
We were not putting high probability on it—the RCT had few participants but a large number of questions, which we launched knowing full well that it was unlikely to tell us much and that most results would likely be negative (and that any results with e.g. p=.05 would probably be statistical flukes, given the number of comparisons), specifically so we could figure out which hypotheses to test more carefully later.
We’ll be continuing with small, not-bankruptingly-expensive tests this year. If a large targeted donation could be found, we could of course do more of this faster; if anyone’s interested they should talk to me. We’ll also be continuing to rapidly shift the curriculum as we get informal impressions/feedback from our workshops and from the continuing stream of new units that we try on volunteers, in response mostly to our intuitive impressions but also to more formal tests.
(The RCT is not an attempt to conform to an effective altruism ritual—if such ritual was imposed on CFAR’s structure without thinking carefully about what we’re actually trying to do, such attempts would probably do more harm than good to our mission, in the manner of Feynman’s “Cargo cult science”. The RCT is just a part of a much larger set of attempts to figure out how to create a effective, clear-thinking do-gooding—and to avoid deluding ourselves while we do this.)
I’m looking forward to talking with you on Skype—thanks for signing up for a timeslot—this’ll probably be easier to discuss in person.