Great, so did I! Now communicate that evidence. If it can’t be communicated, I don’t think you should be so confident in it.
Here:
Surprisingly positive reviews in both qualitative and quantitative forms on our exit surveys.
Follow-ups with many individual minicampers who report that several of the things we taught have stuck with them and improved their lives.
People telling me to my face during minicamp that they were getting lots of value out of it.
Enthusiastic testimonials.
It may take time for the participants to report back, but not for you to tabulate the results.
No, it definitely takes time to tabluate the results and write a presentable post about the results. I’ve personally spent 3 hours on it already but the project is unfinished.
Do you want your audience to be people who just take your word on something like this?
Ah. I may not have communicate this clearly: I think your skepticism concerning the success of the minicamp is warranted because almost no evidence is available to you. You’re welcome to not take my word for it. When I have another 5-10 hours to finish putting together the results and write a post with more details about minicamp, I will, but I’m mostly waiting to invest that time until I can do it most profitably, for example when we’ve gathered more ‘after minicamp’ data.
Then why don’t you mention this in your “how to be happy” post, which is also being used as evidence of your productivity?
I don’t understand. The ‘How to Be Happy’ post was written before I helped run minicamp. And, there are tons of things not mentioned in that post. That post barely scratches the surface of my thoughts on happiness, let alone research on happiness in general.
Do you know a single person who has improved fashion to an acceptable level as a result of those magazines?
I doubt magazines is ever the sole input on someone’s fashion sense, but yes I know people who have improved their fashion as a result of following magazines (or fashion blogs; same thing basically). Ask Peter Scheyer about this, for example.
Honestly, I’m not sure. Having a randomized control group and then looking at actual success would be nice. Even without a good control, one obvious thing to do would have been to do before and after tests of similar questions that test for rational behavior (e.g. whether they can recognize they are engaging in the sunk cost fallacy and things like that). It may be that given the circumstances the best evidence we have is self-reporting like this. If so, it is evidence for the success of the minicamps. But, it is not very strong evidence precisely because it is consistent with a variety of other not implausible hypotheses. This thread has made me more inclined to believe that the minicamps were successful, but had not strongly increased my confidence.
Here:
Surprisingly positive reviews in both qualitative and quantitative forms on our exit surveys.
Follow-ups with many individual minicampers who report that several of the things we taught have stuck with them and improved their lives.
People telling me to my face during minicamp that they were getting lots of value out of it.
Enthusiastic testimonials.
No, it definitely takes time to tabluate the results and write a presentable post about the results. I’ve personally spent 3 hours on it already but the project is unfinished.
Ah. I may not have communicate this clearly: I think your skepticism concerning the success of the minicamp is warranted because almost no evidence is available to you. You’re welcome to not take my word for it. When I have another 5-10 hours to finish putting together the results and write a post with more details about minicamp, I will, but I’m mostly waiting to invest that time until I can do it most profitably, for example when we’ve gathered more ‘after minicamp’ data.
I don’t understand. The ‘How to Be Happy’ post was written before I helped run minicamp. And, there are tons of things not mentioned in that post. That post barely scratches the surface of my thoughts on happiness, let alone research on happiness in general.
I doubt magazines is ever the sole input on someone’s fashion sense, but yes I know people who have improved their fashion as a result of following magazines (or fashion blogs; same thing basically). Ask Peter Scheyer about this, for example.
Given the large amount of effort it took to get to the miny camps, all four of these could be easily explained by cognitive dissonance.
What evidence would you expect them to have if the “minicamp” was a genuine success? (Edited—thanks for the correction, wedrified!)
Bootcamp? I found the wording Eliezer used fascinating:
Have they actually claimed anywhere here that the bootcamp was successful?
Oops, fixed—thanks!
Honestly, I’m not sure. Having a randomized control group and then looking at actual success would be nice. Even without a good control, one obvious thing to do would have been to do before and after tests of similar questions that test for rational behavior (e.g. whether they can recognize they are engaging in the sunk cost fallacy and things like that). It may be that given the circumstances the best evidence we have is self-reporting like this. If so, it is evidence for the success of the minicamps. But, it is not very strong evidence precisely because it is consistent with a variety of other not implausible hypotheses. This thread has made me more inclined to believe that the minicamps were successful, but had not strongly increased my confidence.