Depending on the time scale of the experiment, you could run a rain-dance trial. (thinking primary school kids)
a rain dance is where you do a special dance to make it rain.
spend 5 minutes each day doing the dance, (or not) and evaluating if it rained yesterday, keep a graph of rain+dancing. Run trials for as many weeks as you like.
If this would be enough to prove the effectiveness of rain-dancing, then we would develop 30 different styles of rain-dance, test each of them, and with a very high chance we would get p<0.05 on at least one of them.
Sadly, the medical industry is full of such publications, because publishing new ideas is rewarded more than reproducing already published experiments.
I came here to mention raindances. You do a raindance and nothing happens. You raindance for 12 more days and suddenly it rains. That must mean if you dance for 13 days straight (or dance until some other sort of requirement you Just So on the spot) it will rain!
If you don’t add the idea of falsifiability to accept that raindances might not cause rain when you get negative results, then you will always get the conclusion that some amount of raindancing will cause rain.
Ideally you would add a parameter of audience interaction though if you really want everyone to feel the impact of their failed predictions on a gut level. That’s the value of the 2-4-6 game and things like making predictions before learning about scope insensitivity.
raindance is good for that reason (it has a lot of freedom). You can do statistics on it; you can also (sneakily) keep experimenting for a very long time scale and only stop when you have the right answer.
you can also do things like—dance on days when the weather man says it will rain. just to confuse people
My motorcycle once broke down. Messing about with all the usual stuff didn’t restart it. Eventually I danced backwards round it waving a spanner and singing about petrol. Started first kick.
Depending on the time scale of the experiment, you could run a rain-dance trial. (thinking primary school kids)
a rain dance is where you do a special dance to make it rain. spend 5 minutes each day doing the dance, (or not) and evaluating if it rained yesterday, keep a graph of rain+dancing. Run trials for as many weeks as you like.
That could backfire quite spectacularly :-)
We should keep running the trials until we can get p<0.05 and prove the hypothesis!
If this would be enough to prove the effectiveness of rain-dancing, then we would develop 30 different styles of rain-dance, test each of them, and with a very high chance we would get p<0.05 on at least one of them.
Sadly, the medical industry is full of such publications, because publishing new ideas is rewarded more than reproducing already published experiments.
Hitting p<0.05 doesn’t prove the hypotheis. That’s not what the t-test does.
I came here to mention raindances. You do a raindance and nothing happens. You raindance for 12 more days and suddenly it rains. That must mean if you dance for 13 days straight (or dance until some other sort of requirement you Just So on the spot) it will rain!
If you don’t add the idea of falsifiability to accept that raindances might not cause rain when you get negative results, then you will always get the conclusion that some amount of raindancing will cause rain.
Ideally you would add a parameter of audience interaction though if you really want everyone to feel the impact of their failed predictions on a gut level. That’s the value of the 2-4-6 game and things like making predictions before learning about scope insensitivity.
raindance is good for that reason (it has a lot of freedom). You can do statistics on it; you can also (sneakily) keep experimenting for a very long time scale and only stop when you have the right answer.
you can also do things like—dance on days when the weather man says it will rain. just to confuse people
My motorcycle once broke down. Messing about with all the usual stuff didn’t restart it. Eventually I danced backwards round it waving a spanner and singing about petrol. Started first kick.