They’re technically not incorrect, but they are on the wrong side of the debate. It’s true that we can occasionally understand things without directly experimenting on them, but we could use more experiment, not less.
The interesting thing is often not if a treatment method works but how it compares to other methods. Afaik in cancer research often groups get different treatment that then gets compared.
Sadly it seems that correct statistical knowledge is not too widely spread in all places where needed. I read a book of german medical professors who dearly complained about that.
There is no need to slavishly follow one standard of testing. What would be awesome were a better understanding on how to get good results with the least effort (in case of medics: least ppl. treated ineffectively).
While more controlled experiments are undoubtedly a good thing, observational studies are often not useless, since one can often make a plausible argument for extracting causation from them. Sadly, the default state of causal analysis in medicine remains “use regression.”
They’re technically not incorrect, but they are on the wrong side of the debate. It’s true that we can occasionally understand things without directly experimenting on them, but we could use more experiment, not less.
If you say that all experiments have to be placebo controlled double blind experiments you aren’t advocating more experiments.
You are advocating that the resources get spread about over less experiments but that those experiments that are done have a higher standard. http://www.blog.sethroberts.net/2011/01/25/monocultures-of-evidence/
The interesting thing is often not if a treatment method works but how it compares to other methods. Afaik in cancer research often groups get different treatment that then gets compared. Sadly it seems that correct statistical knowledge is not too widely spread in all places where needed. I read a book of german medical professors who dearly complained about that. There is no need to slavishly follow one standard of testing. What would be awesome were a better understanding on how to get good results with the least effort (in case of medics: least ppl. treated ineffectively).
While more controlled experiments are undoubtedly a good thing, observational studies are often not useless, since one can often make a plausible argument for extracting causation from them. Sadly, the default state of causal analysis in medicine remains “use regression.”