I’d imagine publication bias priors are helpful, especially with increasing specificity of research area, and especially where you can think of any remote possibility for interference.
Just as an example I’m familiar with (note this is probably a somewhat more extreme example than for most research areas due to the state of pharmacological research): If you see 37 RCTs in favour of a given drug, and 3 that find no significant impact (i.e. 93% in favour), it is not unfounded to assume that the trials actually performed are roughly equal in favour and against, and that there may be a missing 34-odd studies.
A 2009 analysis found that this was almost exactly the case (the studies registered were 36:38 in favour of the drug; one positive RCT went missing before publication. Along with twenty-two non-significant studies that were missing altogether, and a further 11 which were so poorly analysed as to appear significant.
(Bad Pharma, by Ben Goldacre, is a pretty sound resource for this topic in general)
I’d imagine publication bias priors are helpful, especially with increasing specificity of research area, and especially where you can think of any remote possibility for interference.
Just as an example I’m familiar with (note this is probably a somewhat more extreme example than for most research areas due to the state of pharmacological research): If you see 37 RCTs in favour of a given drug, and 3 that find no significant impact (i.e. 93% in favour), it is not unfounded to assume that the trials actually performed are roughly equal in favour and against, and that there may be a missing 34-odd studies.
A 2009 analysis found that this was almost exactly the case (the studies registered were 36:38 in favour of the drug; one positive RCT went missing before publication. Along with twenty-two non-significant studies that were missing altogether, and a further 11 which were so poorly analysed as to appear significant.
(Bad Pharma, by Ben Goldacre, is a pretty sound resource for this topic in general)
Wow thank you! I found this really helpful.