One quibble – “not replicable” seems like a much stronger criticism than “not replicated” – I imagine you might have meant the latter, i.e. attempted replications failed to find similarly ‘significant’ effects and not ‘the effect(s), if real, can not be replicated in principle’.
(And now I’m wondering whether “not replicable” is common and I’ve never noticed it before.)
Some thoughts about your question itself:
replicability [of all studies in this book] is somewhere between 12% and 46%.
That’s a pretty wide range!
It would probably also, significantly, matter as to which specific studies were not be replicated (and whether the attempted replications themselves were well done) and then which parts of the book depend on those studies, or cite them as evidence. Ideally, one would want to consider something like the entire ‘graph’ of claims/beliefs made or argued for in the book and both the specific and overall updates one would reasonably make based on the (non-)replication of the cited/referenced studies. That would be an interesting, tho costly (if only in time), project itself!
This is a good question!
One quibble – “not replicable” seems like a much stronger criticism than “not replicated” – I imagine you might have meant the latter, i.e. attempted replications failed to find similarly ‘significant’ effects and not ‘the effect(s), if real, can not be replicated in principle’.
(And now I’m wondering whether “not replicable” is common and I’ve never noticed it before.)
Some thoughts about your question itself:
That’s a pretty wide range!
It would probably also, significantly, matter as to which specific studies were not be replicated (and whether the attempted replications themselves were well done) and then which parts of the book depend on those studies, or cite them as evidence. Ideally, one would want to consider something like the entire ‘graph’ of claims/beliefs made or argued for in the book and both the specific and overall updates one would reasonably make based on the (non-)replication of the cited/referenced studies. That would be an interesting, tho costly (if only in time), project itself!