it should only take <2.5 times as many subjects to detect a real effect at p < .001 instead of p < .05
Not to disagree with the overarching point, but the use of “only” here is inappropriate under some circumstances. Eg, a neuropsychological study requiring participants with a particular kind of brain injury is going to find more than doubling its n extremely difficult and time-consuming. For this kind of study (presuming insistence on working with p-values) it seems better to roll with the “ludicrous” p < .05 and rely on replication elsewhere for improved reliability. “Ludicrous” is too strong in fields with small effect sizes and small subject pools; they just need a much higher rate of replication.
Not to disagree with the overarching point, but the use of “only” here is inappropriate under some circumstances. Eg, a neuropsychological study requiring participants with a particular kind of brain injury is going to find more than doubling its n extremely difficult and time-consuming. For this kind of study (presuming insistence on working with p-values) it seems better to roll with the “ludicrous” p < .05 and rely on replication elsewhere for improved reliability. “Ludicrous” is too strong in fields with small effect sizes and small subject pools; they just need a much higher rate of replication.