A single study can’t get close to 100% certainty, because that’s just not how science works. If you look at all the studies that were true with 95% certainty, you’ll find that well over 5% have found conclusions now believed to be false. There are issues of trust, issues of data collection errors, issues of statistical evaluation, the fact that scientific methods are designed under the assumption that studies will be repeated, etc.
The steps within unsound mathematical proofs may be valuable, but their conclusions are not.
A single study can’t get close to 100% certainty, because that’s just not how science works. … the fact that scientific methods are designed under the assumption that studies will be repeated, etc.
The current scientific method is in no way ideal. If a study were properly Bayesian, then you should be able to confidently learn from its results. That still leaves issues of trust and the possibility of human error, but there might also be ways to combat those. But in a human society, repeating studies is perhaps the best thing one can hope for.
The steps within unsound mathematical proofs may be valuable, but their conclusions are not.
Agreed. That is the one part of an unsound proof that is useless.
Can you describe a better, more Bayesian scientific method? The main way I would change it is to increase the number of studies that are repeated, to improve the accuracy of our knowledge. How would you propose to improve our confidence other than by showing that an experiment has reproducible results?
A single study can’t get close to 100% certainty, because that’s just not how science works. If you look at all the studies that were true with 95% certainty, you’ll find that well over 5% have found conclusions now believed to be false. There are issues of trust, issues of data collection errors, issues of statistical evaluation, the fact that scientific methods are designed under the assumption that studies will be repeated, etc.
The steps within unsound mathematical proofs may be valuable, but their conclusions are not.
The current scientific method is in no way ideal. If a study were properly Bayesian, then you should be able to confidently learn from its results. That still leaves issues of trust and the possibility of human error, but there might also be ways to combat those. But in a human society, repeating studies is perhaps the best thing one can hope for.
Agreed. That is the one part of an unsound proof that is useless.
Can you describe a better, more Bayesian scientific method? The main way I would change it is to increase the number of studies that are repeated, to improve the accuracy of our knowledge. How would you propose to improve our confidence other than by showing that an experiment has reproducible results?