To the superficial observer, scientific truth is unassailable, the logic of science is infallible; and if scientific men sometimes make mistakes, it is because they have not understood the rules of the game. Mathematical truths are derived from a few self-evident propositions, by a chain of flawless reasonings; they are imposed not only on us, but also on nature itself. By them the Creator is fettered, as it were, and His choice is limited to a relatively small number of solutions. A few experiments, therefore, will be sufficient to enable us to determine what choice He has made. From each experiment a number of consequences will follow by a series of mathematical deductions...This, to the minds of most people...is the origin of certainty in science.
But upon more mature reflection the position held by hypothesis was seen; it was recognized that it is as necessary to the experimenter as to the mathematician. And then the doubt arose if all these constructions are built on solid foundations. The conclusion was drawn that a breath would bring them to the ground. This sceptical attitude does not escape the charge of superficiality. To doubt everything or to believe everything is two equally convenient solutions; both dispense with the necessity of reflection.
-Henri Poincare, Science and Hypothesis