As a scientist, I don’t come to work on Monday and make an observation, then form a hypothesis on Tuesday, devise an experiment to test some prediction on Wednesday, perform the experiment Thursday, and interpret the result on Friday. On any given day I would be hard pressed to tell you where I am in the process. All of the above, really. It’s a mess.
That is a large part of the reason why we have problems like the file drawer effect and data dredging.
Yeah. But I think there are different levels of propriety, and that is what the quote is getting at. We should mention that the ideal form of science would look very rigid and modular and be without bias. Then, we should talk about how actual science inevitably involves biases and errors, and that these biases to a limited extent are sometimes compensated by increased efficiency. Then, we should talk about how to minimize biases while maximizing the efficiency of our thought processes.
Level One: Ideal
Level Two: Reality
Level Three: Pragmatic Ideal
A class or book on Level Three would be very useful to me and I’m not aware of any. Anyone have suggestions? Less Wrong seems to cover Level One very well and Level Two is obvious to anyone who is a human being but Level Three is what I would really like to work on.
That is a large part of the reason why we have problems like the file drawer effect and data dredging.
I don’t think that thinking categorically and mechanically would be feasibly productive.
It’s a reality that we have to think messily in order to solve problems quickly, even if that efficiency also causes biases.
However, we should at least be aware of what the proper way to do it would be.
Yeah. But I think there are different levels of propriety, and that is what the quote is getting at. We should mention that the ideal form of science would look very rigid and modular and be without bias. Then, we should talk about how actual science inevitably involves biases and errors, and that these biases to a limited extent are sometimes compensated by increased efficiency. Then, we should talk about how to minimize biases while maximizing the efficiency of our thought processes.
Level One: Ideal
Level Two: Reality
Level Three: Pragmatic Ideal
A class or book on Level Three would be very useful to me and I’m not aware of any. Anyone have suggestions? Less Wrong seems to cover Level One very well and Level Two is obvious to anyone who is a human being but Level Three is what I would really like to work on.