This makes a lot of sense, actually. You’re focused on mechanisms that a good thinker could use to determine whether or not a particular scientific finding is true or not. I’m worried about the ways that the conversation around skepticism can and does go astray.
Perhaps I read some of the quotes from the papers uncharitably. Silberzahn asks “What if scientific results are highly contingent on subjective decisions at the analysis stage?” I interpreted this question, in conjunction with the paper’s conclusion, as pointing to a line of thinking that goes something like this:
What if scientific results are highly contingent on subjective decisions at the analysis stage?
Some scientific results are highly contingent on subjective decisions at the analysis stage.
What if ALL scientific results are highly contingent on subjective decisions at the analysis stage across the board???!!!
But a more charitable version for the third step is:
3. This method helped us uncover one such case, and might help us uncover more. Also, it’s a reminder to avoid overconfidence in published research, especially in politically charged and important issues where good evidence is hard to come by.
I spent the last ten years teaching children, and so my default mode is one of “educating the young and naive to be a little more sophisticated.” Part of my role was to sequence and present ideas with care in order to increase the chance that an impressionable and naive young mind absorbed the healthy version of an idea, rather than a damaging misinterpretation. Maybe that informs the way I perceive this debate.
This makes a lot of sense, actually. You’re focused on mechanisms that a good thinker could use to determine whether or not a particular scientific finding is true or not. I’m worried about the ways that the conversation around skepticism can and does go astray.
Perhaps I read some of the quotes from the papers uncharitably. Silberzahn asks “What if scientific results are highly contingent on subjective decisions at the analysis stage?” I interpreted this question, in conjunction with the paper’s conclusion, as pointing to a line of thinking that goes something like this:
What if scientific results are highly contingent on subjective decisions at the analysis stage?
Some scientific results are highly contingent on subjective decisions at the analysis stage.
What if ALL scientific results are highly contingent on subjective decisions at the analysis stage across the board???!!!
But a more charitable version for the third step is:
3. This method helped us uncover one such case, and might help us uncover more. Also, it’s a reminder to avoid overconfidence in published research, especially in politically charged and important issues where good evidence is hard to come by.
I spent the last ten years teaching children, and so my default mode is one of “educating the young and naive to be a little more sophisticated.” Part of my role was to sequence and present ideas with care in order to increase the chance that an impressionable and naive young mind absorbed the healthy version of an idea, rather than a damaging misinterpretation. Maybe that informs the way I perceive this debate.
Just wanted to confirm you have accurately described my thoughts, and I feel I have a better understanding of your position as well now.