Chiropractics was long considered to be pseudo-medicine because it rests on the perceptive ability of it’s practioners. Yet, according to Cochrane we now know that their interventions have effects that are comparable to our mainstream treatments for backpain.
The useless paradigm of domestic science had a lot of esteem in the 20th centure while chiropratics had none. Given that it took this long to settle simply question of whether chiropratical intevention works for backpain, I think it’s very hard to say for most alternative medicine approaches that have seen a lot less research what effects they have and could be demonstrated if you fund them as a serious paradigm.
In medicine most of the journals endorse the CONSORT guidelines yet their peer-review processes don’t make sure that the clear quality standards of the CONSORT guidelines are followed in a majority of published papers.
Blinding peer-review doesn’t help at all with encourages paradigm violating papers. Instead of succeding at forcing the quality standards they endorse on the papers they publish, mainstream journals do succeed at not publishing any papers that violate the mainsteam paradigm.
Again: you are conflating the descriptive and the normative. You are all the time giving examples of how science went wrong. And that may have well been the case. What I am saying is that, there are tools to mitigate these problems. In order to challenge my points, you’d have to show that chriopractics did not appear even worthy of pursuit *in view of the criteria I mentioned above* and yet it should have been pursued (I am not familiar with this branch of science, btw, so I don’t have enough knowledge to say anything concerning its current status). But even if you could do this, this would be an extremely odd example, so you’d have to come up with a couple of them to make a normatively interesting point. Of course, I’d be happy to hear about that.
The confusion between the desctiptive (how things are) and the normative (how they should be) concerns also your comments on peer review, where you are bringing issues that are problematic in the current medical practice, but I don’t see why we should consider them inherent to the peer-review procedure as such. Your points concern the presence of biases in science which make paradigmatic changes difficult, and that may indeed be a problem, but I don’t see how abandoning the peer-review procedure is going to solve it.
I agree that some notion of past fruitfulness and further promise is important. It’s however hard to judge fruitfulness from the outside as a lot of the progress within a new paradigm might not be intelligible in the old paradigms.
If you would have asked chiropractors in the 20th century whether they made theoretical progress, I would guess that you would get answer about how their theory progressed. If you however asked any mainstream medicine academic you would likely get the answer that they didn’t produce anything useful.
The standard peer review is a heavily standardized process that makes specific assumptions about the shape of knowledge.
The ontology of special relations is something that matters for science but I can have that discussion Github. Github does provide for a way of “peer-review” but it’s very different then the way traditional scientific papers work.
When I look at that discussion, it’s also funny that both the person I’m speaking with and I have both studied bioinformatics.
Bioinformatics as a field managed to share a lot of knowledge openly through ways besides scientific papers. It wouldn’t be surprising to me when the DSM gets one day replaced by a well developed ontology created with a more bioinformatical paradigm.
The database that comes out of the money from Zuckerberg will also be likely more scientifically valuable then any classical academic papers written about it.
Te problem of disagreements that arise due to different paradigms or ‘schools of thought’, which you mention, is an important problem as it concerns the possibility of so-called rational disagreements in science. This paper (published here) makes an attempt at providing a normative framework for such situations, suggesting that if scientists have at least some indications that the claims of their opponent is a result of a rational deliberation, they should epistemically tolerate their ideas, which means: they should treat them as potentially rational, their theory as potentially promising, and as a potential challenge to their own stance.
Of course, the main challenge for epistemic toleration is putting ourselves in the other one’s shoes :) Like in the example you mention: if the others are working on an approach that is completely different from mine, it won’t be easy for me to agree with everything they say, but that doesn’t mean I should equate them with some junk scientists.
As for discussions via Github, that’s interesting and probably we could discuss this in a separate thread, on the topic of different forms of scientific interaction. I think that peer-review can also be a useful form of dialogue, specially since a paper may end up going through different rounds of peer-review (sometimes also across different journals, in case it gets rejected in the beginning). However, preprint archives that we have nowadays are also valuable, since even if a paper keeps on being rejected (let’s say unfairly, e.g. due to a dogmatic environment in the given discipline), others may still have access to it, cite it, and it may still have an impact.
Chiropractics was long considered to be pseudo-medicine because it rests on the perceptive ability of it’s practioners. Yet, according to Cochrane we now know that their interventions have effects that are comparable to our mainstream treatments for backpain.
The useless paradigm of domestic science had a lot of esteem in the 20th centure while chiropratics had none. Given that it took this long to settle simply question of whether chiropratical intevention works for backpain, I think it’s very hard to say for most alternative medicine approaches that have seen a lot less research what effects they have and could be demonstrated if you fund them as a serious paradigm.
In medicine most of the journals endorse the CONSORT guidelines yet their peer-review processes don’t make sure that the clear quality standards of the CONSORT guidelines are followed in a majority of published papers.
Blinding peer-review doesn’t help at all with encourages paradigm violating papers. Instead of succeding at forcing the quality standards they endorse on the papers they publish, mainstream journals do succeed at not publishing any papers that violate the mainsteam paradigm.
Again: you are conflating the descriptive and the normative. You are all the time giving examples of how science went wrong. And that may have well been the case. What I am saying is that, there are tools to mitigate these problems. In order to challenge my points, you’d have to show that chriopractics did not appear even worthy of pursuit *in view of the criteria I mentioned above* and yet it should have been pursued (I am not familiar with this branch of science, btw, so I don’t have enough knowledge to say anything concerning its current status). But even if you could do this, this would be an extremely odd example, so you’d have to come up with a couple of them to make a normatively interesting point. Of course, I’d be happy to hear about that.
The confusion between the desctiptive (how things are) and the normative (how they should be) concerns also your comments on peer review, where you are bringing issues that are problematic in the current medical practice, but I don’t see why we should consider them inherent to the peer-review procedure as such. Your points concern the presence of biases in science which make paradigmatic changes difficult, and that may indeed be a problem, but I don’t see how abandoning the peer-review procedure is going to solve it.
I agree that some notion of past fruitfulness and further promise is important. It’s however hard to judge fruitfulness from the outside as a lot of the progress within a new paradigm might not be intelligible in the old paradigms.
If you would have asked chiropractors in the 20th century whether they made theoretical progress, I would guess that you would get answer about how their theory progressed. If you however asked any mainstream medicine academic you would likely get the answer that they didn’t produce anything useful.
The standard peer review is a heavily standardized process that makes specific assumptions about the shape of knowledge.
The ontology of special relations is something that matters for science but I can have that discussion Github. Github does provide for a way of “peer-review” but it’s very different then the way traditional scientific papers work.
When I look at that discussion, it’s also funny that both the person I’m speaking with and I have both studied bioinformatics.
Bioinformatics as a field managed to share a lot of knowledge openly through ways besides scientific papers. It wouldn’t be surprising to me when the DSM gets one day replaced by a well developed ontology created with a more bioinformatical paradigm.
The database that comes out of the money from Zuckerberg will also be likely more scientifically valuable then any classical academic papers written about it.
Te problem of disagreements that arise due to different paradigms or ‘schools of thought’, which you mention, is an important problem as it concerns the possibility of so-called rational disagreements in science. This paper (published here) makes an attempt at providing a normative framework for such situations, suggesting that if scientists have at least some indications that the claims of their opponent is a result of a rational deliberation, they should epistemically tolerate their ideas, which means: they should treat them as potentially rational, their theory as potentially promising, and as a potential challenge to their own stance.
Of course, the main challenge for epistemic toleration is putting ourselves in the other one’s shoes :) Like in the example you mention: if the others are working on an approach that is completely different from mine, it won’t be easy for me to agree with everything they say, but that doesn’t mean I should equate them with some junk scientists.
As for discussions via Github, that’s interesting and probably we could discuss this in a separate thread, on the topic of different forms of scientific interaction. I think that peer-review can also be a useful form of dialogue, specially since a paper may end up going through different rounds of peer-review (sometimes also across different journals, in case it gets rejected in the beginning). However, preprint archives that we have nowadays are also valuable, since even if a paper keeps on being rejected (let’s say unfairly, e.g. due to a dogmatic environment in the given discipline), others may still have access to it, cite it, and it may still have an impact.