I don’t really disagree with any of that, but yeah I think you might be missing the issue of curation, which is kind of most of the work that journals do. A revolutionary publication, before being widely recognized, will look just like an error. Most of the time, it will turn out to be an error. Fully evaluating it takes time and energy, and if no one is paying reviewers to do that, it’s generally totally unrewarding work and no one will do it and the diamonds in the rough wont be made discoverable. If you understand why we must reward the boring work of replication, you will also understand why we must reward the boring work of reading probably-bad submissions from unknowns and writing thoughtful reviews/recommending them for promotion in different lists.
My tasteweb will help a bit with curation, but it’s essentially a way of using voluntary moderation/curation work much more efficiently, the rewards for contributing are immaterial, sometimes nonexistent, sometimes negative (popular curators have to deal with a lot of moderation issues). I think it’ll inject a lot of life into academic dialog, but I don’t think it will be enough to fix academic publishing. It might fix publishing/discoverability in a lot of other aspects of life where the entities being curated aren’t so hard to judge, though. I haven’t thought much about compensated review processes, but I always feel the issue looming on the other side of the hill. It’s not going to go away.
By the way, do you know about dSocialCommons? It grew out of twitter’s social network federation project, but the discord has become a bit of a meeting point for our sorts https://dsocialcommons.org/
I don’t really disagree with any of that, but yeah I think you might be missing the issue of curation, which is kind of most of the work that journals do.
A revolutionary publication, before being widely recognized, will look just like an error. Most of the time, it will turn out to be an error. Fully evaluating it takes time and energy, and if no one is paying reviewers to do that, it’s generally totally unrewarding work and no one will do it and the diamonds in the rough wont be made discoverable.
If you understand why we must reward the boring work of replication, you will also understand why we must reward the boring work of reading probably-bad submissions from unknowns and writing thoughtful reviews/recommending them for promotion in different lists.
My tasteweb will help a bit with curation, but it’s essentially a way of using voluntary moderation/curation work much more efficiently, the rewards for contributing are immaterial, sometimes nonexistent, sometimes negative (popular curators have to deal with a lot of moderation issues). I think it’ll inject a lot of life into academic dialog, but I don’t think it will be enough to fix academic publishing. It might fix publishing/discoverability in a lot of other aspects of life where the entities being curated aren’t so hard to judge, though.
I haven’t thought much about compensated review processes, but I always feel the issue looming on the other side of the hill. It’s not going to go away.
By the way, do you know about dSocialCommons? It grew out of twitter’s social network federation project, but the discord has become a bit of a meeting point for our sorts https://dsocialcommons.org/