The expertise problem is one of Wikipedia’s perennial headaches. Whereas most actual experts are happy to talk about their field with interested amateurs and even take their ideas seriously, structurally it’s just about impossible to keep an indefinitely renewed supply of idiots out of the experts’ faces on Wikipedia.
Just giving experts primacy was tried by Citizendium and failed badly—the token of expertise used was credentials and it turns out that cranks care a lot more about credentials than actual experts do, so the cranks moved in and CZ became known for pseudoscience.
I don’t know of other ideas for how to keep idiots out of experts’ faces, and I’ve been around English Wikipedia for seven years now. Any are welcomed, even if we or someone has likely tried them already.
No good ideas for Wikipedia, but I’ve been wondering a bit about this in general. If we could somehow get a largish group of people generally agreed to be experts actively using a large-scale online reputation system where they start out marked as such, we could write an algorithm that gives stuff and people get expert cred when they are upvoted by the established experts. Could the algorithm be designed to set up a perpetuating and non-decaying reputation cluster of actual experts, while not being swamped by populist crap despite some of it getting tons of non-expert votes?
It is a domain-specific community (everything about software development), in the form of questions and answers. Reputation is earned by upvotes from other community members. Naturally, the established experts emerge as high-reputation members, being those with a long history of giving good answers.
Stack Overflow is just one (and the original) of a set of sites/communities on the same software, Stack Exchange. Each site has its own reputation scores for users, on the principle that someone who is knowledgeable (and sensible) on a given topic isn’t necessarily so on another (though there is a +100 cross-signup bonus, presumably on the “OK, you’re not an unknown fresh pseudonym” basis).
Avoiding populism problems: Stack Exchange specifically avoids “general interest” in favor of sites with specific topics, and moderation discourages “populist crap” of the “What are your favorite X” / “How do you feel about X” sort.
The format draws a sharp distinction between questions and answers and meta-discussion thereof (either in the form of “comments” or the full-scale meta-discussion site) in order to increase signal-to-noise.
(In case you haven’t noticed, I think they’re doing a lot of things right and right things, in terms of creating a valuable resource and community.)
(Should there be a top-level post about SO/SE? I don’t know that I could write it.)
StackExchange makes no distinction between up-votes from experts and up-votes from idiots. The way I read Risto’s suggestion is that the people get cred only from up-votes from experts. This is why it has to be seeded with experts.
The expertise problem is one of Wikipedia’s perennial headaches. Whereas most actual experts are happy to talk about their field with interested amateurs and even take their ideas seriously, structurally it’s just about impossible to keep an indefinitely renewed supply of idiots out of the experts’ faces on Wikipedia.
Just giving experts primacy was tried by Citizendium and failed badly—the token of expertise used was credentials and it turns out that cranks care a lot more about credentials than actual experts do, so the cranks moved in and CZ became known for pseudoscience.
I don’t know of other ideas for how to keep idiots out of experts’ faces, and I’ve been around English Wikipedia for seven years now. Any are welcomed, even if we or someone has likely tried them already.
No good ideas for Wikipedia, but I’ve been wondering a bit about this in general. If we could somehow get a largish group of people generally agreed to be experts actively using a large-scale online reputation system where they start out marked as such, we could write an algorithm that gives stuff and people get expert cred when they are upvoted by the established experts. Could the algorithm be designed to set up a perpetuating and non-decaying reputation cluster of actual experts, while not being swamped by populist crap despite some of it getting tons of non-expert votes?
″ we could write an algorithm that gives stuff and people get expert cred when they are upvoted by the established experts”
Sounds like StackOverflow (http://stackoverflow.com)
It is a domain-specific community (everything about software development), in the form of questions and answers. Reputation is earned by upvotes from other community members. Naturally, the established experts emerge as high-reputation members, being those with a long history of giving good answers.
Stack Overflow is just one (and the original) of a set of sites/communities on the same software, Stack Exchange. Each site has its own reputation scores for users, on the principle that someone who is knowledgeable (and sensible) on a given topic isn’t necessarily so on another (though there is a +100 cross-signup bonus, presumably on the “OK, you’re not an unknown fresh pseudonym” basis).
Avoiding populism problems: Stack Exchange specifically avoids “general interest” in favor of sites with specific topics, and moderation discourages “populist crap” of the “What are your favorite X” / “How do you feel about X” sort.
The format draws a sharp distinction between questions and answers and meta-discussion thereof (either in the form of “comments” or the full-scale meta-discussion site) in order to increase signal-to-noise.
(In case you haven’t noticed, I think they’re doing a lot of things right and right things, in terms of creating a valuable resource and community.)
(Should there be a top-level post about SO/SE? I don’t know that I could write it.)
Did anyone write this top-level SO/SE post, as a model for charities built around capturing time rather than money?
StackExchange makes no distinction between up-votes from experts and up-votes from idiots. The way I read Risto’s suggestion is that the people get cred only from up-votes from experts. This is why it has to be seeded with experts.
Stack Overflow and other forums dedicated to a specific topic don’t have quite the same populism problem as general interest forums do.
What about Quora?