“This won’t work, for the same reason PageRank did not work”
I am very confused by this. Google’s search vastly outperformed its competitors with PageRank and is still using a heavily tweaked version of PageRank to this day, delivering by far the best search on the market. It seems to me that PageRank should widely be considered to be the most successful reputation algorithm that has ever been invented, having demonstrated extraordinary real-world success. In what way does it make sense to say “PageRank did not work”?
Google is using a much more complicated algorithm that is constantly tweaked, and is a trade secret—precisely because as soon as it became profitable to do so, the ecosystem proceeded to game the hell out of PageRank.
Google hasn’t been using PageRank-as-in-the-paper for ages. The real secret sauce behind Google is not eigenvalues, it’s the fact that it’s effectively anti-inductive, because the algorithm isn’t open and there is an army of humans looking for attempts to game it, and modifying it as soon as such an attempt is found.
Given that, it seems equally valid to say “this will work, for the same reason that PageRank worked”, i.e., we can also tweak the reputation algorithm as people try to attack it. We don’t have as much resources as Google, but then we also don’t face as many attackers (with as strong incentives) as Google does.
I personally do prefer a forum with karma numbers, to help me find quality posts/comments/posters that I would likely miss or have to devote a lot of time and effort to sift through.
I am not really trying to be negative for the sake of being negative here, I am trying to correctly attribute success to the right thing. People get “halo effect” in their head because “eigenvalues” sound nice and clean.
Reputation systems, though, aren’t the type of problem that linear algebra will solve for you. And this isn’t too surprising. People are involved with reputation systems, and people are far too complex for linear algebra to model properly.
people are far too complex for linear algebra to model properly
True, but not particularly relevant. Reputation systems like karma will not solve the problem of who to trust or who to pay attention to—but they are not intended to. Their task is to be merely helpful to humans navigating the social landscape. They do not replace networking, name recognition, other reputation measures, etc.
“This won’t work, for the same reason PageRank did not work”
I am very confused by this. Google’s search vastly outperformed its competitors with PageRank and is still using a heavily tweaked version of PageRank to this day, delivering by far the best search on the market. It seems to me that PageRank should widely be considered to be the most successful reputation algorithm that has ever been invented, having demonstrated extraordinary real-world success. In what way does it make sense to say “PageRank did not work”?
FWIW, I worked at Google about a decade ago, and even then, PageRank was basically no longer used. I can’t imagine it’s gotten more influence since.
It did work, but I got the strong sense that it no longer worked.
Google is using a much more complicated algorithm that is constantly tweaked, and is a trade secret—precisely because as soon as it became profitable to do so, the ecosystem proceeded to game the hell out of PageRank.
Google hasn’t been using PageRank-as-in-the-paper for ages. The real secret sauce behind Google is not eigenvalues, it’s the fact that it’s effectively anti-inductive, because the algorithm isn’t open and there is an army of humans looking for attempts to game it, and modifying it as soon as such an attempt is found.
Given that, it seems equally valid to say “this will work, for the same reason that PageRank worked”, i.e., we can also tweak the reputation algorithm as people try to attack it. We don’t have as much resources as Google, but then we also don’t face as many attackers (with as strong incentives) as Google does.
I personally do prefer a forum with karma numbers, to help me find quality posts/comments/posters that I would likely miss or have to devote a lot of time and effort to sift through.
It’s not PageRank that worked, it’s anti-induction that worked. PageRank did not work, as soon as it faced resistance.
You really are a “glass half empty” kind of guy aren’t you.
I am not really trying to be negative for the sake of being negative here, I am trying to correctly attribute success to the right thing. People get “halo effect” in their head because “eigenvalues” sound nice and clean.
Reputation systems, though, aren’t the type of problem that linear algebra will solve for you. And this isn’t too surprising. People are involved with reputation systems, and people are far too complex for linear algebra to model properly.
True, but not particularly relevant. Reputation systems like karma will not solve the problem of who to trust or who to pay attention to—but they are not intended to. Their task is to be merely helpful to humans navigating the social landscape. They do not replace networking, name recognition, other reputation measures, etc.