Set up a website where people can submit artistic works—poetry, drawings, short stories, maybe even pictures of themselves—and it’s expected rating on a 1-10 scale.
The works would be publicly displayed, but anonymously, and visitors could rate them (“nonymously” is to make sure the ratings are “global” and not “compared to other work by the same guy”—so maybe the author could be displayed once you rated it).
You could then compare the expected rating of a work to the actual ratings it received, and see how much the author under- or over-estimates himself.
(for extra measurment of calibration, you could also ask the author to give a confidence factor, though I’m not sure how exactly it should be presented and calculated)
Your own art has the advantage of being something about which you might be systematically biased, and which can still be evaluated pretty easily (as opposed to predictions about how to get out of the financial crisis).
Set up a website where people can submit artistic works—poetry, drawings, short stories, maybe even pictures of themselves—and it’s expected rating on a 1-10 scale.
The works would be publicly displayed, but anonymously, and visitors could rate them (“nonymously” is to make sure the ratings are “global” and not “compared to other work by the same guy”—so maybe the author could be displayed once you rated it).
You could then compare the expected rating of a work to the actual ratings it received, and see how much the author under- or over-estimates himself.
(for extra measurment of calibration, you could also ask the author to give a confidence factor, though I’m not sure how exactly it should be presented and calculated)
Your own art has the advantage of being something about which you might be systematically biased, and which can still be evaluated pretty easily (as opposed to predictions about how to get out of the financial crisis).