At the very least, I suspect one of the analyses will be ‘bucketize corresponding to certainty, then plot “what % of responses in bucket were right?”’ - something that was done last year (see 2013 LessWrong Survey Results)
Last year it was broken down into “elite” and “typical” LW-er groups, which presumably would tell you if hanging out here made you better at overconfidence, or something similar in that general vicinity.
At the very least, I suspect one of the analyses will be ‘bucketize corresponding to certainty, then plot “what % of responses in bucket were right?”’ - something that was done last year (see 2013 LessWrong Survey Results)
Last year it was broken down into “elite” and “typical” LW-er groups, which presumably would tell you if hanging out here made you better at overconfidence, or something similar in that general vicinity.