I had been worried about this earlier in the design-process for the review. A major reason I didn’t object to the system we ended up with is...
...well, if you tell people “evaluate these posts for truth/usefulness”, but clearly the results of the vote are going to translate into prestige, it seems like it makes the situation worse rather than better if you try to pretend otherwise.
But I think I might be interested in experimenting in another direction next year, where the vote isn’t focused on relative ranking of posts at all, instead it’s more like a survey where people answer qualitative questions, like:
Have you thought about the ideas in this post in the past year?
Do the ideas in this post seem important?
How do you feel about this post’s epistemics
Should this post appear in a public-facing Best of LW book?
Should this post appear in an inward-facing, high-context LW Journal?
I had been worried about this earlier in the design-process for the review. A major reason I didn’t object to the system we ended up with is...
...well, if you tell people “evaluate these posts for truth/usefulness”, but clearly the results of the vote are going to translate into prestige, it seems like it makes the situation worse rather than better if you try to pretend otherwise.
But I think I might be interested in experimenting in another direction next year, where the vote isn’t focused on relative ranking of posts at all, instead it’s more like a survey where people answer qualitative questions, like:
Have you thought about the ideas in this post in the past year?
Do the ideas in this post seem important?
How do you feel about this post’s epistemics
Should this post appear in a public-facing Best of LW book?
Should this post appear in an inward-facing, high-context LW Journal?