Quick note that I personally didn’t look at the post mostly due to opportunity cost of lots of other posts in the review.
I also think we should maybe run a filter on the votes that only takes AlignmentForum users, and check what the AF consensus on alignment-related posts was. Which may not end up mattering here, but I know I personally avoided voting on a lot of alignment stuff because I didn’t feel like I could evaluate them well, and wouldn’t be surprised if other people did that as well.
I also ended up voting 0 on a large amount of AI Alignment stuff, because the overhead required to make judgments that would add value seemed too large, so better not to vote on those.
Seems like a good thing to check in principle, but my guess is it won’t make much difference for this or other posts. AI posts got about as many nonzero votes as other posts, and the ranking of posts by avg vote is almost the same as the official ranking by total votes.
I also think we should maybe run a filter on the votes that only takes AlignmentForum users, and check what the AF consensus on alignment-related posts was.
I would definitely be interested in seeing this. I certainly put a lot of my votes in Thoughts on Human Models, since I agree it’s a great post (and also nominated it for the review in the first place).
I know I personally avoided voting on a lot of alignment stuff because I didn’t feel like I could evaluate them well, and wouldn’t be surprised if other people did that as well.
I wonder if this suggests that you should be using a voting system that averages votes rather than summing them, thereby assigning people who didn’t vote on a post the average vote rather than a zero vote.
This was my thought as well – I expect a majority of readers won’t understand AI-related posts in the first place, let alone how they fit into the larger picture.
Quick note that I personally didn’t look at the post mostly due to opportunity cost of lots of other posts in the review.
I also think we should maybe run a filter on the votes that only takes AlignmentForum users, and check what the AF consensus on alignment-related posts was. Which may not end up mattering here, but I know I personally avoided voting on a lot of alignment stuff because I didn’t feel like I could evaluate them well, and wouldn’t be surprised if other people did that as well.
I also ended up voting 0 on a large amount of AI Alignment stuff, because the overhead required to make judgments that would add value seemed too large, so better not to vote on those.
Seems like a good thing to check in principle, but my guess is it won’t make much difference for this or other posts. AI posts got about as many nonzero votes as other posts, and the ranking of posts by avg vote is almost the same as the official ranking by total votes.
I would definitely be interested in seeing this. I certainly put a lot of my votes in Thoughts on Human Models, since I agree it’s a great post (and also nominated it for the review in the first place).
I wonder if this suggests that you should be using a voting system that averages votes rather than summing them, thereby assigning people who didn’t vote on a post the average vote rather than a zero vote.
This was my thought as well – I expect a majority of readers won’t understand AI-related posts in the first place, let alone how they fit into the larger picture.