A lot of the details are up in the air – over the next week I plan to write out a lot of my thoughts and open questions about the review process, and how it should feel into the overall end product.
One option is to include a curated selection of comments from the post. Another is to sort of leave that up to reviewers, to distill those comments down into a more succinct encapsulation of them. In some cases it might be that the commenters “got it right the first time”, and basically wrote a fine “review-like comment” back in 2018, and there should be some way of marking an old comment as a review, retroactively.
A middle ground might be something like “in addition to summarizing key points from the previous discussion, reviewers can point to particular comments that seem worth including”.
In the end, the editors will make some judgment calls about how much fits – we definitely wouldn’t include the entire comment section of Circling. My guess is that the upper bound of “amount of comments and/or reviews from a given post to include” is roughly the same as “the upper bound for a post.” (In some cases posts are quite long, but maybe expect the median comments/reviews-length to be comparable to the median post length)
A lot of the details are up in the air – over the next week I plan to write out a lot of my thoughts and open questions about the review process, and how it should feel into the overall end product.
One option is to include a curated selection of comments from the post. Another is to sort of leave that up to reviewers, to distill those comments down into a more succinct encapsulation of them. In some cases it might be that the commenters “got it right the first time”, and basically wrote a fine “review-like comment” back in 2018, and there should be some way of marking an old comment as a review, retroactively.
A middle ground might be something like “in addition to summarizing key points from the previous discussion, reviewers can point to particular comments that seem worth including”.
In the end, the editors will make some judgment calls about how much fits – we definitely wouldn’t include the entire comment section of Circling. My guess is that the upper bound of “amount of comments and/or reviews from a given post to include” is roughly the same as “the upper bound for a post.” (In some cases posts are quite long, but maybe expect the median comments/reviews-length to be comparable to the median post length)