At least in theory, the comments, particularly a ‘related work’ comment-tree, would do that already by talking about other LW articles as relevant. (All of which the LLM should know by heart due to the finetuning.)
Might not work out of the box, of course, in which case you could try to fix that. You could do a regular nearest-neighbors-style look up and just send that to the author as a comment (“here are the 20 most similar LW articles:”); or you could elaborate the virtual comments by adding a retrieval step and throwing into the prompt metadata about ‘similar’ articles as the draft, so the generated comments are much more likely to reference them.
Can we add retrieval augmentation to this? Something that, as you are writing your article, goes: “Have you read this other article?”
At least in theory, the comments, particularly a ‘related work’ comment-tree, would do that already by talking about other LW articles as relevant. (All of which the LLM should know by heart due to the finetuning.)
Might not work out of the box, of course, in which case you could try to fix that. You could do a regular nearest-neighbors-style look up and just send that to the author as a comment (“here are the 20 most similar LW articles:”); or you could elaborate the virtual comments by adding a retrieval step and throwing into the prompt metadata about ‘similar’ articles as the draft, so the generated comments are much more likely to reference them.