skulk-and-quarrel comments on RLHF does not appear to differentially cause mode-collapse

[skulk-and-quarrel]

The impact in ChatGPT could be potentially due to longer prompts or the “system prompt”. It would be great to test that in a similar analysis