Refer my other reply here. And as the post mentions, RLHF also does exhibit mode collapse (check the section on prior work).
Refer my other reply here. And as the post mentions, RLHF also does exhibit mode collapse (check the section on prior work).