neverix comments on Is InstructGPT Following Instructions in Other Languages Surprising?

[neverix]

Is RLHF updating abstract circuits an established fact? Why would it suffer from mode collapse in that case?