quetzal_rainbow comments on DPO/​PPO-RLHF on LLMs incentivizes sycophancy, exaggeration and deceptive hallucination, but not misaligned powerseeking

[quetzal_rainbow]

My point is that RLHF incentivizes all sorts of tnings and these things depend on content of trained model, not on what RLHF is.

[tailcalled]

It depends on both.