Victor Ashioya comments on Victor Ashioya’s Shortform

[Victor Ashioya]

Also, another interesting detail is that PPO still shows superior performance on RLHF testbeds.