Vladimir_Nesov comments on Take 10: Fine-tuning with RLHF is aesthetically unsatisfying.

[Vladimir_Nesov]

Thanks for the link to porby post on modularity and goal agnosticism, that’s an overlooked goldmine.