This is honestly some of the most significant alignment work I’ve seen in recent years (for reasons I plan to post on shortly), thank you for going to all this length!
Typo: “Thoughout this process test loss remains low—even a partial memorising solution still performs extremely badly on unseen data!”, ‘low’ should be ‘high’ (and ‘throughout’ is misspelled too).
Thanks, I really appreciate it. Though I wouldn’t personally consider this among the significant alignment work, and would love to hear about why you do!
This is honestly some of the most significant alignment work I’ve seen in recent years (for reasons I plan to post on shortly), thank you for going to all this length!
Typo: “Thoughout this process test loss remains low—even a partial memorising solution still performs extremely badly on unseen data!”, ‘low’ should be ‘high’ (and ‘throughout’ is misspelled too).
Thanks, I really appreciate it. Though I wouldn’t personally consider this among the significant alignment work, and would love to hear about why you do!