I want to point out that insight 6 has less value in the current day, since it looks like the reversal curse turns out to be fixable very simply, and I agree with @gwern that the research was just a bit too half-baked for the extensive discussion it got:
I want to point out that insight 6 has less value in the current day, since it looks like the reversal curse turns out to be fixable very simply, and I agree with @gwern that the research was just a bit too half-baked for the extensive discussion it got:
https://www.lesswrong.com/posts/SCqDipWAhZ49JNdmL/paper-llms-trained-on-a-is-b-fail-to-learn-b-is-a#FLzuWQpEmn3hTAtqD
https://www.lesswrong.com/posts/SCqDipWAhZ49JNdmL/paper-llms-trained-on-a-is-b-fail-to-learn-b-is-a#3cAiWvHjEeCffbcof