Clarification on The Bitter Lesson and Data Efficiency
I thought this exchange provided some much-needed clarification on The Bitter Lesson that I think many people don’t realize, so I figured I’d share it here:
Lecun responds:
Then, Richard Sutton agrees with Yann. Someone asks him:
Yes, but despite the Bitter Lesson being quite short, many people have not read the original text and are just taking the ‘scale is all you need’ telephone game discussion of it.
Clarification on The Bitter Lesson and Data Efficiency
I thought this exchange provided some much-needed clarification on The Bitter Lesson that I think many people don’t realize, so I figured I’d share it here:
Lecun responds:
Then, Richard Sutton agrees with Yann. Someone asks him:
It’s clear from Sutton’s original article. https://www.lesswrong.com/posts/sTDfraZab47KiRMmT/views-on-when-agi-comes-and-on-strategy-to-reduce#The_bitter_lesson_and_the_success_of_scaling
Yes, but despite the Bitter Lesson being quite short, many people have not read the original text and are just taking the ‘scale is all you need’ telephone game discussion of it.