It’s very interesting that even quite recently ICL was considered to be “an impossible Holy Grail goal”, with the assumption that models always need to see many examples to learn anything new (and so they are inherently inferior to biological learners in this sense).
And now we have this strong ICL ability and this gap with biological learners is gone...
Yes, I agree with that.
It’s very interesting that even quite recently ICL was considered to be “an impossible Holy Grail goal”, with the assumption that models always need to see many examples to learn anything new (and so they are inherently inferior to biological learners in this sense).
And now we have this strong ICL ability and this gap with biological learners is gone...