I am unconvinced that “the” reliability issue is a single issue that will be solved by a single insight, rather than AIs lacking procedural knowledge of how to handle a bunch of finicky special cases that will be solved by online learning or very long context windows once hardware costs decrease enough to make one of those approaches financially viable.
Yeah, I’m sympathetic to this argument that there won’t be a single insight, and that at least one approach will work out once hardware costs decrease enough, and I agree less with Thane Ruthenis’s intuitions here than I did before.
I am unconvinced that “the” reliability issue is a single issue that will be solved by a single insight, rather than AIs lacking procedural knowledge of how to handle a bunch of finicky special cases that will be solved by online learning or very long context windows once hardware costs decrease enough to make one of those approaches financially viable.
Yeah, I’m sympathetic to this argument that there won’t be a single insight, and that at least one approach will work out once hardware costs decrease enough, and I agree less with Thane Ruthenis’s intuitions here than I did before.