My impression is that people think it is possible to have a transformative AI without solving context window problem. Why do you think it is a must? Can’t AI still work without it?
I’m not sure it’ a must—hence “or something”—I just used it as a general example of some currently unsolved problem that may result in capability plateau. I do have an intuition that context window may help based on “it’s harder for me to think without using memory”.
I honestly would like more detailed investigation into why we can’t just fail to solve increasing context window for the next 100 years or something.
My impression is that people think it is possible to have a transformative AI without solving context window problem. Why do you think it is a must? Can’t AI still work without it?
I’m not sure it’ a must—hence “or something”—I just used it as a general example of some currently unsolved problem that may result in capability plateau. I do have an intuition that context window may help based on “it’s harder for me to think without using memory”.