My impression is that people think it is possible to have a transformative AI without solving context window problem. Why do you think it is a must? Can’t AI still work without it?
I’m not sure it’ a must—hence “or something”—I just used it as a general example of some currently unsolved problem that may result in capability plateau. I do have an intuition that context window may help based on “it’s harder for me to think without using memory”.
My impression is that people think it is possible to have a transformative AI without solving context window problem. Why do you think it is a must? Can’t AI still work without it?
I’m not sure it’ a must—hence “or something”—I just used it as a general example of some currently unsolved problem that may result in capability plateau. I do have an intuition that context window may help based on “it’s harder for me to think without using memory”.