I have a list of specific technical advances in algorithms/architecture that I suspect will push these open-source LLMs further in capabilities when integrated. Especially increasing effective agency & strategic planning. I think these advances, if like 80% of them are discovered and are as successful as I expect, are enough with like a 65 billion or so param LLM, to begin a successful RSI process. Slow at first, but able to accelerate since I still think there’s a lot of algorithmic efficiency gain sitting on the table. What I don’t know is what to do about that scenario. If this is the case, then the world is going to look pretty crazy a couple years from now.
I have a list of specific technical advances in algorithms/architecture that I suspect will push these open-source LLMs further in capabilities when integrated. Especially increasing effective agency & strategic planning. I think these advances, if like 80% of them are discovered and are as successful as I expect, are enough with like a 65 billion or so param LLM, to begin a successful RSI process. Slow at first, but able to accelerate since I still think there’s a lot of algorithmic efficiency gain sitting on the table. What I don’t know is what to do about that scenario. If this is the case, then the world is going to look pretty crazy a couple years from now.