Another example: Notion, the popular wiki/information management tool, just announced an AI-powered writing assistant. Now, they haven’t announced specifically that it’s using a LLM, but if you look at the demo, it’s hard to imagine what else it could be.
to be honest I’m slightly confused about your phrasing; it looks like they demonstrate the output of a language model on the page, and so the only question left is whether it’s transformers or some swanky high speed RWKV thing or other
no I mean, that would still be an LLM. just not a transformer-based one. to not be an LLM you have to train it on significantly less text data, I think. maybe I would also count training on sufficiently much other modality data. by its behavior we can know that it could only possibly be an LLM, there could be no other AI algorithm that outputs text like that without satisfying the constraint of “is LLM”.
Oh, I guess I misunderstood what you were saying. Yes, I agree that nothing else produces output like that. I was just pointing out that Notion haven’t come out and explicitly stated what, specifically, they’re using to do this.
yeah could be any LLM. It does feel like an ungrounded generative model like most LLMs right now, but maybe it’s some swanky new physical model based thing, you never know.
Another example: Notion, the popular wiki/information management tool, just announced an AI-powered writing assistant. Now, they haven’t announced specifically that it’s using a LLM, but if you look at the demo, it’s hard to imagine what else it could be.
to be honest I’m slightly confused about your phrasing; it looks like they demonstrate the output of a language model on the page, and so the only question left is whether it’s transformers or some swanky high speed RWKV thing or other
I wasn’t aware of RWKV until you mentioned it. Fair enough. It’s possible that they’re using that instead of a LLM.
no I mean, that would still be an LLM. just not a transformer-based one. to not be an LLM you have to train it on significantly less text data, I think. maybe I would also count training on sufficiently much other modality data. by its behavior we can know that it could only possibly be an LLM, there could be no other AI algorithm that outputs text like that without satisfying the constraint of “is LLM”.
Oh, I guess I misunderstood what you were saying. Yes, I agree that nothing else produces output like that. I was just pointing out that Notion haven’t come out and explicitly stated what, specifically, they’re using to do this.
yeah could be any LLM. It does feel like an ungrounded generative model like most LLMs right now, but maybe it’s some swanky new physical model based thing, you never know.