I agree that it’s plausible they are doing snippets of highly specialized algorithms that could be viewed as shards[1] of AGI cognition. I would still be very impressed if they could find algorithms of even that level of complexity in such large models. That’s what I meant by the word salad of a second sentence I wrote.
Not value shards, to be clear. Rather, something like a specialized form of an algorithm working on resctricted inputs and or a bunch of heuristics that approximate the full algorithm.
I agree that it’s plausible they are doing snippets of highly specialized algorithms that could be viewed as shards[1] of AGI cognition. I would still be very impressed if they could find algorithms of even that level of complexity in such large models. That’s what I meant by the word salad of a second sentence I wrote.
Not value shards, to be clear. Rather, something like a specialized form of an algorithm working on resctricted inputs and or a bunch of heuristics that approximate the full algorithm.