When you start trying to make an agent, you realize how much your feedback, rerolls, etc are making chat based llms useful
the error correction mechanism is you in a chat based llms, and in the absence of that, it’s quite easy for agents to get off track
you can of course add error correction mechanism like multiple llms checking each other, multiple chains of thought, etc, but the cost can quickly get out of hand
Is answer assumes that you either have a fully chat based version or one that operates fully autonomous.
You could build something in the middle where every step of the agent gets presented to a human who can press next or correct the agent. An agent might even propose multiple ways forward and let the human decide. That then produces the training data for the agent to get better in the future.
I’ve been using Aider recently with coding. It’s a mixed bag, but overall I think I like it. You can configure whether it just acts, or asks for permission first.
When you start trying to make an agent, you realize how much your feedback, rerolls, etc are making chat based llms useful
the error correction mechanism is you in a chat based llms, and in the absence of that, it’s quite easy for agents to get off track
you can of course add error correction mechanism like multiple llms checking each other, multiple chains of thought, etc, but the cost can quickly get out of hand
Is answer assumes that you either have a fully chat based version or one that operates fully autonomous.
You could build something in the middle where every step of the agent gets presented to a human who can press next or correct the agent. An agent might even propose multiple ways forward and let the human decide. That then produces the training data for the agent to get better in the future.
This exists and is getting more popular, especially with coding, but also in other verticals
Which one’s do you see as the top ones?
I’ve been using Aider recently with coding. It’s a mixed bag, but overall I think I like it. You can configure whether it just acts, or asks for permission first.