Scott here from spellbook.legal (mentioned above)!
We are finding LLMs do be incredibly powerful tools for legal drafting & review, mind-blowingly good. It is a whole new way of thinking as a programmer though: results are non-deterministic! Chaining together non-deterministic queries is much more of an art than science. I think it will take the software engineering profession a long time to get comfortable with that. It really requires tinkering at scale, but not necessarily formal methods.
I also think there is a perception that GPT-3 is “too easy” and you have to “learn to do things from first principles first”. I really disagree with that, and I wrote about that fallacy here.
One last point: GPT-3 has improved dramatically over the past 2 years. It’s not the same product it was when it launched. I don’t think many people have caught on to the level of improvement yet.
Scott here from spellbook.legal (mentioned above)!
We are finding LLMs do be incredibly powerful tools for legal drafting & review, mind-blowingly good. It is a whole new way of thinking as a programmer though: results are non-deterministic! Chaining together non-deterministic queries is much more of an art than science. I think it will take the software engineering profession a long time to get comfortable with that. It really requires tinkering at scale, but not necessarily formal methods.
I also think there is a perception that GPT-3 is “too easy” and you have to “learn to do things from first principles first”. I really disagree with that, and I wrote about that fallacy here.
One last point: GPT-3 has improved dramatically over the past 2 years. It’s not the same product it was when it launched. I don’t think many people have caught on to the level of improvement yet.