I don’t have any first- or second-hand experience with that happening. I see occasional articles about protein and materials research that LLMs have massively accelerated, but my suspicion is the main value currently is NOT cutting-edge significant problem solving.
The “mundane utility” section of Zvi’s writeups have very good examples of what it IS currently good at now. There’s yet a long way to go to handle long-running multi-step creative analysis that the top few percent of humans are engaged in. What is the shape of the curve (both of capabilities and of “intelligence level” metrics) is currently not known.
I don’t have any first- or second-hand experience with that happening. I see occasional articles about protein and materials research that LLMs have massively accelerated, but my suspicion is the main value currently is NOT cutting-edge significant problem solving.
The “mundane utility” section of Zvi’s writeups have very good examples of what it IS currently good at now. There’s yet a long way to go to handle long-running multi-step creative analysis that the top few percent of humans are engaged in. What is the shape of the curve (both of capabilities and of “intelligence level” metrics) is currently not known.
Thanks for pointing me to Zvi’s work