There are other interesting places where LLMs fail badly at reasoning, eg planning problems like block-world or scheduling meetings between people with availability constraints; see eg this paper & other work from Kambhampati.
I’ve been considering putting some time into this as a research direction; the ML community has a literature on the topic but it doesn’t seem to have been discussed much in AIS, although the ARC prize could change that. I think it needs to be considered through a safety lens, since it has significant impacts on the plausibility of short timelines to drop-in-researcher like @leopold’s. I have an initial sketch of such a direction here, combining lit review & experimentation. Feedback welcomed!
(if in fact someone already has looked at this issue through an AIS lens, I’d love to know about it!)
There are other interesting places where LLMs fail badly at reasoning, eg planning problems like block-world or scheduling meetings between people with availability constraints; see eg this paper & other work from Kambhampati.
I’ve been considering putting some time into this as a research direction; the ML community has a literature on the topic but it doesn’t seem to have been discussed much in AIS, although the ARC prize could change that. I think it needs to be considered through a safety lens, since it has significant impacts on the plausibility of short timelines to drop-in-researcher like @leopold’s. I have an initial sketch of such a direction here, combining lit review & experimentation. Feedback welcomed!
(if in fact someone already has looked at this issue through an AIS lens, I’d love to know about it!)