I really appreciate that in that case they did make falsifiable claims; I wonder whether either author has at any point acknowledged that they were falsified
AFAICT, the only falsified claim in the paper is the “three plus five equals” claim you mentioned. This is in this appendix and doesn’t seem that clear to me what they mean by “pure LLM”. (Like surely they agree that you can memorize this?)
The other claims are relatively weak and not falsified. See here
AFAICT, the only falsified claim in the paper is the “three plus five equals” claim you mentioned. This is in this appendix and doesn’t seem that clear to me what they mean by “pure LLM”. (Like surely they agree that you can memorize this?)
The other claims are relatively weak and not falsified. See here