It seems to me that o1 and deepseek already do a bunch of the “mental simulation” kind of reasoning, and even previous LLMs did so a good amount if you prompted them to think in chain-of-thoughts, so the core point fell a bit flat for me.
Thanks, that’s helpful. My impression from o1 is that it does something that could be called mental simulation for domains like math where the “simulation” can in fact be represented with just writing (or equations more specifically). But I think that writing is only an efficient format for mental simulation for a very small number of domains.
It seems to me that o1 and deepseek already do a bunch of the “mental simulation” kind of reasoning, and even previous LLMs did so a good amount if you prompted them to think in chain-of-thoughts, so the core point fell a bit flat for me.
Thanks, that’s helpful. My impression from o1 is that it does something that could be called mental simulation for domains like math where the “simulation” can in fact be represented with just writing (or equations more specifically). But I think that writing is only an efficient format for mental simulation for a very small number of domains.