It seems to have a bug where it uses German (possible because of payment details) for its hidden thoughts without really knowing it too well.
The hidden thoughts contain a ton of nonsense, typos and ungrammatical phrases. A bit of English and even French is mixed in. They read like the output of a pretty small open source model that has not seen much German or chess.
‘...after weighing multiple factors including user experience, competitive advantage, and the option to pursue the chain of thought monitoring, we have decided not to show the raw chains of thought to users. We acknowledge this decision has disadvantages. We strive to partially make up for it by teaching the model to reproduce any useful ideas from the chain of thought in the answer. For the o1 model series we show a model-generated summary of the chain of thought.’
Aaah, so the question is if it’s actually thinking in German because of your payment info or it’s just the thought-trace-condenser that’s translating into German because of your payment info.
I know, but I think Ia3orn said that the reasoning traces are hidden and only a summary is shown. And I haven’t seen any information on a “thought-trace-condenser” anywhere.
I played a game of chess against o1-preview.
It seems to have a bug where it uses German (possible because of payment details) for its hidden thoughts without really knowing it too well.
The hidden thoughts contain a ton of nonsense, typos and ungrammatical phrases. A bit of English and even French is mixed in. They read like the output of a pretty small open source model that has not seen much German or chess.
Playing badly too.
Do you work at OpenAI? This would be fascinating, but I thought OpenAI was hiding the hidden thoughts.
No, I don’t—but the thoughts are not hidden. You can expand them unter “Gedanken zu 6 Sekunden”.
Which then looks like this:
‘...after weighing multiple factors including user experience, competitive advantage, and the option to pursue the chain of thought monitoring, we have decided not to show the raw chains of thought to users. We acknowledge this decision has disadvantages. We strive to partially make up for it by teaching the model to reproduce any useful ideas from the chain of thought in the answer. For the o1 model series we show a model-generated summary of the chain of thought.’
(from ‘Hiding the Chains of Thought’ in their main post)
Aaah, so the question is if it’s actually thinking in German because of your payment info or it’s just the thought-trace-condenser that’s translating into German because of your payment info.
Interesting, I’d guess the 2nd but ???
There is a thought-trace-condenser?
Ok, then the high-level nature of some of these entries makes more sense.
Edit: Do you have a source for that?
You can read examples of the hidden reasoning traces here.
I know, but I think Ia3orn said that the reasoning traces are hidden and only a summary is shown. And I haven’t seen any information on a “thought-trace-condenser” anywhere.
See the section titled “Hiding the Chains of Thought” here: https://openai.com/index/learning-to-reason-with-llms/