Daniel Kokotajlo comments on What will the scaled up GATO look like? (Updated with questions)

[Daniel Kokotajlo]

I’d be interested to forecast on whether Gato2 will see bigger gains from chain-of-thought style stuff than a similarly-sized LLM.

[Daniel Kokotajlo]

I weakly predict yes.