On one hand, I agree that nothing really special and novel is happening in Cicero. On the other hand, something about it makes me feel like it’s important. I think it’s the plan->communicate->alter plan->repeat cycle partly taking place in English that intuitively makes me think “oh shit, that’s basically how I think. If we scale this up, it’ll do everything I can do”. I don’t know how true this actually is.
I vaguely recall feeling something like this when a general-purpose model learned to play all the Atari games. But I’m feeling it a lot more now. Maybe it’s the fact that if you showed the results of this to pre-GPT2 me, I’d think it’s an AGI, with zero doubt or hesitation.
On one hand, I agree that nothing really special and novel is happening in Cicero. On the other hand, something about it makes me feel like it’s important. I think it’s the plan->communicate->alter plan->repeat cycle partly taking place in English that intuitively makes me think “oh shit, that’s basically how I think. If we scale this up, it’ll do everything I can do”. I don’t know how true this actually is.
I vaguely recall feeling something like this when a general-purpose model learned to play all the Atari games. But I’m feeling it a lot more now. Maybe it’s the fact that if you showed the results of this to pre-GPT2 me, I’d think it’s an AGI, with zero doubt or hesitation.