(Eli’s notes, mostly for his own understanding. Feel free to respond if you want.)
The bottleneck I named in my last discussion with Paul was, “We have copies of a starting agent, which run for at most one cumulative day before being terminated, and this agent hasn’t previously learned much math but is smart and can get to understanding algebra by the end of the day even though the agent started out knowing just concrete arithmetic. How does a system of such agents, without just operating a Turing machine that operates an AGI, get to the point of inventing Hessian-free optimization in a neural net?”
Yeah. It seems to me that the system Paul outlines can’t do this task.
(Eli’s notes, mostly for his own understanding. Feel free to respond if you want.)
Yeah. It seems to me that the system Paul outlines can’t do this task.