I’m hazier on the details of how this would play out (and a bit sceptical that it would enable a truly runaway feedback loop), but more sophisticated systems could help to gather the real-world data to make subsequent finetuning efforts more effective.
On the contrary, I think proactive gathering of data is very plausibly the bottleneck, and (smarts) → (better data gathering) → (more smarts) is high on my list of candidates for the critical feedback loop.
FWIW I don’t think vanilla ‘fine tuning’ necessarily achieves this, but coupled with retrieval augmented generation and similar scaffolding, incorporation of new data becomes more fluent.
On the contrary, I think proactive gathering of data is very plausibly the bottleneck, and (smarts) → (better data gathering) → (more smarts) is high on my list of candidates for the critical feedback loop.
In a world where the ‘big two’ (R&D and executive capacity) are characterised by driving beyond the frontier of the well-understood it’s all about data gathering and sample-efficient incorporation of the data.
FWIW I don’t think vanilla ‘fine tuning’ necessarily achieves this, but coupled with retrieval augmented generation and similar scaffolding, incorporation of new data becomes more fluent.