But are they going to do that again? GPT4 used the same training set as GPT3 didn’t it?
Ah, I was under a misapprehension, I thought the data was much more recent, but the GPT-4 page says:
GPT-4 generally lacks knowledge of events that have occurred after the vast majority of its data cuts off (September 2021)
However that is after GPT-3 was released (June 2020), so it’s a new dataset.
Extrapolating naively, 2 years from now we will see GPT-5 trained on data from today.
But are they going to do that again? GPT4 used the same training set as GPT3 didn’t it?
Ah, I was under a misapprehension, I thought the data was much more recent, but the GPT-4 page says:
However that is after GPT-3 was released (June 2020), so it’s a new dataset.
Extrapolating naively, 2 years from now we will see GPT-5 trained on data from today.