Here’s a plot of the Metaculus Strong AGI predictions over time (code by Rylan Schaeffer). The x-axis is the data of the prediction, the y-axis is the predicted year of strong AGI at the time. The blue line is a linear fit. The red dashed line is a y = x line.
Interestingly, it seems these predictions have been dropping by 5.5 predicted years per real year which seems much faster than I imagined. If we extrapolate out and look at where the blue regression intersects the red y = x line (so assuming similar updating in the future, when we might expect the updated time to be the same as the time of prediction), we get 2025.77 (October 9, 2025) for AGI.
Edit: Re-pulled the Metaculus data which slightly changed the regression (m=-6.5 → −5.5) and intersection (2025.44 → 2025.77).
There’s a striking inverted V-shape there (which would be even clearer if you fit a segmented regression with 1 break point), where it’s drifting up for all of 2021, only to suddenly reverse and drop over like a stone 2022-2023.
What’s the qualitative characterization of Metaculus collective views there? At least from my perspective, 2021 seemed in line with scaling expectations with tons of important DL research demonstrating the scaling hypothesis & blessings of scale. I don’t remember anything that would’ve been pivotal around what looks like a breakpoint Dec 2021 - if it had happened around or after Feb 2022, then you could point to Chinchilla / Gato / PaLM / Flamingo / DALL-E 2, but why Dec 2021?
Of course the choice of what sort of model we fit to our data can sometimes preordain the conclusion.
Another way to interpret this is there was a very steep update made by the community in early 2022, and since then it’s been relatively flat, or perhaps trending down slowly with a lot of noise (whereas before the update it was trending up slowly).
Seems to me there’s too much noise to pinpoint the break at a specific month. There are some predictions made in early 2022 with an even later date than those made in late 2021.
But one pivotal thing around that time might have been the chain-of-thought stuff which started to come to attention then (even though there was some stuff floating around Twitter earlier).
Here’s a plot of the Metaculus Strong AGI predictions over time (code by Rylan Schaeffer). The x-axis is the data of the prediction, the y-axis is the predicted year of strong AGI at the time. The blue line is a linear fit. The red dashed line is a y = x line.
Interestingly, it seems these predictions have been dropping by 5.5 predicted years per real year which seems much faster than I imagined. If we extrapolate out and look at where the blue regression intersects the red y = x line (so assuming similar updating in the future, when we might expect the updated time to be the same as the time of prediction), we get 2025.77 (October 9, 2025) for AGI.
Edit: Re-pulled the Metaculus data which slightly changed the regression (m=-6.5 → −5.5) and intersection (2025.44 → 2025.77).
There’s a striking inverted V-shape there (which would be even clearer if you fit a segmented regression with 1 break point), where it’s drifting up for all of 2021, only to suddenly reverse and drop over like a stone 2022-2023.
What’s the qualitative characterization of Metaculus collective views there? At least from my perspective, 2021 seemed in line with scaling expectations with tons of important DL research demonstrating the scaling hypothesis & blessings of scale. I don’t remember anything that would’ve been pivotal around what looks like a breakpoint Dec 2021 - if it had happened around or after Feb 2022, then you could point to Chinchilla / Gato / PaLM / Flamingo / DALL-E 2, but why Dec 2021?
Good idea. Here’s just considering the predictions starting in 2022 and on. Then, you get a prediction update rate of 16 years per year.
Halloween, 2023, is when the AGI is extrapolated to arrive...
Of course the choice of what sort of model we fit to our data can sometimes preordain the conclusion.
Another way to interpret this is there was a very steep update made by the community in early 2022, and since then it’s been relatively flat, or perhaps trending down slowly with a lot of noise (whereas before the update it was trending up slowly).
Seems to me there’s too much noise to pinpoint the break at a specific month. There are some predictions made in early 2022 with an even later date than those made in late 2021.
But one pivotal thing around that time might have been the chain-of-thought stuff which started to come to attention then (even though there was some stuff floating around Twitter earlier).