Will it take <=12 months for open-source AI forecasting to go from consistently worse than humans to broadly superhuman?
AIOne-Off7j
Manifold MarketsGeen KYCGeverifieerde afwikkelingsgegevensRedelijk gekalibreerdWaarschuwing datakwaliteitBrongegevens verslechterd
Gegevens van 26 okt 2026, 03:24 UTC · beleid pm-quality-4
Huidige gemeenschapsvoorspellingNee 74%
Voorspellers
8
Vraagtype
binary
Methodologie
Play-money forecasting platform
Brontype
Voorspelling
Marktdata
Bijgewerkt 10 uur geleden
Verouderd21 jan 24, 14:21 UTC2 jan 34, 07:59 UTC
Trends
Gerelateerde Markten
Gerelateerde vragen voor context, geen vergelijking van gelijkwaardige contracten.
When will AI forecasting crush human superforecasters?
Manifold MarketsPMF or Die (AI Forecasting Edition)
Manifold MarketsUS government bans an open source AI model in 2026?
PolymarketWill the U.S. ban any open-source AI model in 2026?
KalshiTop Open Source AI this week
KalshiWill open-source AI remain at least one year behind proprietary AI? (ACX, AI 2027 #4)
Manifold MarketsRegels
Will there be a date X when the public best AI forecasting techniques (open-sourced model weights and any scaffolding; training details not necessary as long as weights are open) score worse than 75th percentile Metaculus forecasters across almost all categories of 1-3 month resolution questions, as well as a date before X+12 months when I believe that the best open-source AI forecasting techniques are on par with or better than 98th percentile Metaculus forecasters in a wide variety of 1-3 month resolution question categories.
- I'll make my resolution decision at least a year after the first commenter who credibly and in good faith proposes that date X+12 months has been reached, and at least a year after any system that ultimately resolves this question becomes public.
- I intend to decide whether X and X+12 meet the above requirements according to the long term performance of the models on several rounds of real forecasting tournaments.
- I also intend to consider the models' performances on a slate of forecasting benchmarks like Autocast (https://arxiv.org/abs/2206.15474) against any comparable human data.
- If I believe AI forecasting methods no longer perform worse than 75th percentile Metaculus forecasters at some date Y, and by Y+24 months I determine that the best methods at Y+12 months were not broadly superhuman, I will resolve NO.
- Finally, I will resolve NO no matter what on 1/1/2034.