Will it take <=12 months for open-source AI forecasting to go from consistently worse than humans to broadly superhuman?
KIOne-Off7J
Manifold MarketsKein KYCVerifizierte AuflösungsdatenOrdentlich kalibriertAktuelle Community-Prognose
Nein 74%
Nein 74%Prognostiker
8
Fragetyp
binary
Methodik
Play-money forecasting platform
Quellentyp
Prognose
Marktdaten
Aktualisiert vor 5 Stunden
Veraltet21. Jan. 24, 14:21 UTC2. Jan. 34, 07:59 UTC
Trends
Verwandte Märkte
Verwandte Fragen als Kontext, kein Vergleich gleichwertiger Kontrakte.
When will AI forecasting crush human superforecasters?
Manifold MarketsPMF or Die (AI Forecasting Edition)
Manifold MarketsTop Open Source AI this week
KalshiUS government bans an open source AI model in 2026?
PolymarketWill the U.S. ban any open-source AI model in 2026?
KalshiWill open-source AI remain at least one year behind proprietary AI? (ACX, AI 2027 #4)
Manifold MarketsRegeln
Will there be a date X when the public best AI forecasting techniques (open-sourced model weights and any scaffolding; training details not necessary as long as weights are open) score worse than 75th percentile Metaculus forecasters across almost all categories of 1-3 month resolution questions, as well as a date before X+12 months when I believe that the best open-source AI forecasting techniques are on par with or better than 98th percentile Metaculus forecasters in a wide variety of 1-3 month resolution question categories.
- I'll make my resolution decision at least a year after the first commenter who credibly and in good faith proposes that date X+12 months has been reached, and at least a year after any system that ultimately resolves this question becomes public.
- I intend to decide whether X and X+12 meet the above requirements according to the long term performance of the models on several rounds of real forecasting tournaments.
- I also intend to consider the models' performances on a slate of forecasting benchmarks like Autocast (https://arxiv.org/abs/2206.15474) against any comparable human data.
- If I believe AI forecasting methods no longer perform worse than 75th percentile Metaculus forecasters at some date Y, and by Y+24 months I determine that the best methods at Y+12 months were not broadly superhuman, I will resolve NO.
- Finally, I will resolve NO no matter what on 1/1/2034.