In 2029, will any AI be able to take an arbitrary proof in the mathematical literature and translate it into a form suitable for symbolic verification? (Gary Marcus benchmark #5)
IAOne-Off3aManifold MarketsSans KYCDonnées de résolution vérifiéesAssez bien calibréPrévision communautaire actuelleOui 77.4%
Prévisionnistes
106
Type de question
binary
Méthodologie
Play-money forecasting platform
Type de source
Prévision
Données du marché
Mis à jour il y a 11 heures
Obsolète16 sept. 22, 20:47 UTC1 janv. 30, 08:00 UTC
Tendances
Marchés Associés
Questions liées pour le contexte, et non une comparaison de contrats équivalents.
In 2029, will any AI be able to work as a competent cook in an arbitrary kitchen? (Gary Marcus benchmark #3)
Manifold MarketsBy 2029, will any AI be able to read a novel and reliably answer questions about it? (Gary Marcus benchmark #2)
Manifold MarketsIn 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4)
Manifold MarketsTop AI model in September?
KalshiBest AI at the end of 2026?
KalshiAnthropic IPO by which date?
PolymarketRègles
The fifth question from this post: https://garymarcus.substack.com/p/dear-elon-musk-here-are-five-things
- The full text is: "In 2029, AI will not be able to take arbitrary proofs from the mathematical literature written in natural language and convert them into a symbolic form suitable for symbolic verification."
- Judgment will be by me, not Gary Marcus.
- Ambiguous whether this means start or end of 2029, so I have set it for the end.
- I will accept if there is an AI that can do this for >=75% of the proofs published on the arxiv math categories in 2029.