In 2029, will any AI be able to take an arbitrary proof in the mathematical literature and translate it into a form suitable for symbolic verification? (Gary Marcus benchmark #5)
IAOne-Off3a
Manifold MarketsSans KYCDonnées de résolution vérifiéesBien calibréPrévision communautaire actuelleOui 77.7%
Prévisionnistes
107
Type de question
binary
Méthodologie
Play-money forecasting platform
Type de source
Prévision
Données du marché
Mis à jour il y a 8 heures
Obsolète16 sept. 22, 20:47 UTC1 janv. 30, 08:00 UTC
Tendances
Marchés Associés
Questions liées pour le contexte, et non une comparaison de contrats équivalents.
In 2029, will any AI be able to work as a competent cook in an arbitrary kitchen? (Gary Marcus benchmark #3)
Manifold MarketsIn 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4)
Manifold MarketsBy 2029, will any AI be able to read a novel and reliably answer questions about it? (Gary Marcus benchmark #2)
Manifold MarketsBy 2029 will any AI be able to watch a movie and accurately tell you what is going on? (Gary Marcus benchmark #1)
Manifold MarketsWho is Dwarkesh's upcoming "biggest guest yet"?
Manifold MarketsWhich company has the best AI model end of October?
PolymarketRègles
The fifth question from this post: https://garymarcus.substack.com/p/dear-elon-musk-here-are-five-things
- The full text is: "In 2029, AI will not be able to take arbitrary proofs from the mathematical literature written in natural language and convert them into a symbolic form suitable for symbolic verification."
- Judgment will be by me, not Gary Marcus.
- Ambiguous whether this means start or end of 2029, so I have set it for the end.
- I will accept if there is an AI that can do this for >=75% of the proofs published on the arxiv math categories in 2029.
