In 2029, will any AI be able to take an arbitrary proof in the mathematical literature and translate it into a form suitable for symbolic verification? (Gary Marcus benchmark #5)
AIOne-Off3y
Manifold MarketsNo KYCVerified resolution dataWell calibratedCurrent community forecastYes 77.7%
Forecasters
107
Question type
binary
Methodology
Play-money forecasting platform
Source type
Forecast
Market data
Updated 10 hours ago
StaleSep 16, 22, 8:47 PM UTCJan 1, 30, 8:00 AM UTC
Trends
Related Markets
Related questions for context, not a comparison of equivalent contracts.
In 2029, will any AI be able to work as a competent cook in an arbitrary kitchen? (Gary Marcus benchmark #3)
Manifold MarketsIn 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4)
Manifold MarketsBy 2029, will any AI be able to read a novel and reliably answer questions about it? (Gary Marcus benchmark #2)
Manifold MarketsBy 2029 will any AI be able to watch a movie and accurately tell you what is going on? (Gary Marcus benchmark #1)
Manifold MarketsWho is Dwarkesh's upcoming "biggest guest yet"?
Manifold MarketsWhich company has the best AI model end of October?
PolymarketRules
The fifth question from this post: https://garymarcus.substack.com/p/dear-elon-musk-here-are-five-things
- The full text is: "In 2029, AI will not be able to take arbitrary proofs from the mathematical literature written in natural language and convert them into a symbolic form suitable for symbolic verification."
- Judgment will be by me, not Gary Marcus.
- Ambiguous whether this means start or end of 2029, so I have set it for the end.
- I will accept if there is an AI that can do this for >=75% of the proofs published on the arxiv math categories in 2029.
