In 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4)
IAOne-OffTecnologia3aManifold MarketsSem KYCDados de resolução verificadosRazoavelmente calibradoPrevisão da comunidade atualSim 91.4%
Previsores
116
Tipo de pergunta
binary
Metodologia
Play-money forecasting platform
Tipo de fonte
Previsão
Dados do mercado
Atualizado há 8 horas
Desatualizado16/09/22, 20:43 UTC1/01/30, 08:00 UTC
Tendências
Regras
The fourth question from this post: https://garymarcus.substack.com/p/dear-elon-musk-here-are-five-things
- The full text is: "In 2029, AI will not be able to reliably construct bug-free code of more than 10,000 lines from natural language specification or by interactions with a non-expert user. [Gluing together code from existing libraries doesn’t count.]"
- Judgment will be by me, not Gary Marcus.
- Ambiguous whether this means start or end of 2029, so I have set it for the end.
- For this question I am not using the exact text of the question, because I think "bug-free" is 1. silly 2. untestable.
- I will instead accept if it produces code of >=10k LOC with <= the number of bugs in an implementation by a human (many small bugs for some significant bugs will unfortunately be down to my subjective impression of whether it's "better")
Mercados abertos
AI
KALSHITop AI model in September?
- claude-fable-5.1-max-12.0pt72%
- claude-opus-5-high+2.0pt6%
- claude-opus-4-6-thinking4%
+3 mais resultados
- Volume total
- € 135,2 mil
- Volume 24h
- € 102,7 mil
POLYMARKETWill CMI declare a Millennium Prize Problem solved by which date?
- 2028+6.5pt62.1%
- 2027-3.5pt28.4%
- 2026+2.0pt9.5%
POLYMARKETAnthropic IPO by which date?
- December 31,-1.0pt90%
- December 15,+3.5pt90%
- November 30,85%
+7 mais resultados
- Volume total
KALSHIBest AI at the end of 2026?
- Claude-0.7pt61.4%
- ChatGPT-2.1pt22.8%
- Grok-0.1pt7.9%
+5 mais resultados
- Volume total
- € 9,1 mi
KALSHIBest AI in Sep 2026?
- Claude+3.0pt81.3%
- ChatGPT-1.0pt11.2%
- Grok2.8%
+4 mais resultados
- Volume total
- € 325 mil
POLYMARKETOpenAI’s Astra Model: Text Arena Debut?
- 1480+-2.5pt66%
- 1490+-9.0pt51%
- 1500+-3.0pt23%
+2 mais resultados
- Largest IPO by market cap in 2026?
- OpenAI IPO Closing Market Cap
- When will Anthropic officially announce an IPO?
- Anthropic IPO Closing Market Cap
- When will OpenAI achieve AGI?
- Will Anthropic’s valuation hit __ by December 31?
- Will OpenAI's valuation hit __ by December 31?
- Next Google Gemini Pro Model released by which date?
- Best Chinese AI Company end of September?
- What will OpenAI's IPO valuation be?
Perguntas frequentes
- Quais são as probabilidades atuais de In 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4)?
- A Manifold Markets cota Yes em 91% em 8 de setembro de 2026.
- Quando In 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4) é resolvido?
- In 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4) deverá ser resolvido em 1 de janeiro de 2030.
- Como In 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4) é liquidado?
- A Manifold Markets liquida este mercado da seguinte forma: The fourth question from this post: https://garymarcus.substack.com/p/dear-elon-musk-here-are-five-things