Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA?
AIOne-Off3moManifold MarketsNo KYCVerified resolution dataFairly calibratedCurrent community forecastYes 55.5%
Forecasters
8
Question type
binary
Methodology
Play-money forecasting platform
Source type
Forecast
Market data
Updated 5 hours ago
StaleSep 20, 25, 10:10 PM UTCDec 31, 26, 11:59 PM UTC
Trends
Related Markets
Related questions for context, not a comparison of equivalent contracts.
Before 2027, will OpenAI release a Frontier Model trained according to their "Why LLMs hallucinate" paper?
Manifold MarketsWill Microsoft train and release a frontier model in 2026?
Manifold MarketsWill China restrict the open release of frontier AI models above a capability threshold by end of 2026?
Manifold MarketsWill OpenAI release a social network in 2026?
PolymarketTop AI model in September?
KalshiBest AI at the end of 2026?
KalshiRules
SimpleQA is an obscure trivia benchmark OpenAI uses to evaluate hallucination rate.
- Resolves yes if a Frontier model released by OpenAI declines to answer SimpleQA questions at least 5 times as often as it incorrectly answers them.
- To resolve yes, the model must not have access to the internet or any database of facts.
- I will be largely looking towards OpenAI's evaluations to resolve this market but will accept 3rd party evals if OpenAI stops using SimpleQA.
- OpenAI's latest frontier model GPT-5-thinking has only a 1:8 ratio.
- However, OpenAI claimed in a recent paper that they have new insights into why LLMs hallucinate and how to prevent them.
Open markets
AIKALSHITop AI model in September?
- claude-fable-5.1-max-12.0pt72%
- claude-opus-5-high+2.0pt6%
- claude-opus-4-6-thinking4%
+3 more outcomes
- Total Vol
- $157.2K
- 24h Vol
- $119.4K
POLYMARKETWill CMI declare a Millennium Prize Problem solved by which date?
- 2028+10.0pt60%
- 2027+2.0pt31.4%
- 2026+2.0pt8.6%
POLYMARKETAnthropic IPO by which date?
- December 31,-1.0pt90%
- December 15,+3.5pt90%
- November 30,85%
+7 more outcomes
- Total Vol
KALSHIBest AI at the end of 2026?
- Claude-0.7pt61.4%
- ChatGPT-2.7pt22.8%
- Grok-0.1pt7.9%
+5 more outcomes
- Total Vol
- $10.6M
KALSHIBest AI in Sep 2026?
- Claude+3.0pt81.3%
- ChatGPT-4.0pt11.2%
- Grok2.8%
+4 more outcomes
- Total Vol
- $377.7K
- 24h Vol
POLYMARKETOpenAI’s Astra Model: Text Arena Debut?
- 1480+-2.5pt66%
- 1490+-9.0pt51%
- 1500+-3.5pt23%
+2 more outcomes
- Largest IPO by market cap in 2026?
- OpenAI IPO Closing Market Cap
- When will Anthropic officially announce an IPO?
- Anthropic IPO Closing Market Cap
- When will OpenAI achieve AGI?
- Will Anthropic’s valuation hit __ by December 31?
- Will OpenAI's valuation hit __ by December 31?
- Next Google Gemini Pro Model released by which date?
- Best Chinese AI Company end of September?
- What will OpenAI's IPO valuation be?
Frequently asked questions
- What are the current odds for Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA??
- Manifold Markets prices Yes at 56% as of September 8, 2026.
- When does Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA? resolve?
- Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA? is scheduled to resolve on December 31, 2026.
- How is Before 2027, will OpenAI release a frontier model with a 5:1 or better abstention to hallucination ratio on SimpleQA? settled?
- Manifold Markets settles this market as follows: SimpleQA is an obscure trivia benchmark OpenAI uses to evaluate hallucination rate.