Manifold MarketsKYC yokDoğrulanmış sonuçlanma verisiOrta düzey kalibreVeri kalitesi uyarısıKaynak verileri bozulmuş
26 Eki 2026 04:28 UTC itibarıyla veriler · politika pm-quality-4
Güncel topluluk tahminiHayır 68.4%
Tahminciler
13
Soru türü
binary
Yöntem
Play-money forecasting platform
Kaynak türü
Tahmin
Piyasa verileri
4 saat önce güncellendi
Guncelligini yitirmis7 Şub 25 00:49 UTC1 Oca 27 04:59 UTC
Trendler
İlgili Piyasalar
Bağlam için ilgili sorular; eşdeğer sözleşmelerin karşılaştırması değildir.
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2027?
Manifold MarketsWill Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2028?
Manifold MarketsWill Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2028?
Manifold MarketsWill Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2030?
Manifold MarketsHighest OpenAI score on Humanity’s Last Exam in 2026?
PolymarketHighest Grok score on Humanity’s Last Exam in 2026?
PolymarketKurallar
Humanity's Last Exam (HLE) is a benchmark designed to evaluate Al systems' reasoning and problem-solving capabilities across a wide range of academic disciplines, including mathematics, humanities, and natural sciences.
- Developed collaboratively by the Center for Al Safety and Scale Al, HLE comprises 3,000 unambiguous and verifiable academic questions contributed by nearly 1,000 subject-matter experts from over 500 institutions across 50 countries.
- The dataset is multimodal, with approximately 10% of the questions requiring both image and text comprehension, while the remaining 90% are text-based.
- As of early 2025, state-of-the-art Al models have demonstrated limited success on the HLE benchmark.
- For instance, OpenAl's 03-mini (high) model achieved an accuracy of 13% when evaluated solely on text-based questions.
- OpenAl's Deep Research agent, which leverages the 03 model for extensive web browsing and data analysis, reached an accuracy of 26.6% on the HLE benchmark.
