Benchmark Gap #5: Once a single AI model solves >= 95% of miniF2F, MATH, and MMLU STEM, will it be less than two years before AI models are used as entry-level data science / data analysis / statistics workers?
One-OffYZ
Manifold MarketsKYC yokDoğrulanmış sonuçlanma verisiOrta düzey kalibreGüncel topluluk tahminiEvet 67.1%
Tahminciler
8
Soru türü
binary
Yöntem
Play-money forecasting platform
Kaynak türü
Tahmin
Piyasa verileri
6 dakika önce güncellendi
20 Ara 22 08:34 UTC1 Oca 50 08:00 UTC
Trendler
Kurallar
This question is meant to measure the gap between solving the main math-based benchmarks at the time of market creation, and applying mathematics in the real world.
- Data science / data analysis / statistics positions: I'll accept anything in this general realm of jobs, with the caveat that I won't require any significant coding.
- For instance an AI working as an ML scientist would resolve this market YES, but this is not a requirement.
- There is no requirement that any human entry-level workers be fired/replaced, e.g. if for some reason both humans and AI are employed to do the same work that counts.
