Manifold MarketsKYC yokDoğrulanmış sonuçlanma verisiOrta düzey kalibreGüncel topluluk tahmini2027 62.3%8 seçenek arasında lider
Tahminciler
3
Soru türü
multiple choice
Yöntem
Play-money forecasting platform
Kaynak türü
Tahmin
7g Değişim
0.0 pts
Piyasa verileri
11 saat önce güncellendi
Guncelligini yitirmis13 Tem 25 18:02 UTC1 Oca 33 23:59 UTC
Trendler
Kurallar
The GSO (Global Software Optimization) benchmark tests whether large-language-model agents can act like real performance engineers.
- It extracts 102 optimisation tasks from the commit histories of 10 production code-bases spanning C, C++, Rust, Go, Java, and Python.
- For each task the agent receives the full repo, a correctness test-suite, and a runtime profiler, then must submit a single patch that (i) keeps all tests green and (ii) reaches ≥ 95 % of the speed-up achieved by the human expert commit.
- The headline metric, Opt @ 1, is simply the fraction of tasks cleared on the very first try; no retries, no cherry-picking.
- All patches are rebuilt and timed in a sandbox so scores are reproducible and publicly displayed on the GSO leaderboard.
- State of play (July 2025)
