Manifold MarketsSans KYCDonnées de résolution vérifiéesAssez bien calibréPrévision communautaire actuelle2027 62.3%En tête parmi 8 options
Prévisionnistes
3
Type de question
multiple choice
Méthodologie
Play-money forecasting platform
Type de source
Prévision
Variation 7j
0.0 pts
Données du marché
Mis à jour il y a 4 heures
Obsolète13 juil. 25, 18:02 UTC1 janv. 33, 23:59 UTC
Tendances
Règles
The GSO (Global Software Optimization) benchmark tests whether large-language-model agents can act like real performance engineers.
- It extracts 102 optimisation tasks from the commit histories of 10 production code-bases spanning C, C++, Rust, Go, Java, and Python.
- For each task the agent receives the full repo, a correctness test-suite, and a runtime profiler, then must submit a single patch that (i) keeps all tests green and (ii) reaches ≥ 95 % of the speed-up achieved by the human expert commit.
- The headline metric, Opt @ 1, is simply the fraction of tasks cleared on the very first try; no retries, no cherry-picking.
- All patches are rebuilt and timed in a sandbox so scores are reproducible and publicly displayed on the GSO leaderboard.
- State of play (July 2025)
