Will $10,000 worth of AI hardware be able to train a GPT-3 equivalent model in under 1 hour, by EOY 2027?
IAOne-OffTecnologia1aManifold MarketsSenza KYCDati di risoluzione verificatiDiscretamente calibratoPrevisione della comunità attualeNo 84.5%
Previsori
38
Tipo di domanda
binary
Metodologia
Play-money forecasting platform
Tipo di fonte
Previsione
Dati di mercato
Aggiornato 10 minuti fa
10 apr 24, 06:31 UTC1 gen 28, 04:59 UTC
Trend
Mercati Correlati
Domande correlate per il contesto, non un confronto tra contratti equivalenti.
Before 2028, will anyone train a GPT-4-level model in a minute?
Manifold MarketsHow much compute will be used to train GPT-5?
Manifold MarketsBest AI at the end of 2026?
KalshiWhich company has the best AI model end of October?
PolymarketWhich company has best AI model end of 2026?
PolymarketGemini 4.0 released by which date?
PolymarketRegole
Using the best estimates we have at the time, using actually-purchasable hardware.
- Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020.
- Like its predecessor, GPT-2, it is a decoder-only[2] transformer model of deep neural network, which supersedes recurrence and convolution-based architectures with a technique known as "attention".[3]
- It uses a 2048-tokens-long context[jargon], float16 (16-bit) precision, and a hitherto-unprecedented 175 billion parameters, requiring 350GB of storage space as each parameter takes 2 bytes of space, and has demonstrated strong "zero-shot" and "few-shot" learning abilities on many tasks.
- "GPT-3 equivalent" in terms of floating point operations that were needed to train gpt3, as well as space requirements, energy requirements, etc. Algorithmic improvements that make a smaller model as good as gpt3 as an LLM would not count for the purpose of this question.