Will $10,000 worth of AI hardware be able to train a GPT-3 equivalent model in under 1 hour, by EOY 2027?
IAOne-OffTecnologia1aManifold MarketsSem KYCDados de resolução verificadosRazoavelmente calibradoPrevisão da comunidade atualNão 84.5%
Previsores
38
Tipo de pergunta
binary
Metodologia
Play-money forecasting platform
Tipo de fonte
Previsão
Dados do mercado
Atualizado há 12 minutos
10/04/24, 06:31 UTC1/01/28, 04:59 UTC
Tendências
Mercados Relacionados
Perguntas relacionadas para dar contexto, não uma comparação de contratos equivalentes.
Before 2028, will anyone train a GPT-4-level model in a minute?
Manifold MarketsHow much compute will be used to train GPT-5?
Manifold MarketsBest AI at the end of 2026?
KalshiWhich company has the best AI model end of October?
PolymarketWhich company has best AI model end of 2026?
PolymarketGemini 4.0 released by which date?
PolymarketRegras
Using the best estimates we have at the time, using actually-purchasable hardware.
- Generative Pre-trained Transformer 3 (GPT-3) is a large language model released by OpenAI in 2020.
- Like its predecessor, GPT-2, it is a decoder-only[2] transformer model of deep neural network, which supersedes recurrence and convolution-based architectures with a technique known as "attention".[3]
- It uses a 2048-tokens-long context[jargon], float16 (16-bit) precision, and a hitherto-unprecedented 175 billion parameters, requiring 350GB of storage space as each parameter takes 2 bytes of space, and has demonstrated strong "zero-shot" and "few-shot" learning abilities on many tasks.
- "GPT-3 equivalent" in terms of floating point operations that were needed to train gpt3, as well as space requirements, energy requirements, etc. Algorithmic improvements that make a smaller model as good as gpt3 as an LLM would not count for the purpose of this question.