Will general purpose AI models beat average score of human players in Diplomacy by 2028?
EsportesOne-OffIAXadrezTecnologia1a
Manifold MarketsSem KYCDados de resolução verificadosRazoavelmente calibradoPrevisão da comunidade atualSim 56.2%
Previsores
12
Tipo de pergunta
binary
Metodologia
Play-money forecasting platform
Tipo de fonte
Previsão
Dados do mercado
Atualizado há 7 horas
Desatualizado20/09/23, 20:10 UTC31/12/27, 22:59 UTC
Tendências
Regras
General purpose (not trained for a specific task) language models demonstrated chess playing ability.
- They are also capable of deception and lie detection.
- Will language models or visual-language models* beat the average score of human players during a series of 40 games on webDiplomacy.net by 2028? (question modeled after Meta's Cicero result). [EDIT: Please notice that while "CICERO achieved more than 2x the average score of its opponents" this question requires only achieving the above-average score]
- *models or agents trained on different modalities (so e. g. models capable of controlling robotic arm like PaLM-E) would also qualify as long as they weren't trained specifically to play Diplomacy
