Enter opens the highlighted result. Esc closes.

GameBench 2 leaderboard

Claude Opus 5.5 leads
94.9
models measured
86
lead over #2
+0.7
median
55.7

Leader on GameBench 2 · read November 5

gamebench_2.py


        # GameBench 2, read November 5
        leaders = {
            "Claude Opus 5.5": 94.9,    "Claude Fable 5.1": 94.1,    "GPT-6 Astra": 94.0,
        }
      

On November 5, 2026, 87 of our catalog's models had a GameBench 2 result, and Anthropic Claude Opus 5.5 led with 94.9, ahead of Anthropic Claude Fable 5.1 at 94.1.

GameBench 2 asks each model to write a program that plays eight strategy games (Go, Chess, Shogi, Xiangqi, Hex, International Draughts, Game of the Amazons and Tumbleweed). DuelLab then plays the programs against each other in deterministic matches.

How to read the score: The score runs from 0 to 100 and shows expected points against a fixed reference field of player programs, averaged across the eight games. It is a relative score, not a percentage of games won; a program that fails to build counts as 0. Small gaps between models are not a firm ordering.

87 models with a result

Original board: DuelLab GameBench 2
GameBench 2 results for models in the catalog
# Model Result Cost per program First-try buildsFailed programsMatchesWinsDrawsLosses Evidence Coding index Output $/Mtok
1 Claude Opus 5.5Anthropic 94.9 $1.9869 75.0%0.0%4,1843,93980165 88.9 $20.00
2 Claude Fable 5.1Anthropic 94.1 $5.1543 75.0%0.0%4,1803,90282196 84.3 $50.00
3 GPT-6 AstraOpenAI 94.0 $1.3034 100.0%0.0%4,1843,890108186 85.1 $50.00
4 GPT-6.1 SolOpenAI 91.9 $0.2665 100.0%0.0%4,1843,80699279 82.3 $10.00
5 Claude Sonnet 5.5Anthropic 91.3 $0.5482 87.5%0.0%4,1823,667313202 87.3 $10.00
6 U Pareto 26.10Unbiased 89.7 $0.0296 100.0%0.0%4,1903,625276289 Not benchmarked $3.20
7 Gemini 4 ArgonGoogle 89.0 $0.4405 62.5%0.0%4,1803,628181371 81.0 $10.00
8 GPT-6.1 TerraOpenAI 85.7 $0.1068 100.0%0.0%4,1803,408343429 77.4 $5.00
9 GPT-6.1 Terra ProOpenAI 84.8 $0.3013 100.0%0.0%4,1743,445193536 Not benchmarked $5.00
10 Claude Opus 5Anthropic 84.7 $1.3797 100.0%0.0%6,8005,497401902 81.6 $25.00
11 Kimi K3.1 ProMoonshot AI 84.0 $0.4584 100.0%0.0%4,1943,331356507 82.2 $10.00
12 GPT-5.6 SolOpenAI 79.6 $0.7966 87.5%0.0%4,1783,154309715 70.7 $20.00
13 GPT-6 SolOpenAI 79.3 $0.2068 100.0%0.0%4,1843,191254739 72.3 $10.00
14 Muse WonderMeta 77.1 $0.4876 100.0%0.0%4,1902,934545711 72.0 $20.00
15 Claude Fable 5Anthropic 75.0 $1.4706 100.0%0.0%4,1822,944311927 75.9 $50.00
16 GLM 5.3Z.ai 72.1 $0.5497 87.5%12.5%3,6502,796401453 68.5 $4.40
17 Grok 4.7xAI 72.0 $0.3987 87.5%12.5%3,6662,891222553 66.7 $6.00
18 MiMo-V2.6-ProXiaomi 71.3 $0.0569 100.0%0.0%4,1762,7643941,018 65.4 $0.87
19 DeepSeek V4.1 Flash 1017DeepSeek 69.7 $0.0755 75.0%0.0%4,1862,5945851,007 70.3 $0.60
20 Muse Spark 1.3Meta 68.7 $0.2487 87.5%0.0%4,1782,5625441,072 57.4 $4.25
21 Grok 4.6xAI 68.6 $0.1273 75.0%0.0%4,1882,444803941 65.7 $6.00
22 Qwen3.8 Max (0902)Qwen 68.1 $0.3986 87.5%0.0%4,1842,401824959 67.1 $6.00
23 GLM 5.3 FlashXZ.ai 67.6 $0.0604 100.0%0.0%4,1842,5275191,138 Not benchmarked $1.25
24 DeepSeek V4.1 FlashDeepSeek 67.4 $0.0264 100.0%0.0%4,1882,4486781,062 56.6 $0.96
25 Qwen3.8 2.4T A95BQwen 66.7 $0.4318 75.0%0.0%4,1822,349837996 Not benchmarked $6.00
26 Gemini 3.1 Pro PreviewGoogle 64.7 $0.324 62.5%0.0%4,1822,4125511,219 32.3 $12.00
27 Gemini 3.8 FlashGoogle 64.2 $0.1432 87.5%0.0%4,1882,4354261,327 61.6 $3.75
28 E GlimpseElorian 64.1 $0.1412 75.0%0.0%4,1822,1919461,045 Not benchmarked $3.00
29 Ember-1Fireworks 62.9 $0.2989 87.5%0.0%4,1862,2507251,211 52.6 $15.00
30 Gemini 3.6 FlashGoogle 62.8 $0.4249 75.0%0.0%8,3624,4251,4662,471 62.5 $3.75
31 Gemini 3.5 FlashGoogle 62.6 $0.2706 62.5%0.0%4,1882,2566461,286 39.8 $9.00
32 Claude Opus 4.8Anthropic 62.4 $0.9312 75.0%12.5%3,6722,355484833 62.8 $25.00
33 GPT-5.4OpenAI 61.8 $1.519 87.5%12.5%3,6942,342489863 64.4 $15.00
34 Qwen3.8 FlashQwen 61.7 $0.0377 62.5%0.0%4,1882,0619611,166 Not benchmarked $0.47
35 Grok 4.5xAI 61.4 $0.0746 75.0%0.0%4,1782,1936791,306 52.3 $6.00
36 Hy4 previewTencent 61.4 $0.1212 87.5%0.0%4,1902,1008441,246 44.3 $2.501
37 GLM 5.3 FlashZ.ai 61.4 $0.0058 100.0%0.0%4,1842,1697171,298 57.7 $0.50
38 GPT-5.5OpenAI 59.7 $2.7357 87.5%12.5%3,6922,189628875 67.9 $30.00
39 Muse Spark OpenMeta 59.2 $0.1216 100.0%0.0%4,1122,0896571,366 47.3 $4.25
40 MiMo-V2.6-FlashXiaomi 58.4 $0.0178 62.5%0.0%4,1802,1794301,571 54.8 $0.28
41 Muse Spark 1.2Meta 57.4 $0.1434 100.0%0.0%4,1762,0127061,458 50.9 $4.25
42 Mistral Large 4Mistral AI 56.1 $0.1911 87.5%0.0%4,1921,7981,0081,386 63.4 $2.10
43 GPT-6 LunaOpenAI 55.8 $0.0117 100.0%0.0%4,1841,9955741,615 57.4 $0.50
44 Claude Haiku 5.5Anthropic 55.7 $0.0119 100.0%0.0%4,1781,7889541,436 70.8 $0.50
45 Claude Sonnet 5Anthropic 54.4 $0.351 100.0%0.0%4,1781,8208421,516 54.7 $10.00
46 GPT-5.6 LunaOpenAI 54.0 $0.0308 100.0%0.0%4,1821,7071,0291,446 55.3 $1.20
47 DeepSeek V4 Pro 0813DeepSeek 53.9 $0.1466 75.0%0.0%4,1921,8517371,604 56.1 $1.98
48 R Beam 1.0 501B A23BReflection 53.4 $0.0285 62.5%0.0%4,1881,8117371,640 Not benchmarked $1.20
49 GPT-5.6 TerraOpenAI 53.1 $0.3834 75.0%0.0%4,1881,7099191,560 63.8 $12.00
50 Step 5 PreviewStepFun 52.2 $0.1294 77.8%0.0%2,9351,2643951,276 61.2 $2.70
51 DeepSeek V4 Pro 0423DeepSeek 51.6 $0.0466 50.0%0.0%4,1921,7218321,639 38.7 $3.1275
52 GLM 5.2Z.ai 49.9 $0.1219 75.0%0.0%4,1821,4641,1601,558 61.1 $4.40
53 Kimi K3Moonshot AI 49.8 $0.076 87.5%0.0%4,1841,5459871,652 62.3 $15.00
54 Claude Opus 4.5Anthropic 49.8 $0.5887 100.0%0.0%4,1881,5769081,704 44.0 $25.00
55 Nemotron 3.5 Super VLNVIDIA 48.1 $0.0117 62.5%0.0%4,1961,4749841,738 19.1 $0.50
56 Nemotron 3 UltraNVIDIA 47.7 $0.0181 75.0%0.0%1,180472260448 30.0 $2.40
57 GPT-5OpenAI 46.7 $0.282 75.0%0.0%4,1841,3821,0551,747 38.8 $10.00
58 GPT-5.4 MiniOpenAI 46.3 $0.2519 87.5%0.0%4,1901,4049581,828 35.8 $4.50
59 Qwen3.8 27BQwen 43.6 $0.1957 62.5%25.0%3,1761,7052351,236 74.1 $2.55
60 Ling 3.1 FlashinclusionAI 43.5 $0.0077 37.5%0.0%2,042502658882 Not benchmarked $0.225
61 DeepSeek V4 Flash 0423DeepSeek 43.0 $0.005 62.5%0.0%4,1841,2479851,952 Not benchmarked $0.28
62 Seed-2.0-CodeByteDance Seed 41.4 $0.0507 62.5%0.0%4,1861,1191,1351,932 Not benchmarked $3.00
63 GPT-4.1OpenAI 41.1 $0.0572 62.5%0.0%4,1941,1639992,032 Not benchmarked $8.00
64 MiniMax M3.1 FlashMiniMax 40.8 $0.00 62.5%12.5%3,6961,4295191,748 58.9 $0.60
65 o3OpenAI 40.5 $0.0431 87.5%0.0%4,1821,0771,1101,995 Not benchmarked $8.00
66 Qwen3.7 MaxQwen 39.0 $0.0911 12.5%12.5%3,6761,1768621,638 54.1 $4.425
67 Gemini 3.5 Flash LiteGoogle 37.3 $0.017 56.3%6.3%7,8522,1071,8103,935 48.9 $2.50
68 Mercury 3Inception 37.3 $0.0028 87.5%0.0%4,1789911,0072,180 29.3 $0.35
69 MiMo-V2.5-ProXiaomi 36.9 $0.0078 75.0%0.0%2,6546375501,467 31.6 $0.87
70 Gemma 4 31BGoogle 36.3 $0.0038 62.5%0.0%4,1908311,2542,105 39.0 $0.40
71 Kimi K2.7 CodeMoonshot AI 34.1 $0.0994 37.5%37.5%914347318249 53.4 $4.00
72 Muse Glimmer 30BMeta 34.0 $0.0197 62.5%12.5%3,6728331,0901,749 Not benchmarked $1.20
73 gpt-oss-120bOpenAI 33.8 $0.0074 62.5%12.5%3,6509098931,848 Not benchmarked $0.50
74 T Inkling SmallThinking Machines 33.6 $0.0371 66.7%11.1%4,1849161,0662,202 27.3 $1.20
75 Grok Build 0.1xAI 33.4 $0.0607 0.0%0.0%4,2008051,0732,322 Not benchmarked $2.00
76 Qwen3.7 PlusQwen 31.3 $0.0544 12.5%25.0%3,1709626371,571 33.2 $1.28
77 T InklingThinking Machines 31.2 $0.2246 56.3%12.5%7,3401,5961,7893,955 31.6 $4.05
78 Hy3 previewTencent 31.1 $0.0032 55.6%22.2%3,6729888661,818 Not benchmarked $0.60
79 GPT-5.4 NanoOpenAI 31.0 $0.0247 31.3%25.0%6,3322,1168753,341 44.8 $1.25
80 P Laguna S 2.1RetiredPoolside 30.5 $0.003 50.0%14.3%6,3301,8491,0903,391 Not benchmarked $0.18
81 Step 3.7 FlashStepFun 29.5 $0.0142 37.5%25.0%3,0946739761,445 Not benchmarked $1.15
82 MiniMax M3MiniMax 29.0 $0.0254 50.0%25.0%3,1668965671,703 33.6 $1.20
83 LongCat 2.0Meituan 27.6 $0.0134 50.0%12.5%7,3701,5101,3924,468 Not benchmarked $1.20
84 Mistral Medium 3.5Mistral AI 27.0 $0.1747 37.5%12.5%3,6505939482,109 25.4 $7.50
85 MiMo-V2.5Xiaomi 23.8 $0.0024 43.8%31.3%5,7681,2691,3113,188 50.0 $2.00
86 Gemini 3.1 Flash LiteGoogle 19.2 $0.0101 25.0%25.0%3,1844536582,073 Not benchmarked $1.50
87 Ling 3.0 FlashinclusionAI 18.1 $0.00 37.5%37.5%5,2027121,4673,023 29.6 $0.1215

Only models in our catalog are listed, and each appears once with its best published run. 87 rows were read from the source on November 5, 2026, and rows that match no catalog model are left out. Cost per program is what DuelLab reports the model spent, on average, to write one player program, in US dollars. It covers writing the code, not playing the matches. Every other column is a figure the board publishes for the same run.

Data: DuelLab GameBench 2, licensed CC BY 4.0.

What the result is made of

GameBench 2: the parts of each result
Model Result GoChessShogiXiangqiHexInternational DraughtsGame of the AmazonsTumbleweed
Anthropic Claude Opus 5.5 94.9 82.795.797.394.898.399.497.593.1
Anthropic Claude Fable 5.1 94.1 92.195.395.389.492.597.893.197.5
OpenAI GPT-6 Astra 94.0 96.995.397.890.799.084.997.390.3
OpenAI GPT-6.1 Sol 91.9 74.594.397.894.898.087.795.593.0
Anthropic Claude Sonnet 5.5 91.3 78.696.094.882.397.290.192.298.9
Pareto 26.10 89.7 90.578.695.985.390.791.894.790.0
Google Gemini 4 Argon 89.0 94.794.491.670.795.496.982.386.3
OpenAI GPT-6.1 Terra 85.7 73.476.888.383.695.189.997.081.4
OpenAI GPT-6.1 Terra Pro 84.8 40.188.394.783.795.890.695.590.0
Anthropic Claude Opus 5 84.7 68.582.193.379.592.0Not published95.382.4
MoonshotAI Kimi K3.1 Pro 84.0 91.978.885.782.688.782.272.389.5
OpenAI GPT-5.6 Sol 79.6 73.975.377.282.173.582.886.785.2
OpenAI GPT-6 Sol 79.3 9.782.193.187.493.188.193.487.5
Meta Muse Wonder 77.1 83.866.081.480.492.083.471.958.2
Anthropic Claude Fable 5 75.0 84.479.584.884.453.784.963.864.2
Z.ai GLM 5.3 72.1 0.072.282.876.088.289.376.491.8
SpaceXAI Grok 4.7 72.0 78.079.369.892.392.10.074.290.5
Xiaomi MiMo-V2.6-Pro 71.3 51.979.083.945.683.254.287.984.8
DeepSeek V4.1 Flash 1017 69.7 67.379.645.669.270.774.770.580.3
Meta Muse Spark 1.3 68.7 75.060.980.950.176.482.256.667.5
SpaceXAI Grok 4.6 68.6 59.853.665.064.379.775.774.376.1
Qwen3.8 Max (0902) 68.1 74.648.169.783.190.961.074.443.3
Z.ai GLM 5.3 FlashX 67.6 40.667.882.677.175.879.870.446.6
DeepSeek V4.1 Flash 67.4 60.256.258.373.679.679.273.558.7
Qwen3.8 2.4T A95B 66.7 57.152.579.345.665.977.467.588.4
Google Gemini 3.1 Pro Preview 64.7 72.442.264.080.582.517.972.985.0
Google Gemini 3.8 Flash 64.2 53.469.069.746.563.886.467.856.9
Elorian Glimpse 64.1 82.043.035.554.355.681.773.187.4
Fireworks Ember-1 62.9 74.941.579.139.160.349.073.785.7
Google Gemini 3.6 Flash 62.8 54.554.166.662.781.179.449.354.7
Google Gemini 3.5 Flash 62.6 89.961.569.041.248.871.050.669.0
Anthropic Claude Opus 4.8 62.4 67.078.30.070.046.279.774.583.2
OpenAI GPT-5.4 61.8 94.80.042.355.184.078.675.564.2
Qwen3.8 Flash 61.7 50.457.065.047.968.578.173.353.1
SpaceXAI Grok 4.5 61.4 82.157.743.343.171.051.154.588.7
Tencent Hy4 preview 61.4 52.977.170.154.967.477.965.725.0
Z.ai GLM 5.3 Flash 61.4 69.245.378.373.045.678.573.727.4
OpenAI GPT-5.5 59.7 79.50.049.036.475.377.785.174.8
Meta Muse Spark Open 59.2 90.944.465.338.038.147.271.977.9
Xiaomi MiMo-V2.6-Flash 58.4 50.265.560.557.756.962.881.132.9
Meta Muse Spark 1.2 57.4 78.846.959.047.858.025.172.771.0
Mistral Large 4 56.1 33.164.842.266.046.576.477.342.2
OpenAI GPT-6 Luna 55.8 28.562.448.663.350.683.038.571.5
Anthropic Claude Haiku 5.5 55.7 44.061.565.268.154.365.255.231.9
Anthropic Claude Sonnet 5 54.4 61.041.159.151.551.226.166.279.1
OpenAI GPT-5.6 Luna 54.0 79.443.940.237.848.480.770.630.8
DeepSeek V4 Pro 0813 53.9 41.643.961.941.871.362.577.330.8
Reflection Beam 1.0 501B A23B 53.4 23.849.076.059.750.171.638.159.1
OpenAI GPT-5.6 Terra 53.1 68.658.135.341.352.677.142.948.4
StepFun Step 5 Preview 52.2 62.564.751.736.159.966.454.621.4
DeepSeek V4 Pro 0423 51.6 60.538.928.043.046.045.969.381.0
Z.ai GLM 5.2 49.9 45.052.226.955.049.682.763.823.7
MoonshotAI Kimi K3 49.8 49.941.347.444.351.944.828.090.5
Anthropic Claude Opus 4.5 49.8 70.243.048.841.048.552.848.645.2
NVIDIA Nemotron 3.5 Super VL 48.1 64.043.734.740.055.243.555.447.9
NVIDIA Nemotron 3 Ultra 47.7 54.241.852.544.684.235.337.631.3
OpenAI GPT-5 46.7 37.641.335.838.472.766.251.230.7
OpenAI GPT-5.4 Mini 46.3 68.640.842.843.045.344.744.740.9
Qwen3.8 27B 43.6 72.60.00.069.156.226.476.148.4
inclusionAI Ling 3.1 Flash 43.5 46.943.938.943.059.124.623.268.6
DeepSeek V4 Flash 0423 43.0 31.040.945.539.447.346.235.458.3
ByteDance Seed Seed-2.0-Code 41.4 39.740.440.137.346.818.944.064.1
OpenAI GPT-4.1 41.1 59.242.137.437.412.646.946.547.1
MiniMax M3.1 Flash 40.8 66.20.030.837.847.748.369.126.8
OpenAI o3 40.5 36.242.139.943.148.744.738.131.6
Qwen3.7 Max 39.0 17.743.40.042.836.957.574.139.8
Google Gemini 3.5 Flash Lite 37.3 34.739.526.546.710.853.260.126.6
Inception Mercury 3 37.3 33.141.732.539.923.063.132.832.0
Xiaomi MiMo-V2.5-Pro 36.9 54.741.453.138.519.524.939.124.4
Google Gemma 4 31B 36.3 20.942.641.342.069.025.217.531.7
MoonshotAI Kimi K2.7 Code 34.1 63.443.30.038.90.048.60.078.5
Meta Muse Glimmer 30B 34.0 29.942.336.848.143.20.046.325.7
OpenAI gpt-oss-120b 33.8 0.042.844.741.155.221.833.032.1
Thinking Machines Inkling Small 33.6 31.241.143.820.739.551.018.322.9
SpaceXAI Grok Build 0.1 33.4 35.643.028.039.548.130.914.727.2
Qwen3.7 Plus 31.3 49.642.10.00.042.066.223.726.3
Thinking Machines Inkling 31.2 38.040.946.521.415.025.728.033.7
Tencent Hy3 preview 31.1 63.138.00.042.628.612.625.138.9
OpenAI GPT-5.4 Nano 31.0 15.219.50.025.148.456.534.249.1
Poolside Laguna S 2.1Retired 30.5 48.320.038.20.046.518.943.927.9
StepFun Step 3.7 Flash 29.5 30.942.635.939.50.046.440.50.0
MiniMax M3 29.0 56.539.338.30.027.20.022.448.6
Meituan LongCat 2.0 27.6 41.219.833.722.611.233.634.524.1
Mistral Medium 3.5 27.0 0.044.135.938.634.723.813.025.9
Xiaomi MiMo-V2.5 23.8 44.520.30.040.715.037.714.217.8
Google Gemini 3.1 Flash Lite 19.2 32.30.00.041.616.220.96.236.7
inclusionAI Ling 3.0 Flash 18.1 33.519.828.021.90.08.50.033.2

The parts as DuelLab GameBench 2 publishes them, for the same run as the result.

Best model per game

GameBench 2: the leading model of each game
Game Leader Score Median across models
Go OpenAI GPT-6 Astra 96.9 57.1
Chess Anthropic Claude Sonnet 5.5 96.0 44.1
Shogi OpenAI GPT-6 Astra 97.8 48.8
Xiangqi OpenAI GPT-6.1 Sol 94.8 45.6
Hex OpenAI GPT-6 Astra 99.0 55.2
International Draughts Anthropic Claude Opus 5.5 99.4 62.6
Game of the Amazons Anthropic Claude Opus 5.5 97.5 65.7
Tumbleweed Anthropic Claude Sonnet 5.5 98.9 54.7

How a run works

  1. DuelLab gives the model the rules of one game and the interface its player must use. The model answers with the source code of a complete player program.
  2. The code is built and run in a sandbox with fixed limits on time, memory, CPU, files and network. A program that fails can be sent back for repair; one that never works counts as 0 for that game. A program too slow for the speed check is left out rather than scored.
  3. Every working program plays every other program in the game's pool, once with each side. Crashes and illegal moves count as losses.
  4. Wins, draws and losses go into a Bradley–Terry rating. DuelLab turns the rating into a score from 0 to 100: the share of points a program would be expected to take from a fixed reference field of programs.
  5. The headline score is the average of the eight game scores. Each model and reasoning setting is ranked as its own row; our model pages show a model's best setting and list the others as variants.

At a glance

Run by
DuelLab
Task
Write a program that plays a strategy game; the program then plays
Games
8 (Go, Chess, Shogi, Xiangqi, Hex, International Draughts, Game of the Amazons, Tumbleweed)
Score
0 to 100, relative to a fixed reference field
Size of the 26 October 2026 release
525,020 rated matches between 2,053 player programs
Releases
21 between July and October 2026
Data licence
CC BY 4.0 (CSV, JSON and Parquet)
In our indexes
No, shown beside the coding rankings

Role in the index

A coding board we show beside the Vibe Coding Index, not inside it: the index keeps the six boards it was defined on, so a score does not move every time a board is added. Read the methodology

Questions

Is a GameBench 2 score of 95 the share of games won?
No. It is the share of points a model's programs would be expected to take from DuelLab's fixed reference field of programs. A model at 95 wins nearly every match against that field. DuelLab refits the ratings at every release, so a score can move without the model changing.
Why does one model have several GameBench 2 scores?
DuelLab runs each model at several reasoning settings, such as Low, Medium and XHigh, and ranks each one separately. We show a model's best setting as its result and list the other settings as variants on its page.
What do first-try builds and failed programs mean?
First-try builds is the share of a model's programs that built and passed DuelLab's checks without a repair round. Failed programs is the share that never worked and scored 0. A repair that works is not penalised, so a model can score well with a lower first-try rate.
How is GameBench 2 different from chess leaderboards where models play?
On boards like Kaggle Game Arena the model chooses every move itself. In GameBench 2 the model never plays: it writes a program once, and the program plays hundreds of matches. It measures whether a model can turn the rules of a game into a working, strong engine.
Why is GameBench 2 not in the LLMBenchmark Index?
Its score is relative to DuelLab's reference field and is refitted at every release. Adding it would move our index each time DuelLab publishes, so we show it beside the coding rankings instead.