| ALE-Bench | 821.6 | $0.0475 per problem | Tokens per problem 18,681 |
| Kagi LLM Benchmark | 78.5% | $0.50 of the suite | Nothing else |
| LMArena WebDev | 1437 Elo | Not published | Votes 20,091 · Interval (±) ±5.2 |
| GPQA Diamond | 84.1% | Not published | Latency, as printed 2m 32s |
| AIME | 95.6% | Not published | Latency, as printed 5m 23s |
| MMLU Pro | 85.9% | Not published | Latency, as printed 39 s |
| Design Arena: websites | 1248 Elo | Not published | Battles 23,394 |
| Design Arena: UI components | 1236 Elo | Not published | Battles 3,531 |
| Design Arena: game dev | 1207 Elo | Not published | Battles 5,004 |
| Design Arena: data viz | 1219 Elo | Not published | Battles 2,906 |
| Design Arena: 3D | 1205 Elo | Not published | Battles 11,631 |
| Design Arena: all code categories | 1236 Elo | Not published | Battles 41,642 |
| Design Arena: SVG | 1149 Elo | Not published | Battles 1,549 |
| Design Arena: ASCII art | 1166 Elo | Not published | Battles 931 |
| Design Arena: agents building web apps | 1136 Elo | Not published | Battles 3,435 |
| Design Arena: agents building full-stack apps | 1114 Elo | Not published | Battles 1,787 |
| Design Arena: agents building mobile apps | 1147 Elo | Not published | Battles 1,391 |
| Design Arena: agents building Android apps | 1118 Elo | Not published | Battles 554 |
| LiveCodeBench (Vals AI) | 83.9% | Not published | Latency, as printed 3m 20s |
| MMMU Pro (Vals AI) | 84.3% | Not published | Latency, as printed 1m 50s |
| SAGE (Vals AI) | 49.9% | Not published | Latency, as printed 2m 53s |
| CaseLaw (Vals AI) | 58.7% | Not published | Latency, as printed 4m 01s |
| CorpFin (Vals AI) | 68.3% | Not published | Latency, as printed 1m 21s |
| TaxEval (Vals AI) | 74.2% | Not published | Latency, as printed 1m 30s |
| MortgageTax (Vals AI) | 66.5% | Not published | Latency, as printed 1m 20s |
| MedQA (Vals AI) | 94.4% | Not published | Latency, as printed 42 s |
| MedCode (Vals AI) | 39.3% | Not published | Latency, as printed 1m 15s |
| MedScribe (Vals AI) | 76.4% | Not published | Latency, as printed 2m 27s |
| LMArena Text | 1445 Elo | Not published | Votes 74,712 · Interval (±) ±3.3 |
| LMArena Text: coding | 1483 Elo | Not published | Votes 1,871 · Interval (±) ±13.4 |
| LMArena Text: hard prompts | 1453 Elo | Not published | Votes 47,893 · Interval (±) ±3.9 |
| LMArena Text: math | 1470 Elo | Not published | Votes 4,174 · Interval (±) ±9.3 |
| LMArena Text: instruction following | 1431 Elo | Not published | Votes 24,195 · Interval (±) ±4.8 |
| LMArena Text: creative writing | 1422 Elo | Not published | Votes 12,259 · Interval (±) ±6.2 |
| LMArena Vision | 1269 Elo | Not published | Votes 28,249 · Interval (±) ±5.7 |
| LMArena Text: English | 1453 Elo | Not published | Votes 31,744 · Interval (±) ±4.4 |
| LMArena Text: non-English | 1433 Elo | Not published | Votes 42,965 · Interval (±) ±3.9 |
| LMArena Text: Chinese | 1494 Elo | Not published | Votes 4,609 · Interval (±) ±9.1 |
| LMArena Text: German | 1441 Elo | Not published | Votes 1,287 · Interval (±) ±17.4 |
| LMArena Text: Japanese | 1423 Elo | Not published | Votes 850 · Interval (±) ±21.6 |
| LMArena Text: Korean | 1412 Elo | Not published | Votes 1,355 · Interval (±) ±17.2 |
| LMArena Text: French | 1454 Elo | Not published | Votes 2,628 · Interval (±) ±13.0 |
| LMArena Text: Spanish | 1450 Elo | Not published | Votes 2,535 · Interval (±) ±12.7 |
| LMArena Text: Russian | 1435 Elo | Not published | Votes 8,843 · Interval (±) ±6.7 |
| LMArena Text: Polish | 1445 Elo | Not published | Votes 1,521 · Interval (±) ±14.8 |
| LMArena Text: multi-turn | 1444 Elo | Not published | Votes 13,147 · Interval (±) ±6.0 |
| LMArena Text: longer queries | 1445 Elo | Not published | Votes 29,803 · Interval (±) ±4.7 |
| LMArena Text: expert | 1466 Elo | Not published | Votes 7,015 · Interval (±) ±7.6 |
| LMArena Text: hard prompts in English | 1460 Elo | Not published | Votes 21,040 · Interval (±) ±5.2 |
| LMArena Text: software and IT | 1471 Elo | Not published | Votes 2,884 · Interval (±) ±10.7 |
| LMArena Text: mathematical work | 1473 Elo | Not published | Votes 4,063 · Interval (±) ±9.6 |
| LMArena Text: science | 1459 Elo | Not published | Votes 11,807 · Interval (±) ±6.0 |
| LMArena Text: medicine and healthcare | 1448 Elo | Not published | Votes 5,167 · Interval (±) ±8.7 |
| LMArena Text: legal and government | 1441 Elo | Not published | Votes 5,645 · Interval (±) ±8.3 |
| LMArena Text: business and finance | 1427 Elo | Not published | Votes 14,399 · Interval (±) ±5.7 |
| LMArena Text: writing and language | 1425 Elo | Not published | Votes 17,922 · Interval (±) ±5.3 |
| LMArena Text: entertainment and media | 1417 Elo | Not published | Votes 15,483 · Interval (±) ±5.7 |
| LMArena WebDev: React | 1429 Elo | Not published | Votes 16,155 · Interval (±) ±5.8 |
| LMArena WebDev: HTML | 1426 Elo | Not published | Votes 2,585 · Interval (±) ±12.4 |
| LMArena WebDev: from an image | 1439 Elo | Not published | Votes 1,653 · Interval (±) ±17.3 |
| LMArena Vision: English | 1274 Elo | Not published | Votes 10,972 · Interval (±) ±7.7 |
| LMArena Vision: Chinese | 1328 Elo | Not published | Votes 273 · Interval (±) ±34.0 |
| LMArena Vision: reading text | 1276 Elo | Not published | Votes 19,489 · Interval (±) ±5.7 |
| LMArena Vision: diagrams | 1282 Elo | Not published | Votes 7,385 · Interval (±) ±7.9 |
| LMArena Vision: homework | 1297 Elo | Not published | Votes 3,649 · Interval (±) ±10.2 |
| LMArena Vision: humor | 1284 Elo | Not published | Votes 1,083 · Interval (±) ±18.1 |
| LMArena Vision: captioning | 1257 Elo | Not published | Votes 125 · Interval (±) ±48.2 |
| LMArena Vision: recognizing things | 1285 Elo | Not published | Votes 275 · Interval (±) ±32.1 |
| LMArena Vision: creative writing | 1269 Elo | Not published | Votes 1,768 · Interval (±) ±14.4 |