| WeirdML | 49.9% | $0.0903 per run | Median lines of code 141 |
| ProofBench | 11.0% | $0.2441 per test | Time per proof 27m 23s |
| ALE-Bench | 944.2 | $0.0558 per problem | Tokens per problem 24,066 |
| LMArena WebDev | 1358 Elo | Not published | Votes 14,954 · Interval (±) ±6.2 |
| GPQA Diamond | 91.4% | Not published | Latency, as printed 12m 20s |
| MMLU Pro | 85.8% | Not published | Latency, as printed 10m 37s |
| Design Arena: websites | 1196 Elo | Not published | Battles 21,528 |
| Design Arena: UI components | 1193 Elo | Not published | Battles 3,955 |
| Design Arena: game dev | 1174 Elo | Not published | Battles 7,327 |
| Design Arena: data viz | 1179 Elo | Not published | Battles 3,200 |
| Design Arena: 3D | 1125 Elo | Not published | Battles 11,695 |
| Design Arena: all code categories | 1187 Elo | Not published | Battles 41,076 |
| Design Arena: SVG | 1081 Elo | Not published | Battles 3,416 |
| Design Arena: ASCII art | 1126 Elo | Not published | Battles 600 |
| Design Arena: agents building web apps | 1126 Elo | Not published | Battles 6,416 |
| Design Arena: agents building full-stack apps | 1006 Elo | Not published | Battles 3,448 |
| Design Arena: agents building mobile apps | 1057 Elo | Not published | Battles 1,616 |
| Design Arena: agents building Android apps | 977 Elo | Not published | Battles 1,812 |
| Design Arena: agents building Godot games | 914 Elo | Not published | Battles 314 |
| Design Arena: agents building games | 1007 Elo | Not published | Battles 1,917 |
| Design Arena: HTML slides | 1008 Elo | Not published | Battles 1,937 |
| Design Arena: PowerPoint slides | 1011 Elo | Not published | Battles 896 |
| LiveCodeBench (Vals AI) | 84.5% | Not published | Latency, as printed 54m 09s |
| MMMU Pro (Vals AI) | 83.1% | Not published | Latency, as printed 2m 31s |
| SAGE (Vals AI) | 19.7% | Not published | Latency, as printed 1m 36s |
| LegalBench (Vals AI) | 84.5% | Not published | Latency, as printed 5m 48s |
| CaseLaw (Vals AI) | 79.3% | Not published | Latency, as printed 43 s |
| CorpFin (Vals AI) | 68.5% | Not published | Latency, as printed 36 s |
| TaxEval (Vals AI) | 70.8% | Not published | Latency, as printed 6m 32s |
| MortgageTax (Vals AI) | 48.3% | Not published | Latency, as printed 7m 23s |
| MedCode (Vals AI) | 38.1% | Not published | Latency, as printed 44 s |
| MedScribe (Vals AI) | 74.4% | Not published | Latency, as printed 1m 40s |
| LMArena Text | 1397 Elo | Not published | Votes 71,347 · Interval (±) ±3.6 |
| LMArena Text: coding | 1415 Elo | Not published | Votes 19,950 · Interval (±) ±5.6 |
| LMArena Text: hard prompts | 1397 Elo | Not published | Votes 47,680 · Interval (±) ±4.3 |
| LMArena Text: math | 1387 Elo | Not published | Votes 3,416 · Interval (±) ±10.7 |
| LMArena Text: instruction following | 1366 Elo | Not published | Votes 25,136 · Interval (±) ±5.2 |
| LMArena Text: creative writing | 1380 Elo | Not published | Votes 13,226 · Interval (±) ±6.5 |
| LMArena Vision | 1229 Elo | Not published | Votes 27,901 · Interval (±) ±5.8 |
| LMArena Text: English | 1404 Elo | Not published | Votes 32,785 · Interval (±) ±4.7 |
| LMArena Text: non-English | 1385 Elo | Not published | Votes 38,561 · Interval (±) ±4.5 |
| LMArena Text: Chinese | 1421 Elo | Not published | Votes 4,520 · Interval (±) ±9.5 |
| LMArena Text: German | 1395 Elo | Not published | Votes 1,043 · Interval (±) ±19.2 |
| LMArena Text: Japanese | 1379 Elo | Not published | Votes 854 · Interval (±) ±22.2 |
| LMArena Text: Korean | 1355 Elo | Not published | Votes 1,130 · Interval (±) ±19.1 |
| LMArena Text: French | 1412 Elo | Not published | Votes 2,581 · Interval (±) ±13.7 |
| LMArena Text: Spanish | 1399 Elo | Not published | Votes 2,009 · Interval (±) ±14.5 |
| LMArena Text: Russian | 1399 Elo | Not published | Votes 7,507 · Interval (±) ±7.6 |
| LMArena Text: Polish | 1398 Elo | Not published | Votes 1,201 · Interval (±) ±17.5 |
| LMArena Text: multi-turn | 1406 Elo | Not published | Votes 12,856 · Interval (±) ±6.5 |
| LMArena Text: longer queries | 1393 Elo | Not published | Votes 33,219 · Interval (±) ±4.9 |
| LMArena Text: expert | 1385 Elo | Not published | Votes 7,539 · Interval (±) ±7.8 |
| LMArena Text: hard prompts in English | 1402 Elo | Not published | Votes 22,457 · Interval (±) ±5.4 |
| LMArena Text: software and IT | 1416 Elo | Not published | Votes 28,538 · Interval (±) ±5.0 |
| LMArena Text: mathematical work | 1397 Elo | Not published | Votes 3,938 · Interval (±) ±10.2 |
| LMArena Text: science | 1399 Elo | Not published | Votes 11,796 · Interval (±) ±6.5 |
| LMArena Text: medicine and healthcare | 1384 Elo | Not published | Votes 5,323 · Interval (±) ±9.1 |
| LMArena Text: legal and government | 1386 Elo | Not published | Votes 5,796 · Interval (±) ±8.7 |
| LMArena Text: business and finance | 1381 Elo | Not published | Votes 14,233 · Interval (±) ±6.2 |
| LMArena Text: writing and language | 1385 Elo | Not published | Votes 18,665 · Interval (±) ±5.7 |
| LMArena Text: entertainment and media | 1371 Elo | Not published | Votes 17,244 · Interval (±) ±5.9 |
| LMArena WebDev: React | 1353 Elo | Not published | Votes 11,475 · Interval (±) ±6.9 |
| LMArena WebDev: HTML | 1367 Elo | Not published | Votes 1,769 · Interval (±) ±15.4 |
| LMArena WebDev: from an image | 1375 Elo | Not published | Votes 5,868 · Interval (±) ±9.7 |
| LMArena Vision: English | 1235 Elo | Not published | Votes 11,160 · Interval (±) ±8.1 |
| LMArena Vision: Chinese | 1257 Elo | Not published | Votes 1,650 · Interval (±) ±17.2 |
| LMArena Vision: reading text | 1235 Elo | Not published | Votes 19,659 · Interval (±) ±5.8 |
| LMArena Vision: diagrams | 1241 Elo | Not published | Votes 7,408 · Interval (±) ±8.3 |
| LMArena Vision: homework | 1241 Elo | Not published | Votes 3,560 · Interval (±) ±10.6 |
| LMArena Vision: humor | 1222 Elo | Not published | Votes 1,069 · Interval (±) ±18.9 |
| LMArena Vision: recognizing things | 1217 Elo | Not published | Votes 142 · Interval (±) ±44.7 |
| LMArena Vision: creative writing | 1237 Elo | Not published | Votes 2,011 · Interval (±) ±14.1 |
| LMArena Search | 1166 Elo | Not published | Votes 128,393 · Interval (±) ±4.7 |