| SREBench (Vals AI) | 12.2% | $23.63 per test | Duration, as printed 1h 21m |
| IOI (Vals AI) | 84.3% | $16.48 per test | Duration, as printed 56m 42s |
| Terminal-Bench 2.1 (Vals AI) | 84.6% | $0.89 per test | Duration, as printed 12m 33s |
| Vibe Code Bench 1-100 (Vals AI) | 28.5% | $41.49 per test | Duration, as printed 1h 22m |
| SkillsBench (Vals AI) | 60.4% | $2.51 per test | Duration, as printed 8m 25s |
| CyberBench (Vals AI) | 65.4% | $2.87 per test | Duration, as printed 19m 25s |
| Finance Agent (Vals AI) | 58.6% | $5.12 per test | Duration, as printed 9m 58s |
| Tax Agent Bench (Vals AI) | 45.5% | $5.14 per test | Duration, as printed 16m 48s |
| Legal Research Bench (Vals AI) | 55.3% | $6.76 per test | Duration, as printed 31m 01s |
| Excel Modeling Benchmark (Vals AI) | 73.6% | $6.07 per test | Duration, as printed 25m 59s |
| BioMysteryBench (Vals AI) | 79.3% | $3.29 per test | Duration, as printed 36m 36s |
| Terminal-Bench-Science (Vals AI) | 27.1% | $32.54 per test | Duration, as printed 2h 12m |
| Vals Science Index | 47.9% | $13.04 per test | Duration, as printed 1h 02m |
| Public Benefits Bench (Vals AI) | 76.9% | $3.95 per test | Nothing else |
| MysteryMechanism (Vals AI) | 37.4% | $3.28 per test | Duration, as printed 16m 53s |
| Vals Multimodal Index | 73.9% | $6.14 per test | Duration, as printed 14m 14s |
| DeepSWE | 73.6% | $11.8376 mean cost per task | Solved in 4 tries 88.5% · Output tokens per task 117,566 · Agent steps per task 99 |
| FrontierSWE | 52.0% | $196.71 average cost per task | Best of 5 runs 60.7% · Hours per task 16.1 h |
| WeirdML | 91.8% | $4.742 per run | Median lines of code 245 |
| ProofBench | 99.0% | $2.1062 per test | Time per proof 9m 51s |
| ALE-Bench | 2164.6 | $1.8905 per problem | Tokens per problem 78,951 |
| LMArena WebDev | 1689 Elo | Not published | Votes 18,555 · Interval (±) ±6.2 |
| GPQA Diamond | 93.4% | Not published | Latency, as printed 40 s |
| MMLU Pro | 91.6% | Not published | Latency, as printed 9.6 s |
| Design Arena: websites | 1310 Elo | Not published | Battles 10,184 |
| Design Arena: UI components | 1348 Elo | Not published | Battles 1,605 |
| Design Arena: game dev | 1337 Elo | Not published | Battles 3,013 |
| Design Arena: data viz | 1329 Elo | Not published | Battles 1,769 |
| Design Arena: 3D | 1335 Elo | Not published | Battles 3,719 |
| Design Arena: all code categories | 1324 Elo | Not published | Battles 19,145 |
| Design Arena: SVG | 1310 Elo | Not published | Battles 1,700 |
| Design Arena: ASCII art | 1352 Elo | Not published | Battles 227 |
| Design Arena: agents building web apps | 1266 Elo | Not published | Battles 1,860 |
| Design Arena: agents building full-stack apps | 1306 Elo | Not published | Battles 1,195 |
| Design Arena: agents building Android apps | 1267 Elo | Not published | Battles 389 |
| Design Arena: agents building Godot games | 1279 Elo | Not published | Battles 793 |
| Design Arena: agents building games | 1262 Elo | Not published | Battles 782 |
| Design Arena: PowerPoint slides | 1266 Elo | Not published | Battles 605 |
| LiveCodeBench (Vals AI) | 89.0% | Not published | Latency, as printed 59 s |
| MMMU Pro (Vals AI) | 89.9% | Not published | Latency, as printed 30 s |
| SAGE (Vals AI) | 49.4% | Not published | Latency, as printed 56 s |
| LegalBench (Vals AI) | 87.0% | Not published | Latency, as printed 4.4 s |
| CorpFin (Vals AI) | 73.2% | Not published | Latency, as printed 29 s |
| TaxEval (Vals AI) | 75.1% | Not published | Latency, as printed 58 s |
| MortgageTax (Vals AI) | 72.1% | Not published | Latency, as printed 8.0 s |
| MedCode (Vals AI) | 63.6% | Not published | Latency, as printed 25 s |
| MedScribe (Vals AI) | 91.0% | Not published | Latency, as printed 1m 17s |
| APEX-Agents | 65.8% | Not published | Mean score 77.0% |
| OSWorld 2.0 | 31.4% | Not published | With partial credit 68.3% |
| LMArena Text | 1508 Elo | Not published | Votes 32,495 · Interval (±) ±4.8 |
| LMArena Text: coding | 1533 Elo | Not published | Votes 8,148 · Interval (±) ±7.5 |
| LMArena Text: hard prompts | 1526 Elo | Not published | Votes 21,001 · Interval (±) ±5.6 |
| LMArena Text: math | 1532 Elo | Not published | Votes 3,152 · Interval (±) ±11.3 |
| LMArena Text: instruction following | 1518 Elo | Not published | Votes 11,298 · Interval (±) ±6.7 |
| LMArena Text: creative writing | 1492 Elo | Not published | Votes 7,375 · Interval (±) ±8.2 |
| LMArena Vision | 1320 Elo | Not published | Votes 17,743 · Interval (±) ±6.6 |
| LMArena Text: English | 1507 Elo | Not published | Votes 13,105 · Interval (±) ±6.3 |
| LMArena Text: non-English | 1500 Elo | Not published | Votes 19,383 · Interval (±) ±5.6 |
| LMArena Text: Chinese | 1573 Elo | Not published | Votes 2,580 · Interval (±) ±12.6 |
| LMArena Text: German | 1526 Elo | Not published | Votes 554 · Interval (±) ±26.1 |
| LMArena Text: Japanese | 1515 Elo | Not published | Votes 554 · Interval (±) ±27.6 |
| LMArena Text: Korean | 1521 Elo | Not published | Votes 637 · Interval (±) ±24.4 |
| LMArena Text: French | 1520 Elo | Not published | Votes 2,058 · Interval (±) ±14.9 |
| LMArena Text: Spanish | 1519 Elo | Not published | Votes 942 · Interval (±) ±20.2 |
| LMArena Text: Russian | 1507 Elo | Not published | Votes 3,918 · Interval (±) ±10.1 |
| LMArena Text: Polish | 1520 Elo | Not published | Votes 507 · Interval (±) ±25.7 |
| LMArena Text: multi-turn | 1499 Elo | Not published | Votes 4,900 · Interval (±) ±9.1 |
| LMArena Text: longer queries | 1516 Elo | Not published | Votes 15,315 · Interval (±) ±6.3 |
| LMArena Text: expert | 1555 Elo | Not published | Votes 7,467 · Interval (±) ±8.1 |
| LMArena Text: hard prompts in English | 1523 Elo | Not published | Votes 8,411 · Interval (±) ±7.4 |
| LMArena Text: software and IT | 1527 Elo | Not published | Votes 24,848 · Interval (±) ±5.4 |
| LMArena Text: mathematical work | 1544 Elo | Not published | Votes 3,767 · Interval (±) ±10.7 |
| LMArena Text: science | 1531 Elo | Not published | Votes 5,481 · Interval (±) ±8.6 |
| LMArena Text: medicine and healthcare | 1526 Elo | Not published | Votes 2,458 · Interval (±) ±12.8 |
| LMArena Text: legal and government | 1529 Elo | Not published | Votes 2,803 · Interval (±) ±11.9 |
| LMArena Text: business and finance | 1501 Elo | Not published | Votes 6,053 · Interval (±) ±8.4 |
| LMArena Text: writing and language | 1498 Elo | Not published | Votes 9,383 · Interval (±) ±7.3 |
| LMArena Text: entertainment and media | 1480 Elo | Not published | Votes 8,667 · Interval (±) ±7.6 |
| LMArena WebDev: React | 1711 Elo | Not published | Votes 12,036 · Interval (±) ±7.3 |
| LMArena WebDev: HTML | 1680 Elo | Not published | Votes 2,295 · Interval (±) ±14.7 |
| LMArena WebDev: from an image | 1662 Elo | Not published | Votes 4,671 · Interval (±) ±9.8 |
| LMArena Vision: English | 1315 Elo | Not published | Votes 6,237 · Interval (±) ±9.3 |
| LMArena Vision: Chinese | 1400 Elo | Not published | Votes 1,037 · Interval (±) ±20.2 |
| LMArena Vision: reading text | 1329 Elo | Not published | Votes 12,218 · Interval (±) ±6.9 |
| LMArena Vision: diagrams | 1348 Elo | Not published | Votes 4,520 · Interval (±) ±9.7 |
| LMArena Vision: homework | 1338 Elo | Not published | Votes 1,899 · Interval (±) ±14.0 |
| LMArena Vision: humor | 1293 Elo | Not published | Votes 876 · Interval (±) ±20.8 |
| LMArena Vision: creative writing | 1313 Elo | Not published | Votes 1,633 · Interval (±) ±15.7 |
| LMArena Search | 1242 Elo | Not published | Votes 13,285 · Interval (±) ±6.9 |
| LMArena Document | 1516 Elo | Not published | Votes 8,794 · Interval (±) ±7.0 |