| Terminal-Bench 2.1 (Vals AI) | 80.5% | $1.43 per test | Duration, as printed 8m 25s |
| Finance Agent (Vals AI) | 56.3% | $8.06 per test | Duration, as printed 10m 11s |
| Tax Agent Bench (Vals AI) | 38.3% | $6.70 per test | Duration, as printed 14m 27s |
| Legal Research Bench (Vals AI) | 49.5% | $9.79 per test | Duration, as printed 22m 18s |
| Excel Modeling Benchmark (Vals AI) | 73.7% | $12.35 per test | Duration, as printed 26m 34s |
| Terminal-Bench-Science (Vals AI) | 15.7% | $51.99 per test | Duration, as printed 1h 59m |
| Public Benefits Bench (Vals AI) | 70.4% | $4.59 per test | Nothing else |
| Vals Multimodal Index | 74.2% | $7.97 per test | Duration, as printed 12m 49s |
| DeepSWE | 69.9% | $13.4145 mean cost per task | Solved in 4 tries 88.5% · Output tokens per task 80,352 · Agent steps per task 68 |
| FrontierSWE | 47.0% | $301.28 average cost per task | Best of 5 runs 61.8% · Hours per task 15.8 h |
| WeirdML | 91.9% | $8.4244 per run | Median lines of code 218 |
| ProofBench | 95.0% | $5.4515 per test | Time per proof 13m 43s |
| Surface Evolver Bench | 95.0% | $19.4352 of the run | Pass rate 87.5% · Tokens for the run 933,342 |
| ALE-Bench | 2041.3 | $2.1088 per problem | Tokens per problem 45,507 |
| LMArena WebDev | 1624 Elo | Not published | Votes 15,899 · Interval (±) ±6.1 |
| GPQA Diamond | 93.2% | Not published | Latency, as printed 1m 40s |
| MMLU Pro | 91.5% | Not published | Latency, as printed 25 s |
| Design Arena: websites | 1296 Elo | Not published | Battles 10,872 |
| Design Arena: UI components | 1319 Elo | Not published | Battles 1,547 |
| Design Arena: game dev | 1335 Elo | Not published | Battles 3,461 |
| Design Arena: data viz | 1304 Elo | Not published | Battles 1,364 |
| Design Arena: 3D | 1319 Elo | Not published | Battles 4,617 |
| Design Arena: all code categories | 1311 Elo | Not published | Battles 20,216 |
| Design Arena: SVG | 1302 Elo | Not published | Battles 2,098 |
| Design Arena: ASCII art | 1329 Elo | Not published | Battles 298 |
| Design Arena: agents building web apps | 1261 Elo | Not published | Battles 2,911 |
| Design Arena: agents building full-stack apps | 1280 Elo | Not published | Battles 2,118 |
| Design Arena: agents building mobile apps | 1263 Elo | Not published | Battles 791 |
| Design Arena: agents building Android apps | 1298 Elo | Not published | Battles 461 |
| Design Arena: agents building Godot games | 1292 Elo | Not published | Battles 1,379 |
| Design Arena: agents building games | 1285 Elo | Not published | Battles 1,428 |
| Design Arena: HTML slides | 1277 Elo | Not published | Battles 2,181 |
| Design Arena: PowerPoint slides | 1295 Elo | Not published | Battles 1,914 |
| LiveCodeBench (Vals AI) | 89.8% | Not published | Latency, as printed 1m 59s |
| MMMU Pro (Vals AI) | 89.3% | Not published | Latency, as printed 1m 01s |
| SAGE (Vals AI) | 51.9% | Not published | Latency, as printed 1m 57s |
| LegalBench (Vals AI) | 88.6% | Not published | Latency, as printed 9.0 s |
| CorpFin (Vals AI) | 71.8% | Not published | Latency, as printed 53 s |
| TaxEval (Vals AI) | 76.9% | Not published | Latency, as printed 57 s |
| MortgageTax (Vals AI) | 68.9% | Not published | Latency, as printed 16 s |
| MedCode (Vals AI) | 56.1% | Not published | Latency, as printed 1m 31s |
| MedScribe (Vals AI) | 88.5% | Not published | Latency, as printed 1m 59s |
| APEX-Agents | 63.6% | Not published | Mean score 74.5% |
| LMArena Text | 1491 Elo | Not published | Votes 42,004 · Interval (±) ±4.3 |
| LMArena Text: coding | 1518 Elo | Not published | Votes 10,844 · Interval (±) ±6.6 |
| LMArena Text: hard prompts | 1507 Elo | Not published | Votes 27,374 · Interval (±) ±4.9 |
| LMArena Text: math | 1519 Elo | Not published | Votes 2,069 · Interval (±) ±13.2 |
| LMArena Text: instruction following | 1502 Elo | Not published | Votes 14,825 · Interval (±) ±6.0 |
| LMArena Text: creative writing | 1494 Elo | Not published | Votes 9,020 · Interval (±) ±7.4 |
| LMArena Vision | 1325 Elo | Not published | Votes 14,714 · Interval (±) ±7.0 |
| LMArena Text: English | 1499 Elo | Not published | Votes 17,924 · Interval (±) ±5.5 |
| LMArena Text: non-English | 1481 Elo | Not published | Votes 24,075 · Interval (±) ±5.0 |
| LMArena Text: Chinese | 1542 Elo | Not published | Votes 3,131 · Interval (±) ±11.2 |
| LMArena Text: German | 1487 Elo | Not published | Votes 650 · Interval (±) ±23.7 |
| LMArena Text: Japanese | 1506 Elo | Not published | Votes 612 · Interval (±) ±25.8 |
| LMArena Text: Korean | 1491 Elo | Not published | Votes 792 · Interval (±) ±22.6 |
| LMArena Text: French | 1504 Elo | Not published | Votes 1,430 · Interval (±) ±17.3 |
| LMArena Text: Spanish | 1496 Elo | Not published | Votes 1,314 · Interval (±) ±17.1 |
| LMArena Text: Russian | 1503 Elo | Not published | Votes 4,719 · Interval (±) ±9.2 |
| LMArena Text: Polish | 1493 Elo | Not published | Votes 623 · Interval (±) ±23.1 |
| LMArena Text: multi-turn | 1505 Elo | Not published | Votes 6,819 · Interval (±) ±7.9 |
| LMArena Text: longer queries | 1510 Elo | Not published | Votes 19,543 · Interval (±) ±5.6 |
| LMArena Text: expert | 1535 Elo | Not published | Votes 4,679 · Interval (±) ±9.3 |
| LMArena Text: hard prompts in English | 1510 Elo | Not published | Votes 11,708 · Interval (±) ±6.4 |
| LMArena Text: software and IT | 1512 Elo | Not published | Votes 15,669 · Interval (±) ±5.7 |
| LMArena Text: mathematical work | 1515 Elo | Not published | Votes 2,424 · Interval (±) ±12.6 |
| LMArena Text: science | 1506 Elo | Not published | Votes 6,883 · Interval (±) ±7.8 |
| LMArena Text: medicine and healthcare | 1481 Elo | Not published | Votes 2,983 · Interval (±) ±11.6 |
| LMArena Text: legal and government | 1499 Elo | Not published | Votes 3,514 · Interval (±) ±10.7 |
| LMArena Text: business and finance | 1480 Elo | Not published | Votes 8,357 · Interval (±) ±7.2 |
| LMArena Text: writing and language | 1501 Elo | Not published | Votes 11,803 · Interval (±) ±6.6 |
| LMArena Text: entertainment and media | 1482 Elo | Not published | Votes 10,958 · Interval (±) ±6.8 |
| LMArena WebDev: React | 1631 Elo | Not published | Votes 11,075 · Interval (±) ±7.1 |
| LMArena WebDev: HTML | 1651 Elo | Not published | Votes 2,175 · Interval (±) ±14.7 |
| LMArena WebDev: from an image | 1623 Elo | Not published | Votes 5,855 · Interval (±) ±8.9 |
| LMArena Vision: English | 1323 Elo | Not published | Votes 5,874 · Interval (±) ±9.7 |
| LMArena Vision: Chinese | 1373 Elo | Not published | Votes 784 · Interval (±) ±22.7 |
| LMArena Vision: reading text | 1337 Elo | Not published | Votes 10,497 · Interval (±) ±7.3 |
| LMArena Vision: diagrams | 1357 Elo | Not published | Votes 3,956 · Interval (±) ±10.3 |
| LMArena Vision: homework | 1361 Elo | Not published | Votes 1,751 · Interval (±) ±14.7 |
| LMArena Vision: humor | 1341 Elo | Not published | Votes 583 · Interval (±) ±25.3 |
| LMArena Vision: creative writing | 1338 Elo | Not published | Votes 1,159 · Interval (±) ±18.6 |
| LMArena Search | 1229 Elo | Not published | Votes 73,596 · Interval (±) ±6.5 |
| LMArena Document | 1496 Elo | Not published | Votes 8,497 · Interval (±) ±7.9 |