| Terminal-Bench 2.1 (Vals AI) | 71.9% | $2.41 per test | Duration, as printed 15m 30s |
| SkillsBench (Vals AI) | 59.2% | $4.77 per test | Duration, as printed 15m 30s |
| Finance Agent (Vals AI) | 53.9% | $4.22 per test | Duration, as printed 9m 07s |
| Tax Agent Bench (Vals AI) | 30.0% | $1.69 per test | Duration, as printed 7m 59s |
| Legal Research Bench (Vals AI) | 43.8% | $2.82 per test | Duration, as printed 11m 54s |
| Excel Modeling Benchmark (Vals AI) | 69.4% | $12.06 per test | Duration, as printed 43m 52s |
| Terminal-Bench-Science (Vals AI) | 4.3% | $23.14 per test | Duration, as printed 1h 55m |
| Public Benefits Bench (Vals AI) | 68.1% | $1.89 per test | Nothing else |
| Vals Multimodal Index | 70.9% | $5.46 per test | Duration, as printed 16m 20s |
| DeepSWE | 59.0% | $13.2226 mean cost per task | Solved in 4 tries 79.3% · Output tokens per task 135,032 · Agent steps per task 120 |
| WeirdML | 82.9% | $2.3498 per run | Median lines of code 129 |
| ARC-AGI | 92.5% | $2.332 per task | Nothing else |
| ARC-AGI-2 | 72.1% | $2.7425 per task | Nothing else |
| ProofBench | 69.0% | $2.2931 per test | Time per proof 19m 26s |
| Surface Evolver Bench | 87.5% | $21.9616 of the run | Pass rate 68.8% · Tokens for the run 2.7M |
| LMArena WebDev | 1556 Elo | Not published | Votes 18,493 · Interval (±) ±5.8 |
| GPQA Diamond | 92.4% | Not published | Latency, as printed 2m 14s |
| MMLU Pro | 89.6% | Not published | Latency, as printed 23 s |
| Design Arena: websites | 1259 Elo | Not published | Battles 19,529 |
| Design Arena: UI components | 1258 Elo | Not published | Battles 2,340 |
| Design Arena: game dev | 1263 Elo | Not published | Battles 4,894 |
| Design Arena: data viz | 1239 Elo | Not published | Battles 1,843 |
| Design Arena: 3D | 1223 Elo | Not published | Battles 7,335 |
| Design Arena: all code categories | 1255 Elo | Not published | Battles 32,708 |
| Design Arena: SVG | 1193 Elo | Not published | Battles 2,872 |
| Design Arena: ASCII art | 1277 Elo | Not published | Battles 443 |
| Design Arena: agents building web apps | 1232 Elo | Not published | Battles 3,664 |
| Design Arena: agents building full-stack apps | 1249 Elo | Not published | Battles 2,700 |
| Design Arena: agents building mobile apps | 1221 Elo | Not published | Battles 1,254 |
| Design Arena: agents building Android apps | 1247 Elo | Not published | Battles 938 |
| Design Arena: agents building Godot games | 1231 Elo | Not published | Battles 1,659 |
| Design Arena: agents building games | 1238 Elo | Not published | Battles 1,375 |
| Design Arena: HTML slides | 1221 Elo | Not published | Battles 3,664 |
| Design Arena: PowerPoint slides | 1227 Elo | Not published | Battles 1,493 |
| LiveCodeBench (Vals AI) | 87.8% | Not published | Latency, as printed 2m 40s |
| MMMU Pro (Vals AI) | 86.6% | Not published | Latency, as printed 49 s |
| SAGE (Vals AI) | 54.8% | Not published | Latency, as printed 3m 06s |
| LegalBench (Vals AI) | 83.6% | Not published | Latency, as printed 3.1 s |
| CorpFin (Vals AI) | 66.7% | Not published | Latency, as printed 20 s |
| TaxEval (Vals AI) | 75.6% | Not published | Latency, as printed 1m 10s |
| MortgageTax (Vals AI) | 69.9% | Not published | Latency, as printed 21 s |
| MedCode (Vals AI) | 53.2% | Not published | Latency, as printed 1m 46s |
| MedScribe (Vals AI) | 85.8% | Not published | Latency, as printed 1m 22s |
| APEX-Agents | 48.9% | Not published | Mean score 64.4% |
| OSWorld 2.0 | 20.6% | Not published | With partial credit 54.8% |
| LMArena Text | 1461 Elo | Not published | Votes 64,100 · Interval (±) ±3.9 |
| LMArena Text: coding | 1491 Elo | Not published | Votes 17,427 · Interval (±) ±5.8 |
| LMArena Text: hard prompts | 1482 Elo | Not published | Votes 42,534 · Interval (±) ±4.5 |
| LMArena Text: math | 1486 Elo | Not published | Votes 2,969 · Interval (±) ±11.2 |
| LMArena Text: instruction following | 1476 Elo | Not published | Votes 22,679 · Interval (±) ±5.3 |
| LMArena Text: creative writing | 1454 Elo | Not published | Votes 12,797 · Interval (±) ±6.5 |
| LMArena Vision | 1294 Elo | Not published | Votes 18,303 · Interval (±) ±6.5 |
| LMArena Text: English | 1469 Elo | Not published | Votes 28,033 · Interval (±) ±5.0 |
| LMArena Text: non-English | 1450 Elo | Not published | Votes 36,060 · Interval (±) ±4.7 |
| LMArena Text: Chinese | 1507 Elo | Not published | Votes 4,397 · Interval (±) ±9.6 |
| LMArena Text: German | 1472 Elo | Not published | Votes 1,077 · Interval (±) ±18.8 |
| LMArena Text: Japanese | 1441 Elo | Not published | Votes 892 · Interval (±) ±21.9 |
| LMArena Text: Korean | 1432 Elo | Not published | Votes 1,107 · Interval (±) ±19.3 |
| LMArena Text: French | 1481 Elo | Not published | Votes 2,188 · Interval (±) ±14.3 |
| LMArena Text: Spanish | 1465 Elo | Not published | Votes 1,865 · Interval (±) ±14.7 |
| LMArena Text: Russian | 1474 Elo | Not published | Votes 7,149 · Interval (±) ±7.7 |
| LMArena Text: Polish | 1459 Elo | Not published | Votes 1,090 · Interval (±) ±17.6 |
| LMArena Text: multi-turn | 1475 Elo | Not published | Votes 11,189 · Interval (±) ±6.7 |
| LMArena Text: longer queries | 1484 Elo | Not published | Votes 30,215 · Interval (±) ±5.1 |
| LMArena Text: expert | 1503 Elo | Not published | Votes 7,067 · Interval (±) ±7.8 |
| LMArena Text: hard prompts in English | 1487 Elo | Not published | Votes 18,817 · Interval (±) ±5.7 |
| LMArena Text: software and IT | 1488 Elo | Not published | Votes 25,123 · Interval (±) ±5.2 |
| LMArena Text: mathematical work | 1497 Elo | Not published | Votes 3,480 · Interval (±) ±10.7 |
| LMArena Text: science | 1477 Elo | Not published | Votes 10,441 · Interval (±) ±6.7 |
| LMArena Text: medicine and healthcare | 1464 Elo | Not published | Votes 4,774 · Interval (±) ±9.3 |
| LMArena Text: legal and government | 1477 Elo | Not published | Votes 5,534 · Interval (±) ±8.7 |
| LMArena Text: business and finance | 1458 Elo | Not published | Votes 12,750 · Interval (±) ±6.3 |
| LMArena Text: writing and language | 1461 Elo | Not published | Votes 17,290 · Interval (±) ±5.8 |
| LMArena Text: entertainment and media | 1441 Elo | Not published | Votes 16,188 · Interval (±) ±6.0 |
| LMArena WebDev: React | 1557 Elo | Not published | Votes 11,873 · Interval (±) ±6.6 |
| LMArena WebDev: HTML | 1543 Elo | Not published | Votes 2,270 · Interval (±) ±13.7 |
| LMArena Vision: English | 1293 Elo | Not published | Votes 7,311 · Interval (±) ±9.1 |
| LMArena Vision: Chinese | 1346 Elo | Not published | Votes 1,131 · Interval (±) ±19.6 |
| LMArena Vision: reading text | 1303 Elo | Not published | Votes 12,994 · Interval (±) ±6.6 |
| LMArena Vision: diagrams | 1315 Elo | Not published | Votes 4,883 · Interval (±) ±9.5 |
| LMArena Vision: homework | 1337 Elo | Not published | Votes 2,077 · Interval (±) ±13.5 |
| LMArena Vision: humor | 1282 Elo | Not published | Votes 756 · Interval (±) ±22.2 |
| LMArena Vision: creative writing | 1301 Elo | Not published | Votes 1,398 · Interval (±) ±16.8 |
| LMArena Search | 1204 Elo | Not published | Votes 106,304 · Interval (±) ±5.6 |
| LMArena Document | 1475 Elo | Not published | Votes 11,551 · Interval (±) ±6.9 |