| Terminal-Bench 2.1 (Vals AI) | 76.4% | $0.74 per test | Duration, as printed 7m 07s |
| SkillsBench (Vals AI) | 62.5% | $1.57 per test | Duration, as printed 4m 40s |
| Finance Agent (Vals AI) | 51.8% | $4.15 per test | Duration, as printed 11m 02s |
| Tax Agent Bench (Vals AI) | 21.8% | $4.07 per test | Duration, as printed 15m 52s |
| Legal Research Bench (Vals AI) | 40.4% | $7.40 per test | Duration, as printed 37m 45s |
| Excel Modeling Benchmark (Vals AI) | 64.5% | $3.27 per test | Duration, as printed 15m 11s |
| Public Benefits Bench (Vals AI) | 60.9% | $3.97 per test | Nothing else |
| Vals Multimodal Index | 68.1% | $3.32 per test | Duration, as printed 8m 24s |
| WeirdML | 84.9% | $2.5683 per run | Median lines of code 517 |
| OSWorld 2.0 | 13.0% | $2750.00 estimated cost | With partial credit 49.5% |
| ARC-AGI | 95.0% | $0.73 per task | Nothing else |
| ARC-AGI-2 | 85.0% | $1.87 per task | Nothing else |
| ProofBench | 50.0% | $1.6818 per test | Time per proof 49m 13s |
| Surface Evolver Bench | 88.1% | $13.8258 of the run | Pass rate 75.0% · Tokens for the run 2.0M |
| ALE-Bench | 1943.0 | $1.5171 per problem | Tokens per problem 54,091 |
| Kagi LLM Benchmark | 88.8% | $2.20 of the suite | Nothing else |
| LMArena WebDev | 1513 Elo | Not published | Votes 15,612 · Interval (±) ±6.0 |
| GPQA Diamond | 93.2% | Not published | Latency, as printed 1m 52s |
| MMLU Pro | 88.1% | Not published | Latency, as printed 42 s |
| Design Arena: websites | 1256 Elo | Not published | Battles 19,012 |
| Design Arena: UI components | 1257 Elo | Not published | Battles 2,533 |
| Design Arena: game dev | 1293 Elo | Not published | Battles 7,279 |
| Design Arena: data viz | 1264 Elo | Not published | Battles 1,644 |
| Design Arena: 3D | 1197 Elo | Not published | Battles 5,749 |
| Design Arena: all code categories | 1260 Elo | Not published | Battles 33,995 |
| Design Arena: SVG | 1234 Elo | Not published | Battles 3,272 |
| Design Arena: ASCII art | 1255 Elo | Not published | Battles 557 |
| Design Arena: agents building web apps | 1117 Elo | Not published | Battles 5,342 |
| Design Arena: agents building full-stack apps | 1089 Elo | Not published | Battles 3,539 |
| Design Arena: agents building mobile apps | 1142 Elo | Not published | Battles 843 |
| Design Arena: agents building Android apps | 1164 Elo | Not published | Battles 1,611 |
| Design Arena: agents building Godot games | 1173 Elo | Not published | Battles 1,226 |
| Design Arena: agents building games | 1179 Elo | Not published | Battles 2,275 |
| Design Arena: HTML slides | 1017 Elo | Not published | Battles 2,055 |
| Design Arena: PowerPoint slides | 1084 Elo | Not published | Battles 1,237 |
| LiveCodeBench (Vals AI) | 85.3% | Not published | Latency, as printed 2m 47s |
| MMMU Pro (Vals AI) | 88.3% | Not published | Latency, as printed 54 s |
| SAGE (Vals AI) | 51.5% | Not published | Latency, as printed 1m 16s |
| LegalBench (Vals AI) | 86.5% | Not published | Latency, as printed 18 s |
| CaseLaw (Vals AI) | 66.2% | Not published | Latency, as printed 25 s |
| CorpFin (Vals AI) | 68.4% | Not published | Latency, as printed 23 s |
| TaxEval (Vals AI) | 75.0% | Not published | Latency, as printed 1m 36s |
| MortgageTax (Vals AI) | 68.8% | Not published | Latency, as printed 28 s |
| MedCode (Vals AI) | 49.1% | Not published | Latency, as printed 2m 40s |
| MedScribe (Vals AI) | 86.9% | Not published | Latency, as printed 2m 13s |
| APEX-Agents | 55.1% | Not published | Mean score 70.3% |
| LMArena Text | 1471 Elo | Not published | Votes 69,340 · Interval (±) ±3.7 |
| LMArena Text: coding | 1494 Elo | Not published | Votes 19,152 · Interval (±) ±5.7 |
| LMArena Text: hard prompts | 1489 Elo | Not published | Votes 45,527 · Interval (±) ±4.3 |
| LMArena Text: math | 1487 Elo | Not published | Votes 3,518 · Interval (±) ±10.4 |
| LMArena Text: instruction following | 1478 Elo | Not published | Votes 24,002 · Interval (±) ±5.3 |
| LMArena Text: creative writing | 1455 Elo | Not published | Votes 13,147 · Interval (±) ±6.5 |
| LMArena Vision | 1297 Elo | Not published | Votes 28,781 · Interval (±) ±5.8 |
| LMArena Text: English | 1470 Elo | Not published | Votes 31,535 · Interval (±) ±4.8 |
| LMArena Text: non-English | 1467 Elo | Not published | Votes 37,804 · Interval (±) ±4.5 |
| LMArena Text: Chinese | 1534 Elo | Not published | Votes 4,471 · Interval (±) ±9.7 |
| LMArena Text: German | 1480 Elo | Not published | Votes 1,113 · Interval (±) ±19.0 |
| LMArena Text: Japanese | 1499 Elo | Not published | Votes 907 · Interval (±) ±21.3 |
| LMArena Text: Korean | 1460 Elo | Not published | Votes 1,180 · Interval (±) ±18.3 |
| LMArena Text: French | 1485 Elo | Not published | Votes 2,511 · Interval (±) ±13.7 |
| LMArena Text: Spanish | 1468 Elo | Not published | Votes 1,945 · Interval (±) ±14.3 |
| LMArena Text: Russian | 1473 Elo | Not published | Votes 7,412 · Interval (±) ±7.6 |
| LMArena Text: Polish | 1465 Elo | Not published | Votes 1,168 · Interval (±) ±17.5 |
| LMArena Text: multi-turn | 1476 Elo | Not published | Votes 11,821 · Interval (±) ±6.7 |
| LMArena Text: longer queries | 1484 Elo | Not published | Votes 32,009 · Interval (±) ±5.0 |
| LMArena Text: expert | 1507 Elo | Not published | Votes 7,400 · Interval (±) ±7.7 |
| LMArena Text: hard prompts in English | 1483 Elo | Not published | Votes 21,950 · Interval (±) ±5.4 |
| LMArena Text: software and IT | 1493 Elo | Not published | Votes 27,452 · Interval (±) ±5.0 |
| LMArena Text: mathematical work | 1496 Elo | Not published | Votes 3,975 · Interval (±) ±10.1 |
| LMArena Text: science | 1485 Elo | Not published | Votes 11,611 · Interval (±) ±6.5 |
| LMArena Text: medicine and healthcare | 1465 Elo | Not published | Votes 5,318 · Interval (±) ±9.0 |
| LMArena Text: legal and government | 1491 Elo | Not published | Votes 5,610 · Interval (±) ±8.7 |
| LMArena Text: business and finance | 1478 Elo | Not published | Votes 13,713 · Interval (±) ±6.3 |
| LMArena Text: writing and language | 1466 Elo | Not published | Votes 18,160 · Interval (±) ±5.8 |
| LMArena Text: entertainment and media | 1449 Elo | Not published | Votes 16,698 · Interval (±) ±6.0 |
| LMArena WebDev: React | 1506 Elo | Not published | Votes 12,062 · Interval (±) ±6.6 |
| LMArena WebDev: HTML | 1543 Elo | Not published | Votes 1,870 · Interval (±) ±15.0 |
| LMArena WebDev: from an image | 1532 Elo | Not published | Votes 6,795 · Interval (±) ±9.2 |
| LMArena Vision: English | 1292 Elo | Not published | Votes 11,422 · Interval (±) ±8.0 |
| LMArena Vision: Chinese | 1360 Elo | Not published | Votes 1,777 · Interval (±) ±16.6 |
| LMArena Vision: reading text | 1306 Elo | Not published | Votes 20,286 · Interval (±) ±5.8 |
| LMArena Vision: diagrams | 1325 Elo | Not published | Votes 7,798 · Interval (±) ±8.1 |
| LMArena Vision: homework | 1332 Elo | Not published | Votes 3,535 · Interval (±) ±10.8 |
| LMArena Vision: humor | 1293 Elo | Not published | Votes 1,075 · Interval (±) ±18.5 |
| LMArena Vision: recognizing things | 1231 Elo | Not published | Votes 119 · Interval (±) ±52.3 |
| LMArena Vision: creative writing | 1301 Elo | Not published | Votes 2,038 · Interval (±) ±13.9 |
| LMArena Document | 1486 Elo | Not published | Votes 21,279 · Interval (±) ±6.2 |