| ProgramBench (Vals AI) | 2.0% | $70.48 per test | Duration, as printed 5h 42m |
| IOI (Vals AI) | 48.9% | $14.17 per test | Duration, as printed 4h 18m |
| Terminal-Bench 2.1 (Vals AI) | 80.9% | $0.34 per test | Duration, as printed 10m 09s |
| SWE-bench Multimodal (Vals AI) | 44.2% | $1.65 per test | Duration, as printed 22m 45s |
| Vibe Code Bench 1-100 (Vals AI) | 18.2% | $9.40 per test | Duration, as printed 1h 48m |
| CyberBench (Vals AI) | 75.2% | $2.13 per test | Duration, as printed 30m 44s |
| Finance Agent (Vals AI) | 53.1% | $1.91 per test | Duration, as printed 4m 46s |
| Tax Agent Bench (Vals AI) | 33.4% | $2.79 per test | Duration, as printed 40m 15s |
| Legal Research Bench (Vals AI) | 46.1% | $3.47 per test | Duration, as printed 12m 40s |
| Harvey's Legal Agent Benchmark (Vals AI) | 12.9% | $4.14 per test | Duration, as printed 42m 36s |
| Excel Modeling Benchmark (Vals AI) | 66.7% | $3.07 per test | Duration, as printed 12m 21s |
| BioMysteryBench (Vals AI) | 72.6% | $1.06 per test | Duration, as printed 4m 55s |
| Terminal-Bench-Science (Vals AI) | 1.4% | $21.30 per test | Duration, as printed 4h 49m |
| Public Benefits Bench (Vals AI) | 68.2% | $0.91 per test | Nothing else |
| Vals Multimodal Index | 73.4% | $1.70 per test | Duration, as printed 15m 06s |
| DeepSWE | 68.5% | $4.6547 mean cost per task | Solved in 4 tries 89.4% · Output tokens per task 81,500 · Agent steps per task 98 |
| FrontierSWE | 25.9% | $109.71 average cost per task | Best of 5 runs 37.5% · Hours per task 18.4 h |
| WeirdML | 82.6% | $2.0537 per run | Median lines of code 244 |
| ARC-AGI | 94.5% | $0.7705 per task | Nothing else |
| ARC-AGI-2 | 60.4% | $1.5927 per task | Nothing else |
| ProofBench | 87.0% | $1.6468 per test | Time per proof 34m 31s |
| Surface Evolver Bench | 95.0% | $12.1422 of the run | Pass rate 87.5% · Tokens for the run 3.7M |
| ALE-Bench | 1524.5 | $1.2816 per problem | Tokens per problem 88,294 |
| LMArena WebDev | 1655 Elo | Not published | Votes 19,592 · Interval (±) ±6.0 |
| GPQA Diamond | 92.9% | Not published | Latency, as printed 2m 02s |
| MMLU Pro | 88.0% | Not published | Latency, as printed 39 s |
| Design Arena: websites | 1335 Elo | Not published | Battles 4,110 |
| Design Arena: UI components | 1346 Elo | Not published | Battles 499 |
| Design Arena: game dev | 1362 Elo | Not published | Battles 827 |
| Design Arena: data viz | 1350 Elo | Not published | Battles 714 |
| Design Arena: 3D | 1388 Elo | Not published | Battles 3,366 |
| Design Arena: all code categories | 1361 Elo | Not published | Battles 8,934 |
| Design Arena: SVG | 1300 Elo | Not published | Battles 1,070 |
| Design Arena: agents building web apps | 1293 Elo | Not published | Battles 1,916 |
| Design Arena: agents building full-stack apps | 1315 Elo | Not published | Battles 1,316 |
| Design Arena: agents building mobile apps | 1267 Elo | Not published | Battles 1,106 |
| Design Arena: agents building Android apps | 1263 Elo | Not published | Battles 455 |
| Design Arena: agents building Godot games | 1223 Elo | Not published | Battles 587 |
| Design Arena: agents building games | 1251 Elo | Not published | Battles 699 |
| Design Arena: HTML slides | 1256 Elo | Not published | Battles 3,960 |
| Design Arena: PowerPoint slides | 1273 Elo | Not published | Battles 3,281 |
| LiveCodeBench (Vals AI) | 87.2% | Not published | Latency, as printed 3m 20s |
| MMMU Pro (Vals AI) | 88.2% | Not published | Latency, as printed 1m 47s |
| SAGE (Vals AI) | 52.8% | Not published | Latency, as printed 47 s |
| LegalBench (Vals AI) | 86.2% | Not published | Latency, as printed 7.1 s |
| CorpFin (Vals AI) | 71.6% | Not published | Latency, as printed 38 s |
| TaxEval (Vals AI) | 75.7% | Not published | Latency, as printed 2m 25s |
| MortgageTax (Vals AI) | 66.3% | Not published | Latency, as printed 1m 19s |
| MedCode (Vals AI) | 49.4% | Not published | Latency, as printed 37 s |
| MedScribe (Vals AI) | 88.0% | Not published | Latency, as printed 38 s |
| APEX-Agents | 47.8% | Not published | Mean score 62.2% |
| LMArena Text | 1475 Elo | Not published | Votes 32,795 · Interval (±) ±4.6 |
| LMArena Text: coding | 1507 Elo | Not published | Votes 8,306 · Interval (±) ±7.2 |
| LMArena Text: hard prompts | 1494 Elo | Not published | Votes 21,003 · Interval (±) ±5.3 |
| LMArena Text: math | 1494 Elo | Not published | Votes 1,458 · Interval (±) ±15.5 |
| LMArena Text: instruction following | 1483 Elo | Not published | Votes 10,901 · Interval (±) ±6.5 |
| LMArena Text: creative writing | 1456 Elo | Not published | Votes 6,646 · Interval (±) ±8.2 |
| LMArena Text: English | 1481 Elo | Not published | Votes 12,464 · Interval (±) ±6.1 |
| LMArena Text: non-English | 1464 Elo | Not published | Votes 20,322 · Interval (±) ±5.3 |
| LMArena Text: Chinese | 1528 Elo | Not published | Votes 2,372 · Interval (±) ±12.6 |
| LMArena Text: German | 1489 Elo | Not published | Votes 651 · Interval (±) ±23.9 |
| LMArena Text: Japanese | 1489 Elo | Not published | Votes 614 · Interval (±) ±26.1 |
| LMArena Text: Korean | 1460 Elo | Not published | Votes 700 · Interval (±) ±22.7 |
| LMArena Text: French | 1488 Elo | Not published | Votes 1,216 · Interval (±) ±18.4 |
| LMArena Text: Spanish | 1471 Elo | Not published | Votes 1,004 · Interval (±) ±18.8 |
| LMArena Text: Russian | 1481 Elo | Not published | Votes 4,092 · Interval (±) ±9.7 |
| LMArena Text: Polish | 1460 Elo | Not published | Votes 550 · Interval (±) ±24.5 |
| LMArena Text: multi-turn | 1488 Elo | Not published | Votes 5,013 · Interval (±) ±8.9 |
| LMArena Text: longer queries | 1493 Elo | Not published | Votes 14,255 · Interval (±) ±6.2 |
| LMArena Text: expert | 1520 Elo | Not published | Votes 3,003 · Interval (±) ±11.1 |
| LMArena Text: hard prompts in English | 1496 Elo | Not published | Votes 8,025 · Interval (±) ±7.3 |
| LMArena Text: software and IT | 1498 Elo | Not published | Votes 12,508 · Interval (±) ±6.2 |
| LMArena Text: mathematical work | 1506 Elo | Not published | Votes 1,737 · Interval (±) ±14.6 |
| LMArena Text: science | 1507 Elo | Not published | Votes 5,128 · Interval (±) ±8.7 |
| LMArena Text: medicine and healthcare | 1488 Elo | Not published | Votes 2,230 · Interval (±) ±12.9 |
| LMArena Text: legal and government | 1502 Elo | Not published | Votes 2,567 · Interval (±) ±12.1 |
| LMArena Text: business and finance | 1470 Elo | Not published | Votes 6,158 · Interval (±) ±8.1 |
| LMArena Text: writing and language | 1470 Elo | Not published | Votes 8,723 · Interval (±) ±7.3 |
| LMArena Text: entertainment and media | 1452 Elo | Not published | Votes 8,062 · Interval (±) ±7.5 |
| LMArena WebDev: React | 1670 Elo | Not published | Votes 12,988 · Interval (±) ±7.0 |
| LMArena WebDev: HTML | 1644 Elo | Not published | Votes 2,678 · Interval (±) ±13.6 |
| LMArena WebDev: from an image | 1579 Elo | Not published | Votes 3,936 · Interval (±) ±10.3 |