| IOI (Vals AI) | 68.9% | $9.47 per test | Duration, as printed 1h 47m |
| Terminal-Bench 2.1 (Vals AI) | 67.4% | $0.45 per test | Duration, as printed 14m 51s |
| SWE-bench Multimodal (Vals AI) | 42.5% | $0.99 per test | Duration, as printed 18m 44s |
| Vibe Code Bench 1-100 (Vals AI) | 12.8% | $9.68 per test | Duration, as printed 1h 36m |
| SkillsBench (Vals AI) | 42.0% | $0.52 per test | Duration, as printed 15m 48s |
| CyberBench (Vals AI) | 28.6% | $0.78 per test | Duration, as printed 9m 40s |
| Finance Agent (Vals AI) | 50.6% | $1.24 per test | Duration, as printed 19m 35s |
| Tax Agent Bench (Vals AI) | 32.1% | $1.55 per test | Duration, as printed 40m 36s |
| Legal Research Bench (Vals AI) | 47.6% | $2.49 per test | Duration, as printed 1h 01m |
| Excel Modeling Benchmark (Vals AI) | 60.1% | $2.66 per test | Duration, as printed 57m 47s |
| Terminal-Bench-Science (Vals AI) | 12.9% | $16.68 per test | Duration, as printed 3h 24m |
| Public Benefits Bench (Vals AI) | 67.1% | $0.99 per test | Nothing else |
| MysteryMechanism (Vals AI) | 23.9% | $1.31 per test | Duration, as printed 37m 49s |
| Vals Multimodal Index | 65.4% | $1.93 per test | Duration, as printed 33m 16s |
| DeepSWE | 57.5% | $3.7291 mean cost per task | Solved in 4 tries 83.2% · Output tokens per task 95,075 · Agent steps per task 111 |
| FrontierSWE | 17.8% | $51.27 average cost per task | Best of 5 runs 26.8% · Hours per task 19.4 h |
| ProofBench | 58.0% | $1.504 per test | Time per proof 31m 08s |
| LMArena WebDev | 1674 Elo | Not published | Votes 14,421 · Interval (±) ±7.0 |
| GPQA Diamond | 93.7% | Not published | Latency, as printed 4m 27s |
| MMLU Pro | 88.6% | Not published | Latency, as printed 1m 04s |
| Design Arena: websites | 1276 Elo | Not published | Battles 6,135 |
| Design Arena: UI components | 1340 Elo | Not published | Battles 977 |
| Design Arena: game dev | 1313 Elo | Not published | Battles 2,640 |
| Design Arena: data viz | 1281 Elo | Not published | Battles 833 |
| Design Arena: 3D | 1337 Elo | Not published | Battles 3,285 |
| Design Arena: all code categories | 1293 Elo | Not published | Battles 11,172 |
| Design Arena: ASCII art | 1199 Elo | Not published | Battles 246 |
| Design Arena: agents building web apps | 1298 Elo | Not published | Battles 1,756 |
| Design Arena: agents building full-stack apps | 1305 Elo | Not published | Battles 1,327 |
| Design Arena: agents building mobile apps | 1221 Elo | Not published | Battles 1,565 |
| Design Arena: agents building Godot games | 1234 Elo | Not published | Battles 453 |
| Design Arena: PowerPoint slides | 1256 Elo | Not published | Battles 384 |
| Design Arena: spreadsheets | 1015 Elo | Not published | Battles 34 |
| LiveCodeBench (Vals AI) | 87.8% | Not published | Latency, as printed 5m 38s |
| MMMU Pro (Vals AI) | 88.0% | Not published | Latency, as printed 44 s |
| SAGE (Vals AI) | 51.2% | Not published | Latency, as printed 2m 13s |
| LegalBench (Vals AI) | 83.6% | Not published | Latency, as printed 36 s |
| CorpFin (Vals AI) | 65.8% | Not published | Latency, as printed 47 s |
| TaxEval (Vals AI) | 75.5% | Not published | Latency, as printed 4m 26s |
| MortgageTax (Vals AI) | 64.0% | Not published | Latency, as printed 48 s |
| MedCode (Vals AI) | 40.7% | Not published | Latency, as printed 6m 18s |
| MedScribe (Vals AI) | 85.0% | Not published | Latency, as printed 4m 11s |
| APEX-Agents | 63.3% | Not published | Mean score 74.3% |
| LMArena Text | 1483 Elo | Not published | Votes 27,766 · Interval (±) ±5.0 |
| LMArena Text: coding | 1502 Elo | Not published | Votes 7,677 · Interval (±) ±7.5 |
| LMArena Text: hard prompts | 1495 Elo | Not published | Votes 18,366 · Interval (±) ±5.6 |
| LMArena Text: math | 1502 Elo | Not published | Votes 1,401 · Interval (±) ±15.9 |
| LMArena Text: instruction following | 1479 Elo | Not published | Votes 9,874 · Interval (±) ±6.8 |
| LMArena Text: creative writing | 1479 Elo | Not published | Votes 5,471 · Interval (±) ±8.9 |
| LMArena Vision | 1313 Elo | Not published | Votes 9,957 · Interval (±) ±7.5 |
| LMArena Text: English | 1492 Elo | Not published | Votes 10,584 · Interval (±) ±6.6 |
| LMArena Text: non-English | 1472 Elo | Not published | Votes 17,180 · Interval (±) ±5.7 |
| LMArena Text: Chinese | 1536 Elo | Not published | Votes 2,058 · Interval (±) ±13.6 |
| LMArena Text: German | 1483 Elo | Not published | Votes 433 · Interval (±) ±27.2 |
| LMArena Text: Japanese | 1469 Elo | Not published | Votes 505 · Interval (±) ±28.7 |
| LMArena Text: Korean | 1464 Elo | Not published | Votes 585 · Interval (±) ±25.1 |
| LMArena Text: French | 1502 Elo | Not published | Votes 969 · Interval (±) ±19.9 |
| LMArena Text: Spanish | 1492 Elo | Not published | Votes 875 · Interval (±) ±20.6 |
| LMArena Text: Russian | 1482 Elo | Not published | Votes 3,656 · Interval (±) ±10.2 |
| LMArena Text: Polish | 1472 Elo | Not published | Votes 408 · Interval (±) ±27.5 |
| LMArena Text: multi-turn | 1487 Elo | Not published | Votes 4,222 · Interval (±) ±9.6 |
| LMArena Text: longer queries | 1488 Elo | Not published | Votes 12,332 · Interval (±) ±6.5 |
| LMArena Text: expert | 1507 Elo | Not published | Votes 3,086 · Interval (±) ±10.9 |
| LMArena Text: hard prompts in English | 1504 Elo | Not published | Votes 7,058 · Interval (±) ±7.7 |
| LMArena Text: software and IT | 1498 Elo | Not published | Votes 11,018 · Interval (±) ±6.5 |
| LMArena Text: mathematical work | 1494 Elo | Not published | Votes 1,649 · Interval (±) ±14.8 |
| LMArena Text: science | 1511 Elo | Not published | Votes 4,337 · Interval (±) ±9.4 |
| LMArena Text: medicine and healthcare | 1501 Elo | Not published | Votes 1,860 · Interval (±) ±14.4 |
| LMArena Text: legal and government | 1493 Elo | Not published | Votes 2,052 · Interval (±) ±13.5 |
| LMArena Text: business and finance | 1480 Elo | Not published | Votes 5,159 · Interval (±) ±8.7 |
| LMArena Text: writing and language | 1478 Elo | Not published | Votes 7,253 · Interval (±) ±7.8 |
| LMArena Text: entertainment and media | 1465 Elo | Not published | Votes 6,908 · Interval (±) ±8.0 |
| LMArena WebDev: React | 1692 Elo | Not published | Votes 8,977 · Interval (±) ±8.3 |
| LMArena WebDev: HTML | 1649 Elo | Not published | Votes 2,529 · Interval (±) ±14.0 |
| LMArena WebDev: from an image | 1637 Elo | Not published | Votes 1,163 · Interval (±) ±18.3 |
| LMArena Vision: English | 1311 Elo | Not published | Votes 3,284 · Interval (±) ±11.4 |
| LMArena Vision: Chinese | 1358 Elo | Not published | Votes 541 · Interval (±) ±26.0 |
| LMArena Vision: reading text | 1322 Elo | Not published | Votes 6,896 · Interval (±) ±8.0 |
| LMArena Vision: diagrams | 1323 Elo | Not published | Votes 2,497 · Interval (±) ±12.2 |
| LMArena Vision: homework | 1336 Elo | Not published | Votes 909 · Interval (±) ±19.4 |
| LMArena Vision: humor | 1304 Elo | Not published | Votes 435 · Interval (±) ±29.2 |
| LMArena Vision: creative writing | 1312 Elo | Not published | Votes 747 · Interval (±) ±22.1 |
| LMArena Search | 1261 Elo | Not published | Votes 1,870 · Interval (±) ±13.2 |