| SREBench (Vals AI) | 30.5% | $42.52 per test | Duration, as printed 1h 28m |
| IOI (Vals AI) | 91.2% | $7.98 per test | Duration, as printed 1h 02m |
| Terminal-Bench 2.1 (Vals AI) | 85.8% | $1.02 per test | Duration, as printed 6m 13s |
| Vibe Code Bench 1-100 (Vals AI) | 20.0% | $47.43 per test | Duration, as printed 2h 37m |
| SkillsBench (Vals AI) | 54.1% | $4.14 per test | Duration, as printed 13m 07s |
| CyberBench (Vals AI) | 76.3% | $3.05 per test | Duration, as printed 10m 47s |
| Finance Agent (Vals AI) | 53.8% | $1.25 per test | Duration, as printed 19m 25s |
| Tax Agent Bench (Vals AI) | 31.1% | $7.51 per test | Duration, as printed 44m 41s |
| Legal Research Bench (Vals AI) | 48.1% | $21.61 per test | Duration, as printed 1h 17m |
| Excel Modeling Benchmark (Vals AI) | 72.3% | $6.01 per test | Duration, as printed 9m 50s |
| BioMysteryBench (Vals AI) | 71.1% | $1.93 per test | Duration, as printed 18m 18s |
| Terminal-Bench-Science (Vals AI) | 20.0% | $7.32 per test | Duration, as printed 1h 44m |
| Vals Science Index | 41.5% | $3.40 per test | Duration, as printed 43m 32s |
| Public Benefits Bench (Vals AI) | 66.5% | $8.85 per test | Nothing else |
| MysteryMechanism (Vals AI) | 33.3% | $0.96 per test | Duration, as printed 8m 43s |
| Vals Multimodal Index | 72.6% | $5.36 per test | Duration, as printed 9m 11s |
| DeepSWE | 72.7% | $8.3864 mean cost per task | Solved in 4 tries 85.8% · Output tokens per task 60,014 · Agent steps per task 61 |
| FrontierSWE | 32.2% | $179.64 average cost per task | Best of 5 runs 44.2% · Hours per task 8.6 h |
| WeirdML | 88.8% | $1.2548 per run | Median lines of code 567 |
| ARC-AGI | 97.5% | $0.40 per task | Nothing else |
| ARC-AGI-2 | 92.5% | $1.44 per task | Nothing else |
| ProofBench | 83.0% | $1.4383 per test | Time per proof 8m 40s |
| Surface Evolver Bench | 93.1% | $9.4078 of the run | Pass rate 87.5% · Tokens for the run 1.4M |
| ALE-Bench | 2176.9 | $1.5341 per problem | Tokens per problem 58,696 |
| LMArena WebDev | 1616 Elo | Not published | Votes 17,786 · Interval (±) ±5.9 |
| GPQA Diamond | 95.2% | Not published | Latency, as printed 58 s |
| MMLU Pro | 89.1% | Not published | Latency, as printed 16 s |
| Design Arena: websites | 1321 Elo | Not published | Battles 7,152 |
| Design Arena: UI components | 1338 Elo | Not published | Battles 807 |
| Design Arena: game dev | 1369 Elo | Not published | Battles 2,201 |
| Design Arena: data viz | 1323 Elo | Not published | Battles 1,450 |
| Design Arena: 3D | 1385 Elo | Not published | Battles 2,446 |
| Design Arena: all code categories | 1342 Elo | Not published | Battles 13,407 |
| Design Arena: SVG | 1316 Elo | Not published | Battles 1,205 |
| Design Arena: ASCII art | 1300 Elo | Not published | Battles 246 |
| Design Arena: agents building web apps | 1248 Elo | Not published | Battles 2,524 |
| Design Arena: agents building full-stack apps | 1261 Elo | Not published | Battles 1,977 |
| Design Arena: agents building mobile apps | 1250 Elo | Not published | Battles 1,098 |
| Design Arena: agents building Android apps | 1255 Elo | Not published | Battles 635 |
| Design Arena: agents building Godot games | 1260 Elo | Not published | Battles 595 |
| Design Arena: agents building games | 1267 Elo | Not published | Battles 1,049 |
| Design Arena: HTML slides | 1286 Elo | Not published | Battles 451 |
| Design Arena: PowerPoint slides | 1240 Elo | Not published | Battles 1,215 |
| LiveCodeBench (Vals AI) | 82.6% | Not published | Latency, as printed 57 s |
| MMMU Pro (Vals AI) | 88.8% | Not published | Latency, as printed 26 s |
| SAGE (Vals AI) | 52.6% | Not published | Latency, as printed 1m 15s |
| LegalBench (Vals AI) | 87.0% | Not published | Latency, as printed 6.2 s |
| CorpFin (Vals AI) | 64.4% | Not published | Latency, as printed 16 s |
| TaxEval (Vals AI) | 74.8% | Not published | Latency, as printed 1m 02s |
| MortgageTax (Vals AI) | 67.3% | Not published | Latency, as printed 13 s |
| MedCode (Vals AI) | 44.0% | Not published | Latency, as printed 1m 37s |
| MedScribe (Vals AI) | 85.2% | Not published | Latency, as printed 1m 34s |
| OSWorld 2.0 | 27.3% | Not published | With partial credit 62.7% |
| LMArena Text | 1457 Elo | Not published | Votes 40,442 · Interval (±) ±4.3 |
| LMArena Text: coding | 1496 Elo | Not published | Votes 10,825 · Interval (±) ±6.7 |
| LMArena Text: hard prompts | 1483 Elo | Not published | Votes 26,312 · Interval (±) ±5.0 |
| LMArena Text: math | 1473 Elo | Not published | Votes 1,902 · Interval (±) ±13.7 |
| LMArena Text: instruction following | 1482 Elo | Not published | Votes 14,119 · Interval (±) ±6.1 |
| LMArena Text: creative writing | 1449 Elo | Not published | Votes 8,408 · Interval (±) ±7.6 |
| LMArena Vision | 1281 Elo | Not published | Votes 11,439 · Interval (±) ±7.3 |
| LMArena Text: English | 1458 Elo | Not published | Votes 16,314 · Interval (±) ±5.7 |
| LMArena Text: non-English | 1451 Elo | Not published | Votes 24,121 · Interval (±) ±5.1 |
| LMArena Text: Chinese | 1527 Elo | Not published | Votes 3,113 · Interval (±) ±11.3 |
| LMArena Text: German | 1476 Elo | Not published | Votes 644 · Interval (±) ±23.4 |
| LMArena Text: Japanese | 1471 Elo | Not published | Votes 623 · Interval (±) ±26.1 |
| LMArena Text: Korean | 1442 Elo | Not published | Votes 787 · Interval (±) ±22.1 |
| LMArena Text: French | 1474 Elo | Not published | Votes 1,298 · Interval (±) ±17.9 |
| LMArena Text: Spanish | 1441 Elo | Not published | Votes 1,179 · Interval (±) ±17.7 |
| LMArena Text: Russian | 1470 Elo | Not published | Votes 4,774 · Interval (±) ±9.2 |
| LMArena Text: Polish | 1461 Elo | Not published | Votes 616 · Interval (±) ±23.7 |
| LMArena Text: multi-turn | 1460 Elo | Not published | Votes 6,597 · Interval (±) ±8.1 |
| LMArena Text: longer queries | 1481 Elo | Not published | Votes 18,670 · Interval (±) ±5.8 |
| LMArena Text: expert | 1516 Elo | Not published | Votes 4,517 · Interval (±) ±9.4 |
| LMArena Text: hard prompts in English | 1477 Elo | Not published | Votes 10,621 · Interval (±) ±6.7 |
| LMArena Text: software and IT | 1489 Elo | Not published | Votes 15,703 · Interval (±) ±5.8 |
| LMArena Text: mathematical work | 1495 Elo | Not published | Votes 2,244 · Interval (±) ±13.1 |
| LMArena Text: science | 1456 Elo | Not published | Votes 6,582 · Interval (±) ±7.9 |
| LMArena Text: medicine and healthcare | 1432 Elo | Not published | Votes 2,922 · Interval (±) ±11.7 |
| LMArena Text: legal and government | 1476 Elo | Not published | Votes 3,432 · Interval (±) ±10.7 |
| LMArena Text: business and finance | 1456 Elo | Not published | Votes 7,516 · Interval (±) ±7.6 |
| LMArena Text: writing and language | 1463 Elo | Not published | Votes 10,968 · Interval (±) ±6.8 |
| LMArena Text: entertainment and media | 1450 Elo | Not published | Votes 10,300 · Interval (±) ±7.0 |
| LMArena WebDev: React | 1620 Elo | Not published | Votes 11,375 · Interval (±) ±7.0 |
| LMArena WebDev: HTML | 1618 Elo | Not published | Votes 2,443 · Interval (±) ±13.5 |
| LMArena WebDev: from an image | 1609 Elo | Not published | Votes 4,969 · Interval (±) ±9.3 |
| LMArena Vision: English | 1280 Elo | Not published | Votes 3,912 · Interval (±) ±10.8 |
| LMArena Vision: Chinese | 1313 Elo | Not published | Votes 677 · Interval (±) ±23.9 |
| LMArena Vision: reading text | 1290 Elo | Not published | Votes 7,710 · Interval (±) ±7.8 |
| LMArena Vision: diagrams | 1305 Elo | Not published | Votes 2,880 · Interval (±) ±11.7 |
| LMArena Vision: homework | 1305 Elo | Not published | Votes 1,190 · Interval (±) ±17.3 |
| LMArena Vision: humor | 1246 Elo | Not published | Votes 569 · Interval (±) ±25.2 |
| LMArena Vision: creative writing | 1283 Elo | Not published | Votes 1,039 · Interval (±) ±19.4 |
| LMArena Search | 1261 Elo | Not published | Votes 60,437 · Interval (±) ±6.3 |
| LMArena Document | 1483 Elo | Not published | Votes 4,818 · Interval (±) ±8.8 |