| IOI (Vals AI) | 47.6% | $8.18 per test | Duration, as printed 3h 57m |
| Terminal-Bench 2.1 (Vals AI) | 78.3% | $0.45 per test | Duration, as printed 10m 43s |
| Vibe Code Bench 1-100 (Vals AI) | 14.8% | $26.27 per test | Duration, as printed 2h 11m |
| SkillsBench (Vals AI) | 55.8% | $0.92 per test | Duration, as printed 13m 28s |
| CyberBench (Vals AI) | 67.7% | $4.07 per test | Duration, as printed 36m 52s |
| Finance Agent (Vals AI) | 53.7% | $1.66 per test | Duration, as printed 16m 41s |
| Tax Agent Bench (Vals AI) | 33.1% | $0.98 per test | Duration, as printed 10m 58s |
| Legal Research Bench (Vals AI) | 48.1% | $1.53 per test | Duration, as printed 25m 04s |
| Excel Modeling Benchmark (Vals AI) | 62.7% | $3.06 per test | Duration, as printed 52m 59s |
| BioMysteryBench (Vals AI) | 72.2% | $1.23 per test | Duration, as printed 14m 18s |
| Terminal-Bench-Science (Vals AI) | 11.4% | $4.82 per test | Duration, as printed 1h 18m |
| Vals Science Index | 38.1% | $2.45 per test | Duration, as printed 40m 10s |
| Public Benefits Bench (Vals AI) | 66.8% | $0.92 per test | Nothing else |
| MysteryMechanism (Vals AI) | 30.6% | $1.31 per test | Duration, as printed 27m 55s |
| DeepSWE | 67.5% | $3.449 mean cost per task | Solved in 4 tries 84.1% · Output tokens per task 49,764 · Agent steps per task 70 |
| FrontierSWE | 25.3% | $243.43 average cost per task | Best of 5 runs 37.3% · Hours per task 13.8 h |
| WeirdML | 67.3% | $0.3348 per run | Median lines of code 205 |
| ProofBench | 51.0% | $0.759 per test | Time per proof 14m 22s |
| ALE-Bench | 1508.1 | $0.2401 per problem | Tokens per problem 42,843 |
| LMArena WebDev | 1617 Elo | Not published | Votes 10,483 · Interval (±) ±7.3 |
| GPQA Diamond | 94.7% | Not published | Latency, as printed 3m 29s |
| MMLU Pro | 89.4% | Not published | Latency, as printed 55 s |
| LiveCodeBench (Vals AI) | 88.2% | Not published | Latency, as printed 1m 58s |
| SAGE (Vals AI) | 28.9% | Not published | Latency, as printed 3m 22s |
| LegalBench (Vals AI) | 86.3% | Not published | Latency, as printed 27 s |
| CorpFin (Vals AI) | 66.2% | Not published | Latency, as printed 24 s |
| TaxEval (Vals AI) | 71.1% | Not published | Latency, as printed 48 s |
| MortgageTax (Vals AI) | 64.2% | Not published | Latency, as printed 8.6 s |
| MedCode (Vals AI) | 44.7% | Not published | Latency, as printed 2m 07s |
| MedScribe (Vals AI) | 86.5% | Not published | Latency, as printed 1m 11s |
| APEX-Agents | 65.3% | Not published | Mean score 77.3% |
| LMArena Text | 1428 Elo | Not published | Votes 28,965 · Interval (±) ±4.8 |
| LMArena Text: coding | 1465 Elo | Not published | Votes 7,222 · Interval (±) ±7.7 |
| LMArena Text: hard prompts | 1447 Elo | Not published | Votes 18,782 · Interval (±) ±5.6 |
| LMArena Text: math | 1416 Elo | Not published | Votes 1,421 · Interval (±) ±15.8 |
| LMArena Text: instruction following | 1431 Elo | Not published | Votes 10,340 · Interval (±) ±6.8 |
| LMArena Text: creative writing | 1427 Elo | Not published | Votes 6,434 · Interval (±) ±8.5 |
| LMArena Vision | 1263 Elo | Not published | Votes 7,261 · Interval (±) ±8.3 |
| LMArena Text: English | 1433 Elo | Not published | Votes 11,735 · Interval (±) ±6.4 |
| LMArena Text: non-English | 1419 Elo | Not published | Votes 17,226 · Interval (±) ±5.7 |
| LMArena Text: Chinese | 1475 Elo | Not published | Votes 2,314 · Interval (±) ±12.8 |
| LMArena Text: German | 1432 Elo | Not published | Votes 507 · Interval (±) ±27.1 |
| LMArena Text: Japanese | 1380 Elo | Not published | Votes 497 · Interval (±) ±28.9 |
| LMArena Text: Korean | 1396 Elo | Not published | Votes 567 · Interval (±) ±25.8 |
| LMArena Text: French | 1457 Elo | Not published | Votes 840 · Interval (±) ±21.5 |
| LMArena Text: Spanish | 1404 Elo | Not published | Votes 789 · Interval (±) ±21.1 |
| LMArena Text: Russian | 1422 Elo | Not published | Votes 3,634 · Interval (±) ±10.2 |
| LMArena Text: Polish | 1430 Elo | Not published | Votes 436 · Interval (±) ±27.6 |
| LMArena Text: multi-turn | 1424 Elo | Not published | Votes 4,363 · Interval (±) ±9.5 |
| LMArena Text: longer queries | 1455 Elo | Not published | Votes 13,401 · Interval (±) ±6.4 |
| LMArena Text: expert | 1468 Elo | Not published | Votes 3,311 · Interval (±) ±10.7 |
| LMArena Text: hard prompts in English | 1444 Elo | Not published | Votes 7,574 · Interval (±) ±7.6 |
| LMArena Text: software and IT | 1457 Elo | Not published | Votes 10,857 · Interval (±) ±6.6 |
| LMArena Text: mathematical work | 1464 Elo | Not published | Votes 1,710 · Interval (±) ±14.7 |
| LMArena Text: science | 1437 Elo | Not published | Votes 4,815 · Interval (±) ±9.0 |
| LMArena Text: medicine and healthcare | 1421 Elo | Not published | Votes 2,044 · Interval (±) ±13.6 |
| LMArena Text: legal and government | 1427 Elo | Not published | Votes 2,481 · Interval (±) ±12.3 |
| LMArena Text: business and finance | 1416 Elo | Not published | Votes 5,368 · Interval (±) ±8.6 |
| LMArena Text: writing and language | 1429 Elo | Not published | Votes 8,265 · Interval (±) ±7.5 |
| LMArena Text: entertainment and media | 1421 Elo | Not published | Votes 7,591 · Interval (±) ±7.9 |
| LMArena WebDev: React | 1631 Elo | Not published | Votes 6,746 · Interval (±) ±8.7 |
| LMArena WebDev: HTML | 1597 Elo | Not published | Votes 1,670 · Interval (±) ±15.9 |
| LMArena WebDev: from an image | 1603 Elo | Not published | Votes 3,241 · Interval (±) ±11.1 |
| LMArena Vision: English | 1270 Elo | Not published | Votes 2,512 · Interval (±) ±12.9 |
| LMArena Vision: Chinese | 1289 Elo | Not published | Votes 380 · Interval (±) ±30.7 |
| LMArena Vision: reading text | 1272 Elo | Not published | Votes 4,881 · Interval (±) ±9.2 |
| LMArena Vision: diagrams | 1285 Elo | Not published | Votes 1,838 · Interval (±) ±14.2 |
| LMArena Vision: homework | 1283 Elo | Not published | Votes 873 · Interval (±) ±19.9 |
| LMArena Vision: humor | 1270 Elo | Not published | Votes 320 · Interval (±) ±32.5 |
| LMArena Vision: creative writing | 1262 Elo | Not published | Votes 714 · Interval (±) ±23.5 |
| LMArena Document | 1452 Elo | Not published | Votes 2,258 · Interval (±) ±12.0 |