| SREBench (Vals AI) | 1.5% | $3.44 per test | Duration, as printed 1h 42m |
| IOI (Vals AI) | 61.8% | $0.58 per test | Duration, as printed 1h 10m |
| Terminal-Bench 2.1 (Vals AI) | 79.0% | $0.05 per test | Duration, as printed 5m 56s |
| Vibe Code Bench 1-100 (Vals AI) | 22.6% | $4.91 per test | Duration, as printed 2h 03m |
| SkillsBench (Vals AI) | 60.5% | $0.21 per test | Duration, as printed 5m 20s |
| CyberBench (Vals AI) | 73.6% | $0.40 per test | Duration, as printed 16m 15s |
| Finance Agent (Vals AI) | 55.0% | $0.28 per test | Duration, as printed 12m 52s |
| Tax Agent Bench (Vals AI) | 24.8% | $0.47 per test | Duration, as printed 42m 46s |
| Legal Research Bench (Vals AI) | 36.5% | $0.85 per test | Duration, as printed 39m 34s |
| Excel Modeling Benchmark (Vals AI) | 67.1% | $0.37 per test | Duration, as printed 11m 00s |
| BioMysteryBench (Vals AI) | 61.5% | $0.09 per test | Duration, as printed 18m 31s |
| Terminal-Bench-Science (Vals AI) | 0.0% | $0.58 per test | Duration, as printed 2h 03m |
| Vals Science Index | 25.3% | $0.26 per test | Duration, as printed 50m 00s |
| Public Benefits Bench (Vals AI) | 61.2% | $0.27 per test | Nothing else |
| MysteryMechanism (Vals AI) | 14.4% | $0.11 per test | Duration, as printed 8m 13s |
| Vals Multimodal Index | 69.1% | $0.16 per test | Duration, as printed 6m 47s |
| DeepSWE | 67.2% | $3.0281 mean cost per task | Solved in 4 tries 90.3% · Output tokens per task 73,400 · Agent steps per task 102 |
| WeirdML | 60.9% | $0.20 per run | Median lines of code 289 |
| ARC-AGI | 88.0% | $0.32 per task | Nothing else |
| ARC-AGI-2 | 59.5% | $0.67 per task | Nothing else |
| ProofBench | 60.0% | $0.1233 per test | Time per proof 8m 34s |
| Surface Evolver Bench | 61.9% | $1.0079 of the run | Pass rate 18.8% · Tokens for the run 1.2M |
| ALE-Bench | 1667.4 | $0.3592 per problem | Tokens per problem 85,180 |
| LMArena WebDev | 1518 Elo | Not published | Votes 12,501 · Interval (±) ±6.4 |
| GPQA Diamond | 91.7% | Not published | Latency, as printed 54 s |
| MMLU Pro | 86.0% | Not published | Latency, as printed 17 s |
| Design Arena: websites | 1256 Elo | Not published | Battles 13,154 |
| Design Arena: UI components | 1252 Elo | Not published | Battles 1,809 |
| Design Arena: game dev | 1194 Elo | Not published | Battles 3,856 |
| Design Arena: data viz | 1210 Elo | Not published | Battles 1,032 |
| Design Arena: 3D | 1121 Elo | Not published | Battles 3,772 |
| Design Arena: all code categories | 1231 Elo | Not published | Battles 21,673 |
| Design Arena: SVG | 1194 Elo | Not published | Battles 1,549 |
| Design Arena: ASCII art | 1144 Elo | Not published | Battles 316 |
| MMMU Pro (Vals AI) | 85.0% | Not published | Latency, as printed 35 s |
| SAGE (Vals AI) | 44.2% | Not published | Latency, as printed 52 s |
| LegalBench (Vals AI) | 84.0% | Not published | Latency, as printed 5.9 s |
| CorpFin (Vals AI) | 64.2% | Not published | Latency, as printed 17 s |
| TaxEval (Vals AI) | 76.2% | Not published | Latency, as printed 1m 17s |
| MortgageTax (Vals AI) | 67.3% | Not published | Latency, as printed 23 s |
| MedCode (Vals AI) | 42.4% | Not published | Latency, as printed 1m 21s |
| MedScribe (Vals AI) | 84.4% | Not published | Latency, as printed 1m 57s |
| APEX-Agents | 43.0% | Not published | Mean score 57.8% |
| LMArena Text | 1431 Elo | Not published | Votes 41,109 · Interval (±) ±4.3 |
| LMArena Text: coding | 1466 Elo | Not published | Votes 11,127 · Interval (±) ±6.6 |
| LMArena Text: hard prompts | 1451 Elo | Not published | Votes 27,008 · Interval (±) ±5.0 |
| LMArena Text: math | 1459 Elo | Not published | Votes 1,927 · Interval (±) ±13.7 |
| LMArena Text: instruction following | 1437 Elo | Not published | Votes 14,621 · Interval (±) ±6.1 |
| LMArena Text: creative writing | 1396 Elo | Not published | Votes 8,603 · Interval (±) ±7.5 |
| LMArena Vision | 1257 Elo | Not published | Votes 11,055 · Interval (±) ±7.4 |
| LMArena Text: English | 1441 Elo | Not published | Votes 16,656 · Interval (±) ±5.7 |
| LMArena Text: non-English | 1417 Elo | Not published | Votes 24,449 · Interval (±) ±5.1 |
| LMArena Text: Chinese | 1469 Elo | Not published | Votes 3,218 · Interval (±) ±11.1 |
| LMArena Text: German | 1455 Elo | Not published | Votes 707 · Interval (±) ±23.0 |
| LMArena Text: Japanese | 1414 Elo | Not published | Votes 644 · Interval (±) ±25.5 |
| LMArena Text: Korean | 1416 Elo | Not published | Votes 788 · Interval (±) ±21.5 |
| LMArena Text: French | 1458 Elo | Not published | Votes 1,348 · Interval (±) ±17.4 |
| LMArena Text: Spanish | 1446 Elo | Not published | Votes 1,196 · Interval (±) ±17.7 |
| LMArena Text: Russian | 1428 Elo | Not published | Votes 4,732 · Interval (±) ±9.1 |
| LMArena Text: Polish | 1404 Elo | Not published | Votes 610 · Interval (±) ±24.0 |
| LMArena Text: multi-turn | 1434 Elo | Not published | Votes 6,622 · Interval (±) ±8.0 |
| LMArena Text: longer queries | 1437 Elo | Not published | Votes 19,367 · Interval (±) ±5.7 |
| LMArena Text: expert | 1478 Elo | Not published | Votes 4,671 · Interval (±) ±9.2 |
| LMArena Text: hard prompts in English | 1460 Elo | Not published | Votes 10,955 · Interval (±) ±6.6 |
| LMArena Text: software and IT | 1463 Elo | Not published | Votes 15,935 · Interval (±) ±5.8 |
| LMArena Text: mathematical work | 1470 Elo | Not published | Votes 2,323 · Interval (±) ±12.8 |
| LMArena Text: science | 1433 Elo | Not published | Votes 6,720 · Interval (±) ±7.9 |
| LMArena Text: medicine and healthcare | 1399 Elo | Not published | Votes 3,041 · Interval (±) ±11.5 |
| LMArena Text: legal and government | 1446 Elo | Not published | Votes 3,477 · Interval (±) ±10.7 |
| LMArena Text: business and finance | 1438 Elo | Not published | Votes 7,707 · Interval (±) ±7.5 |
| LMArena Text: writing and language | 1419 Elo | Not published | Votes 11,298 · Interval (±) ±6.7 |
| LMArena Text: entertainment and media | 1402 Elo | Not published | Votes 10,794 · Interval (±) ±6.9 |
| LMArena WebDev: React | 1508 Elo | Not published | Votes 7,697 · Interval (±) ±7.8 |
| LMArena WebDev: HTML | 1520 Elo | Not published | Votes 1,799 · Interval (±) ±15.4 |
| LMArena WebDev: from an image | 1517 Elo | Not published | Votes 4,324 · Interval (±) ±9.8 |
| LMArena Vision: English | 1263 Elo | Not published | Votes 3,794 · Interval (±) ±10.9 |
| LMArena Vision: Chinese | 1294 Elo | Not published | Votes 631 · Interval (±) ±24.9 |
| LMArena Vision: reading text | 1264 Elo | Not published | Votes 7,472 · Interval (±) ±7.9 |
| LMArena Vision: diagrams | 1273 Elo | Not published | Votes 2,789 · Interval (±) ±11.7 |
| LMArena Vision: homework | 1282 Elo | Not published | Votes 1,128 · Interval (±) ±18.2 |
| LMArena Vision: humor | 1190 Elo | Not published | Votes 502 · Interval (±) ±27.4 |
| LMArena Vision: creative writing | 1257 Elo | Not published | Votes 977 · Interval (±) ±19.9 |
| LMArena Document | 1457 Elo | Not published | Votes 5,766 · Interval (±) ±8.2 |