| SREBench (Vals AI) | 9.5% | $30.86 per test | Duration, as printed 3h 17m |
| IOI (Vals AI) | 87.6% | $8.66 per test | Duration, as printed 1h 23m |
| Terminal-Bench 2.1 (Vals AI) | 77.5% | $0.47 per test | Duration, as printed 8m 40s |
| Vibe Code Bench 1-100 (Vals AI) | 14.8% | $33.33 per test | Duration, as printed 1h 49m |
| SkillsBench (Vals AI) | 58.9% | $1.75 per test | Duration, as printed 6m 55s |
| CyberBench (Vals AI) | 72.1% | $3.31 per test | Duration, as printed 17m 04s |
| Finance Agent (Vals AI) | 54.4% | $3.63 per test | Duration, as printed 24m 10s |
| Tax Agent Bench (Vals AI) | 30.0% | $4.83 per test | Duration, as printed 1h 01m |
| Legal Research Bench (Vals AI) | 41.4% | $7.91 per test | Duration, as printed 1h 10m |
| Excel Modeling Benchmark (Vals AI) | 66.2% | $2.19 per test | Duration, as printed 13m 33s |
| Terminal-Bench-Science (Vals AI) | 10.0% | $5.19 per test | Duration, as printed 2h 04m |
| Public Benefits Bench (Vals AI) | 62.4% | $1.20 per test | Nothing else |
| Vals Multimodal Index | 65.1% | $0.80 per test | Duration, as printed 4m 18s |
| DeepSWE | 69.6% | $4.9458 mean cost per task | Solved in 4 tries 88.5% · Output tokens per task 71,939 · Agent steps per task 76 |
| WeirdML | 78.3% | $0.3119 per run | Median lines of code 177 |
| ARC-AGI | 96.5% | $0.55 per task | Nothing else |
| ARC-AGI-2 | 83.9% | $1.09 per task | Nothing else |
| ProofBench | 74.0% | $1.2742 per test | Time per proof 12m 57s |
| Surface Evolver Bench | 83.8% | $7.5899 of the run | Pass rate 68.8% · Tokens for the run 2.1M |
| ALE-Bench | 1951.4 | $1.254 per problem | Tokens per problem 86,477 |
| LMArena WebDev | 1522 Elo | Not published | Votes 13,919 · Interval (±) ±6.3 |
| GPQA Diamond | 90.9% | Not published | Latency, as printed 37 s |
| MMLU Pro | 86.7% | Not published | Latency, as printed 8.2 s |
| Design Arena: websites | 1269 Elo | Not published | Battles 36,762 |
| Design Arena: UI components | 1259 Elo | Not published | Battles 6,982 |
| Design Arena: game dev | 1230 Elo | Not published | Battles 14,796 |
| Design Arena: data viz | 1240 Elo | Not published | Battles 5,037 |
| Design Arena: 3D | 1135 Elo | Not published | Battles 17,440 |
| Design Arena: all code categories | 1242 Elo | Not published | Battles 74,620 |
| Design Arena: SVG | 1220 Elo | Not published | Battles 6,338 |
| Design Arena: ASCII art | 1178 Elo | Not published | Battles 1,415 |
| Design Arena: agents building web apps | 1120 Elo | Not published | Battles 3,489 |
| Design Arena: agents building full-stack apps | 1061 Elo | Not published | Battles 2,589 |
| Design Arena: agents building mobile apps | 1110 Elo | Not published | Battles 1,078 |
| Design Arena: agents building Android apps | 1075 Elo | Not published | Battles 1,428 |
| Design Arena: agents building games | 1082 Elo | Not published | Battles 659 |
| Design Arena: HTML slides | 1108 Elo | Not published | Battles 1,014 |
| Design Arena: PowerPoint slides | 1130 Elo | Not published | Battles 870 |
| LiveCodeBench (Vals AI) | 85.9% | Not published | Latency, as printed 44 s |
| MMMU Pro (Vals AI) | 86.5% | Not published | Latency, as printed 13 s |
| SAGE (Vals AI) | 47.0% | Not published | Latency, as printed 40 s |
| LegalBench (Vals AI) | 85.1% | Not published | Latency, as printed 2.8 s |
| CorpFin (Vals AI) | 65.3% | Not published | Latency, as printed 7.7 s |
| TaxEval (Vals AI) | 76.2% | Not published | Latency, as printed 37 s |
| MortgageTax (Vals AI) | 67.3% | Not published | Latency, as printed 6.3 s |
| MedCode (Vals AI) | 43.4% | Not published | Latency, as printed 18 s |
| MedScribe (Vals AI) | 82.9% | Not published | Latency, as printed 36 s |
| APEX-Agents | 58.2% | Not published | Mean score 71.8% |
| LMArena Text | 1447 Elo | Not published | Votes 43,271 · Interval (±) ±4.2 |
| LMArena Text: coding | 1485 Elo | Not published | Votes 11,499 · Interval (±) ±6.5 |
| LMArena Text: hard prompts | 1468 Elo | Not published | Votes 28,222 · Interval (±) ±4.9 |
| LMArena Text: math | 1465 Elo | Not published | Votes 1,946 · Interval (±) ±13.4 |
| LMArena Text: instruction following | 1456 Elo | Not published | Votes 15,379 · Interval (±) ±5.9 |
| LMArena Text: creative writing | 1412 Elo | Not published | Votes 9,176 · Interval (±) ±7.3 |
| LMArena Vision | 1271 Elo | Not published | Votes 11,842 · Interval (±) ±7.2 |
| LMArena Text: English | 1448 Elo | Not published | Votes 17,561 · Interval (±) ±5.6 |
| LMArena Text: non-English | 1440 Elo | Not published | Votes 25,702 · Interval (±) ±5.0 |
| LMArena Text: Chinese | 1515 Elo | Not published | Votes 3,415 · Interval (±) ±10.7 |
| LMArena Text: German | 1458 Elo | Not published | Votes 690 · Interval (±) ±22.8 |
| LMArena Text: Japanese | 1456 Elo | Not published | Votes 676 · Interval (±) ±25.2 |
| LMArena Text: Korean | 1427 Elo | Not published | Votes 840 · Interval (±) ±21.2 |
| LMArena Text: French | 1469 Elo | Not published | Votes 1,372 · Interval (±) ±17.5 |
| LMArena Text: Spanish | 1450 Elo | Not published | Votes 1,320 · Interval (±) ±16.7 |
| LMArena Text: Russian | 1452 Elo | Not published | Votes 4,920 · Interval (±) ±8.9 |
| LMArena Text: Polish | 1447 Elo | Not published | Votes 629 · Interval (±) ±22.9 |
| LMArena Text: multi-turn | 1452 Elo | Not published | Votes 6,941 · Interval (±) ±7.9 |
| LMArena Text: longer queries | 1453 Elo | Not published | Votes 20,120 · Interval (±) ±5.6 |
| LMArena Text: expert | 1495 Elo | Not published | Votes 5,032 · Interval (±) ±8.9 |
| LMArena Text: hard prompts in English | 1464 Elo | Not published | Votes 11,309 · Interval (±) ±6.5 |
| LMArena Text: software and IT | 1481 Elo | Not published | Votes 16,699 · Interval (±) ±5.7 |
| LMArena Text: mathematical work | 1478 Elo | Not published | Votes 2,463 · Interval (±) ±12.4 |
| LMArena Text: science | 1453 Elo | Not published | Votes 7,099 · Interval (±) ±7.7 |
| LMArena Text: medicine and healthcare | 1430 Elo | Not published | Votes 3,105 · Interval (±) ±11.3 |
| LMArena Text: legal and government | 1461 Elo | Not published | Votes 3,695 · Interval (±) ±10.3 |
| LMArena Text: business and finance | 1447 Elo | Not published | Votes 8,036 · Interval (±) ±7.4 |
| LMArena Text: writing and language | 1431 Elo | Not published | Votes 11,998 · Interval (±) ±6.5 |
| LMArena Text: entertainment and media | 1418 Elo | Not published | Votes 11,055 · Interval (±) ±6.8 |
| LMArena WebDev: React | 1513 Elo | Not published | Votes 8,787 · Interval (±) ±7.5 |
| LMArena WebDev: HTML | 1526 Elo | Not published | Votes 1,947 · Interval (±) ±14.7 |
| LMArena WebDev: from an image | 1541 Elo | Not published | Votes 4,814 · Interval (±) ±9.4 |
| LMArena Vision: English | 1272 Elo | Not published | Votes 4,052 · Interval (±) ±10.7 |
| LMArena Vision: Chinese | 1337 Elo | Not published | Votes 682 · Interval (±) ±23.6 |
| LMArena Vision: reading text | 1278 Elo | Not published | Votes 8,104 · Interval (±) ±7.7 |
| LMArena Vision: diagrams | 1295 Elo | Not published | Votes 3,090 · Interval (±) ±11.3 |
| LMArena Vision: homework | 1312 Elo | Not published | Votes 1,286 · Interval (±) ±16.7 |
| LMArena Vision: humor | 1236 Elo | Not published | Votes 526 · Interval (±) ±26.3 |
| LMArena Vision: creative writing | 1248 Elo | Not published | Votes 992 · Interval (±) ±19.9 |
| LMArena Document | 1472 Elo | Not published | Votes 5,787 · Interval (±) ±8.3 |