| Excel Modeling Benchmark (Vals AI) | 52.6% | $3.77 per test | Duration, as printed 11m 49s |
| BioMysteryBench (Vals AI) | 60.0% | $0.71 per test | Duration, as printed 4m 12s |
| Terminal-Bench-Science (Vals AI) | 1.4% | $5.91 per test | Duration, as printed 43m 58s |
| Vals Science Index | 27.4% | $2.56 per test | Duration, as printed 18m 03s |
| Public Benefits Bench (Vals AI) | 53.8% | $0.38 per test | Nothing else |
| MysteryMechanism (Vals AI) | 20.7% | $1.07 per test | Duration, as printed 6m 00s |
| Vals Multimodal Index | 56.1% | $0.98 per test | Duration, as printed 5m 23s |
| DeepSWE | 11.7% | $2.1434 mean cost per task | Solved in 4 tries 28.3% · Output tokens per task 28,369 · Agent steps per task 76 |
| WeirdML | 72.1% | $1.3602 per run | Median lines of code 212 |
| ARC-AGI | 98.0% | $0.5223 per task | Nothing else |
| ARC-AGI-2 | 77.1% | $0.9622 per task | Nothing else |
| ProofBench | 26.0% | $0.7843 per test | Time per proof 14m 49s |
| ALE-Bench | 1160.6 | $0.3884 per problem | Tokens per problem 35,084 |
| LMArena WebDev | 1447 Elo | Not published | Votes 24,199 · Interval (±) ±5.1 |
| GPQA Diamond | 95.5% | Not published | Latency, as printed 1m 06s |
| AIME | 98.1% | Not published | Latency, as printed 1m 45s |
| MMLU Pro | 91.0% | Not published | Latency, as printed 24 s |
| Design Arena: websites | 1234 Elo | Not published | Battles 28,255 |
| Design Arena: UI components | 1227 Elo | Not published | Battles 3,328 |
| Design Arena: game dev | 1202 Elo | Not published | Battles 7,074 |
| Design Arena: data viz | 1209 Elo | Not published | Battles 2,418 |
| Design Arena: 3D | 1234 Elo | Not published | Battles 9,108 |
| Design Arena: all code categories | 1231 Elo | Not published | Battles 47,245 |
| Design Arena: SVG | 1284 Elo | Not published | Battles 4,620 |
| Design Arena: ASCII art | 1270 Elo | Not published | Battles 1,358 |
| Design Arena: agents building web apps | 1126 Elo | Not published | Battles 6,609 |
| Design Arena: agents building full-stack apps | 1068 Elo | Not published | Battles 4,827 |
| Design Arena: agents building mobile apps | 1093 Elo | Not published | Battles 2,911 |
| Design Arena: agents building Android apps | 1065 Elo | Not published | Battles 5,361 |
| Design Arena: agents building games | 1114 Elo | Not published | Battles 1,862 |
| Design Arena: HTML slides | 1153 Elo | Not published | Battles 1,979 |
| Design Arena: PowerPoint slides | 1063 Elo | Not published | Battles 1,341 |
| LiveCodeBench (Vals AI) | 88.5% | Not published | Latency, as printed 1m 29s |
| MMMU Pro (Vals AI) | 88.2% | Not published | Latency, as printed 1m 17s |
| SAGE (Vals AI) | 48.7% | Not published | Latency, as printed 1m 01s |
| LegalBench (Vals AI) | 87.4% | Not published | Latency, as printed 10 s |
| CaseLaw (Vals AI) | 64.8% | Not published | Latency, as printed 57 s |
| CorpFin (Vals AI) | 64.5% | Not published | Latency, as printed 25 s |
| TaxEval (Vals AI) | 72.9% | Not published | Latency, as printed 42 s |
| MortgageTax (Vals AI) | 69.4% | Not published | Latency, as printed 24 s |
| MedQA (Vals AI) | 96.4% | Not published | Latency, as printed 39 s |
| MedCode (Vals AI) | 59.1% | Not published | Latency, as printed 39 s |
| MedScribe (Vals AI) | 76.1% | Not published | Latency, as printed 1m 09s |
| APEX-Agents | 35.1% | Not published | Mean score 52.2% |
| LMArena Text | 1480 Elo | Not published | Votes 127,649 · Interval (±) ±3.0 |
| LMArena Text: coding | 1484 Elo | Not published | Votes 35,033 · Interval (±) ±4.5 |
| LMArena Text: hard prompts | 1485 Elo | Not published | Votes 82,971 · Interval (±) ±3.6 |
| LMArena Text: math | 1485 Elo | Not published | Votes 6,622 · Interval (±) ±8.0 |
| LMArena Text: instruction following | 1466 Elo | Not published | Votes 43,642 · Interval (±) ±4.3 |
| LMArena Text: creative writing | 1482 Elo | Not published | Votes 23,619 · Interval (±) ±5.3 |
| LMArena Vision | 1296 Elo | Not published | Votes 47,114 · Interval (±) ±5.1 |
| LMArena Text: English | 1478 Elo | Not published | Votes 56,117 · Interval (±) ±3.9 |
| LMArena Text: non-English | 1476 Elo | Not published | Votes 71,523 · Interval (±) ±3.6 |
| LMArena Text: Chinese | 1528 Elo | Not published | Votes 8,789 · Interval (±) ±7.3 |
| LMArena Text: German | 1491 Elo | Not published | Votes 2,125 · Interval (±) ±14.3 |
| LMArena Text: Japanese | 1493 Elo | Not published | Votes 1,526 · Interval (±) ±17.5 |
| LMArena Text: Korean | 1454 Elo | Not published | Votes 2,263 · Interval (±) ±14.3 |
| LMArena Text: French | 1486 Elo | Not published | Votes 4,197 · Interval (±) ±11.2 |
| LMArena Text: Spanish | 1480 Elo | Not published | Votes 4,053 · Interval (±) ±10.7 |
| LMArena Text: Russian | 1497 Elo | Not published | Votes 14,555 · Interval (±) ±5.9 |
| LMArena Text: Polish | 1497 Elo | Not published | Votes 2,442 · Interval (±) ±12.4 |
| LMArena Text: multi-turn | 1486 Elo | Not published | Votes 21,640 · Interval (±) ±5.3 |
| LMArena Text: longer queries | 1483 Elo | Not published | Votes 56,414 · Interval (±) ±4.2 |
| LMArena Text: expert | 1483 Elo | Not published | Votes 13,288 · Interval (±) ±6.2 |
| LMArena Text: hard prompts in English | 1480 Elo | Not published | Votes 37,273 · Interval (±) ±4.5 |
| LMArena Text: software and IT | 1487 Elo | Not published | Votes 50,148 · Interval (±) ±4.0 |
| LMArena Text: mathematical work | 1478 Elo | Not published | Votes 7,155 · Interval (±) ±7.9 |
| LMArena Text: science | 1497 Elo | Not published | Votes 21,312 · Interval (±) ±5.2 |
| LMArena Text: medicine and healthcare | 1486 Elo | Not published | Votes 9,525 · Interval (±) ±7.1 |
| LMArena Text: legal and government | 1486 Elo | Not published | Votes 10,501 · Interval (±) ±6.7 |
| LMArena Text: business and finance | 1460 Elo | Not published | Votes 24,753 · Interval (±) ±5.0 |
| LMArena Text: writing and language | 1481 Elo | Not published | Votes 32,660 · Interval (±) ±4.7 |
| LMArena Text: entertainment and media | 1466 Elo | Not published | Votes 29,563 · Interval (±) ±4.9 |
| LMArena WebDev: React | 1438 Elo | Not published | Votes 18,253 · Interval (±) ±5.6 |
| LMArena WebDev: HTML | 1490 Elo | Not published | Votes 2,621 · Interval (±) ±12.2 |
| LMArena WebDev: from an image | 1481 Elo | Not published | Votes 8,219 · Interval (±) ±8.7 |
| LMArena Vision: English | 1287 Elo | Not published | Votes 18,497 · Interval (±) ±7.0 |
| LMArena Vision: Chinese | 1364 Elo | Not published | Votes 3,186 · Interval (±) ±13.3 |
| LMArena Vision: reading text | 1304 Elo | Not published | Votes 32,719 · Interval (±) ±5.0 |
| LMArena Vision: diagrams | 1311 Elo | Not published | Votes 12,416 · Interval (±) ±6.9 |
| LMArena Vision: homework | 1316 Elo | Not published | Votes 6,293 · Interval (±) ±8.4 |
| LMArena Vision: humor | 1322 Elo | Not published | Votes 1,885 · Interval (±) ±14.2 |
| LMArena Vision: captioning | 1345 Elo | Not published | Votes 137 · Interval (±) ±48.5 |
| LMArena Vision: recognizing things | 1330 Elo | Not published | Votes 388 · Interval (±) ±28.9 |
| LMArena Vision: creative writing | 1324 Elo | Not published | Votes 3,296 · Interval (±) ±11.2 |
| LMArena Document | 1444 Elo | Not published | Votes 49,457 · Interval (±) ±5.2 |