| Terminal-Bench-Science (Vals AI) | 4.3% | $4.39 per test | Duration, as printed 1h 52m |
| Public Benefits Bench (Vals AI) | 56.6% | $0.39 per test | Nothing else |
| Vals Multimodal Index | 65.1% | $1.02 per test | Duration, as printed 8m 56s |
| DeepSWE | 46.7% | $4.419 mean cost per task | Solved in 4 tries 75.2% · Output tokens per task 95,845 · Agent steps per task 117 |
| WeirdML | 56.1% | $0.6227 per run | Median lines of code 346 |
| ProofBench | 36.0% | $0.5221 per test | Time per proof 5m 47s |
| ALE-Bench | 715.5 | $0.2445 per problem | Tokens per problem 35,204 |
| LMArena WebDev | 1538 Elo | Not published | Votes 8,762 · Interval (±) ±7.5 |
| GPQA Diamond | 93.4% | Not published | Latency, as printed 18 s |
| MMLU Pro | 89.3% | Not published | Latency, as printed 7.3 s |
| Design Arena: websites | 1300 Elo | Not published | Battles 15,658 |
| Design Arena: UI components | 1297 Elo | Not published | Battles 1,864 |
| Design Arena: game dev | 1263 Elo | Not published | Battles 5,608 |
| Design Arena: data viz | 1289 Elo | Not published | Battles 3,642 |
| Design Arena: 3D | 1272 Elo | Not published | Battles 7,916 |
| Design Arena: all code categories | 1290 Elo | Not published | Battles 32,546 |
| Design Arena: ASCII art | 1279 Elo | Not published | Battles 352 |
| Design Arena: agents building web apps | 1195 Elo | Not published | Battles 2,809 |
| Design Arena: agents building full-stack apps | 1181 Elo | Not published | Battles 2,934 |
| Design Arena: agents building mobile apps | 1197 Elo | Not published | Battles 1,724 |
| Design Arena: agents building Android apps | 1218 Elo | Not published | Battles 2,300 |
| Design Arena: agents building games | 1180 Elo | Not published | Battles 1,695 |
| Design Arena: HTML slides | 1148 Elo | Not published | Battles 1,261 |
| Design Arena: PowerPoint slides | 1145 Elo | Not published | Battles 855 |
| Design Arena: spreadsheets | 1156 Elo | Not published | Battles 36 |
| LiveCodeBench (Vals AI) | 88.1% | Not published | Latency, as printed 32 s |
| MMMU Pro (Vals AI) | 88.4% | Not published | Latency, as printed 11 s |
| SAGE (Vals AI) | 48.7% | Not published | Latency, as printed 22 s |
| LegalBench (Vals AI) | 86.7% | Not published | Latency, as printed 3.0 s |
| CorpFin (Vals AI) | 63.3% | Not published | Latency, as printed 6.3 s |
| TaxEval (Vals AI) | 74.9% | Not published | Latency, as printed 12 s |
| MortgageTax (Vals AI) | 67.6% | Not published | Latency, as printed 9.2 s |
| MedCode (Vals AI) | 53.1% | Not published | Latency, as printed 17 s |
| MedScribe (Vals AI) | 79.7% | Not published | Latency, as printed 34 s |
| APEX-Agents | 46.9% | Not published | Mean score 63.4% |
| LMArena Text | 1479 Elo | Not published | Votes 36,122 · Interval (±) ±4.4 |
| LMArena Text: coding | 1491 Elo | Not published | Votes 10,368 · Interval (±) ±6.8 |
| LMArena Text: hard prompts | 1485 Elo | Not published | Votes 24,166 · Interval (±) ±5.1 |
| LMArena Text: math | 1506 Elo | Not published | Votes 1,764 · Interval (±) ±14.1 |
| LMArena Text: instruction following | 1467 Elo | Not published | Votes 13,124 · Interval (±) ±6.3 |
| LMArena Text: creative writing | 1466 Elo | Not published | Votes 7,583 · Interval (±) ±8.0 |
| LMArena Vision | 1299 Elo | Not published | Votes 8,979 · Interval (±) ±7.9 |
| LMArena Text: English | 1482 Elo | Not published | Votes 15,173 · Interval (±) ±5.8 |
| LMArena Text: non-English | 1470 Elo | Not published | Votes 20,948 · Interval (±) ±5.3 |
| LMArena Text: Chinese | 1530 Elo | Not published | Votes 2,691 · Interval (±) ±11.9 |
| LMArena Text: German | 1481 Elo | Not published | Votes 594 · Interval (±) ±24.4 |
| LMArena Text: Japanese | 1476 Elo | Not published | Votes 618 · Interval (±) ±25.8 |
| LMArena Text: Korean | 1430 Elo | Not published | Votes 708 · Interval (±) ±22.6 |
| LMArena Text: French | 1502 Elo | Not published | Votes 1,150 · Interval (±) ±18.7 |
| LMArena Text: Spanish | 1476 Elo | Not published | Votes 950 · Interval (±) ±20.2 |
| LMArena Text: Russian | 1488 Elo | Not published | Votes 4,166 · Interval (±) ±9.7 |
| LMArena Text: Polish | 1475 Elo | Not published | Votes 532 · Interval (±) ±25.3 |
| LMArena Text: multi-turn | 1481 Elo | Not published | Votes 5,798 · Interval (±) ±8.4 |
| LMArena Text: longer queries | 1474 Elo | Not published | Votes 17,161 · Interval (±) ±5.9 |
| LMArena Text: expert | 1489 Elo | Not published | Votes 4,228 · Interval (±) ±9.5 |
| LMArena Text: hard prompts in English | 1484 Elo | Not published | Votes 10,143 · Interval (±) ±6.8 |
| LMArena Text: software and IT | 1492 Elo | Not published | Votes 14,513 · Interval (±) ±6.0 |
| LMArena Text: mathematical work | 1490 Elo | Not published | Votes 2,148 · Interval (±) ±13.1 |
| LMArena Text: science | 1488 Elo | Not published | Votes 5,824 · Interval (±) ±8.2 |
| LMArena Text: medicine and healthcare | 1468 Elo | Not published | Votes 2,557 · Interval (±) ±12.2 |
| LMArena Text: legal and government | 1480 Elo | Not published | Votes 3,027 · Interval (±) ±11.2 |
| LMArena Text: business and finance | 1464 Elo | Not published | Votes 6,836 · Interval (±) ±7.8 |
| LMArena Text: writing and language | 1470 Elo | Not published | Votes 9,852 · Interval (±) ±7.0 |
| LMArena Text: entertainment and media | 1456 Elo | Not published | Votes 9,313 · Interval (±) ±7.2 |
| LMArena WebDev: React | 1528 Elo | Not published | Votes 5,500 · Interval (±) ±9.1 |
| LMArena WebDev: HTML | 1547 Elo | Not published | Votes 922 · Interval (±) ±20.9 |
| LMArena WebDev: from an image | 1545 Elo | Not published | Votes 1,797 · Interval (±) ±14.3 |
| LMArena Vision: English | 1295 Elo | Not published | Votes 3,098 · Interval (±) ±11.7 |
| LMArena Vision: Chinese | 1357 Elo | Not published | Votes 536 · Interval (±) ±26.1 |
| LMArena Vision: reading text | 1312 Elo | Not published | Votes 6,075 · Interval (±) ±8.4 |
| LMArena Vision: diagrams | 1314 Elo | Not published | Votes 2,285 · Interval (±) ±12.9 |
| LMArena Vision: homework | 1314 Elo | Not published | Votes 993 · Interval (±) ±18.6 |
| LMArena Vision: humor | 1289 Elo | Not published | Votes 427 · Interval (±) ±29.3 |
| LMArena Vision: creative writing | 1278 Elo | Not published | Votes 792 · Interval (±) ±22.0 |
| LMArena Document | 1456 Elo | Not published | Votes 2,975 · Interval (±) ±10.8 |