| Tax Agent Bench (Vals AI) | 5.9% | $0.23 per test | Duration, as printed 2m 35s |
| Legal Research Bench (Vals AI) | 10.6% | $0.27 per test | Duration, as printed 4m 03s |
| Excel Modeling Benchmark (Vals AI) | 22.7% | $1.03 per test | Duration, as printed 11m 59s |
| Public Benefits Bench (Vals AI) | 54.3% | $0.22 per test | Nothing else |
| Vals Multimodal Index | 42.9% | $0.41 per test | Duration, as printed 4m 43s |
| WeirdML | 45.4% | $0.0894 per run | Median lines of code 174 |
| ARC-AGI | 47.7% | $0.2558 per task | Nothing else |
| ARC-AGI-2 | 4.0% | $0.3766 per task | Nothing else |
| LMArena WebDev | 1330 Elo | Not published | Votes 29,061 · Interval (±) ±4.9 |
| GPQA Diamond | 72.2% | Not published | Latency, as printed 1m 23s |
| AIME | 82.7% | Not published | Latency, as printed 2m 38s |
| MMLU Pro | 78.7% | Not published | Latency, as printed 26 s |
| Design Arena: websites | 1122 Elo | Not published | Battles 23,935 |
| Design Arena: UI components | 1100 Elo | Not published | Battles 1,865 |
| Design Arena: game dev | 1097 Elo | Not published | Battles 4,502 |
| Design Arena: data viz | 1124 Elo | Not published | Battles 1,131 |
| Design Arena: 3D | 1072 Elo | Not published | Battles 6,343 |
| Design Arena: all code categories | 1115 Elo | Not published | Battles 35,541 |
| Design Arena: SVG | 1025 Elo | Not published | Battles 4,714 |
| Design Arena: ASCII art | 1140 Elo | Not published | Battles 353 |
| LiveCodeBench (Vals AI) | 41.2% | Not published | Latency, as printed 1m 22s |
| ProgramBench (Vals AI) | 0.0% | Not published | Duration, as printed 7m 37s |
| MMMU Pro (Vals AI) | 46.1% | Not published | Latency, as printed 40 s |
| MGSM (Vals AI) | 92.2% | Not published | Latency, as printed 9.6 s |
| SAGE (Vals AI) | 31.8% | Not published | Latency, as printed 1m 06s |
| LegalBench (Vals AI) | 81.2% | Not published | Latency, as printed 10 s |
| CaseLaw (Vals AI) | 56.5% | Not published | Latency, as printed 33 s |
| CorpFin (Vals AI) | 60.6% | Not published | Latency, as printed 14 s |
| TaxEval (Vals AI) | 67.5% | Not published | Latency, as printed 48 s |
| MortgageTax (Vals AI) | 62.2% | Not published | Latency, as printed 30 s |
| MedQA (Vals AI) | 79.6% | Not published | Latency, as printed 24 s |
| MedCode (Vals AI) | 32.7% | Not published | Latency, as printed 34 s |
| MedScribe (Vals AI) | 85.2% | Not published | Latency, as printed 1m 06s |
| LMArena Text | 1397 Elo | Not published | Votes 149,199 · Interval (±) ±2.4 |
| LMArena Text: coding | 1454 Elo | Not published | Votes 38,427 · Interval (±) ±4.0 |
| LMArena Text: hard prompts | 1420 Elo | Not published | Votes 92,034 · Interval (±) ±3.0 |
| LMArena Text: math | 1397 Elo | Not published | Votes 8,311 · Interval (±) ±7.0 |
| LMArena Text: instruction following | 1414 Elo | Not published | Votes 47,790 · Interval (±) ±3.7 |
| LMArena Text: creative writing | 1371 Elo | Not published | Votes 25,394 · Interval (±) ±4.7 |
| LMArena Text: English | 1414 Elo | Not published | Votes 64,734 · Interval (±) ±3.3 |
| LMArena Text: non-English | 1377 Elo | Not published | Votes 84,413 · Interval (±) ±3.0 |
| LMArena Text: Chinese | 1418 Elo | Not published | Votes 10,532 · Interval (±) ±6.4 |
| LMArena Text: German | 1374 Elo | Not published | Votes 2,468 · Interval (±) ±13.2 |
| LMArena Text: Japanese | 1338 Elo | Not published | Votes 1,712 · Interval (±) ±16.4 |
| LMArena Text: Korean | 1346 Elo | Not published | Votes 2,378 · Interval (±) ±13.6 |
| LMArena Text: French | 1409 Elo | Not published | Votes 4,213 · Interval (±) ±11.1 |
| LMArena Text: Spanish | 1421 Elo | Not published | Votes 4,363 · Interval (±) ±10.3 |
| LMArena Text: Russian | 1381 Elo | Not published | Votes 16,646 · Interval (±) ±5.2 |
| LMArena Text: Polish | 1342 Elo | Not published | Votes 3,483 · Interval (±) ±10.6 |
| LMArena Text: multi-turn | 1409 Elo | Not published | Votes 25,888 · Interval (±) ±4.5 |
| LMArena Text: longer queries | 1427 Elo | Not published | Votes 56,594 · Interval (±) ±3.7 |
| LMArena Text: expert | 1443 Elo | Not published | Votes 13,709 · Interval (±) ±5.9 |
| LMArena Text: hard prompts in English | 1434 Elo | Not published | Votes 40,648 · Interval (±) ±3.9 |
| LMArena Text: software and IT | 1439 Elo | Not published | Votes 56,191 · Interval (±) ±3.5 |
| LMArena Text: mathematical work | 1430 Elo | Not published | Votes 7,959 · Interval (±) ±7.3 |
| LMArena Text: science | 1406 Elo | Not published | Votes 24,337 · Interval (±) ±4.6 |
| LMArena Text: medicine and healthcare | 1394 Elo | Not published | Votes 10,077 · Interval (±) ±6.7 |
| LMArena Text: legal and government | 1400 Elo | Not published | Votes 11,207 · Interval (±) ±6.3 |
| LMArena Text: business and finance | 1400 Elo | Not published | Votes 28,782 · Interval (±) ±4.4 |
| LMArena Text: writing and language | 1387 Elo | Not published | Votes 36,448 · Interval (±) ±4.0 |
| LMArena Text: entertainment and media | 1369 Elo | Not published | Votes 32,219 · Interval (±) ±4.3 |
| LMArena WebDev: React | 1326 Elo | Not published | Votes 16,000 · Interval (±) ±6.0 |
| LMArena WebDev: HTML | 1318 Elo | Not published | Votes 10,648 · Interval (±) ±9.3 |
| LMArena Document | 1420 Elo | Not published | Votes 34,677 · Interval (±) ±5.9 |