| ProofBench | 13.0% | $0.1328 per test | Time per proof 4m 51s |
| ALE-Bench | 765.3 | $0.0457 per problem | Tokens per problem 21,160 |
| LMArena WebDev | 1435 Elo | Not published | Votes 238 · Interval (±) ±40.8 |
| GPQA Diamond | 83.8% | Not published | Latency, as printed 14 s |
| MMLU Pro | 85.8% | Not published | Latency, as printed 4.8 s |
| LiveCodeBench (Vals AI) | 79.0% | Not published | Latency, as printed 21 s |
| MMMU Pro (Vals AI) | 83.6% | Not published | Latency, as printed 7.8 s |
| SAGE (Vals AI) | 47.3% | Not published | Latency, as printed 11 s |
| LegalBench (Vals AI) | 84.1% | Not published | Latency, as printed 1.7 s |
| CorpFin (Vals AI) | 60.7% | Not published | Latency, as printed 3.8 s |
| TaxEval (Vals AI) | 72.6% | Not published | Latency, as printed 8.8 s |
| MortgageTax (Vals AI) | 68.7% | Not published | Latency, as printed 4.9 s |
| MedCode (Vals AI) | 43.5% | Not published | Latency, as printed 6.0 s |
| MedScribe (Vals AI) | 70.9% | Not published | Latency, as printed 19 s |
| APEX-Agents | 29.3% | Not published | Mean score 46.1% |
| LMArena Text | 1435 Elo | Not published | Votes 35,851 · Interval (±) ±4.5 |
| LMArena Text: coding | 1453 Elo | Not published | Votes 9,924 · Interval (±) ±6.9 |
| LMArena Text: hard prompts | 1440 Elo | Not published | Votes 23,813 · Interval (±) ±5.2 |
| LMArena Text: math | 1433 Elo | Not published | Votes 1,624 · Interval (±) ±14.7 |
| LMArena Text: instruction following | 1419 Elo | Not published | Votes 12,907 · Interval (±) ±6.3 |
| LMArena Text: creative writing | 1420 Elo | Not published | Votes 7,473 · Interval (±) ±7.9 |
| LMArena Vision | 1269 Elo | Not published | Votes 9,238 · Interval (±) ±7.8 |
| LMArena Text: English | 1438 Elo | Not published | Votes 14,626 · Interval (±) ±6.0 |
| LMArena Text: non-English | 1426 Elo | Not published | Votes 21,221 · Interval (±) ±5.3 |
| LMArena Text: Chinese | 1467 Elo | Not published | Votes 2,750 · Interval (±) ±11.9 |
| LMArena Text: German | 1454 Elo | Not published | Votes 654 · Interval (±) ±23.1 |
| LMArena Text: Japanese | 1427 Elo | Not published | Votes 583 · Interval (±) ±26.7 |
| LMArena Text: Korean | 1407 Elo | Not published | Votes 715 · Interval (±) ±23.1 |
| LMArena Text: French | 1451 Elo | Not published | Votes 1,100 · Interval (±) ±19.0 |
| LMArena Text: Spanish | 1441 Elo | Not published | Votes 963 · Interval (±) ±19.7 |
| LMArena Text: Russian | 1443 Elo | Not published | Votes 4,098 · Interval (±) ±9.7 |
| LMArena Text: Polish | 1437 Elo | Not published | Votes 522 · Interval (±) ±25.5 |
| LMArena Text: multi-turn | 1444 Elo | Not published | Votes 5,866 · Interval (±) ±8.5 |
| LMArena Text: longer queries | 1435 Elo | Not published | Votes 17,112 · Interval (±) ±6.0 |
| LMArena Text: expert | 1434 Elo | Not published | Votes 4,189 · Interval (±) ±9.7 |
| LMArena Text: hard prompts in English | 1440 Elo | Not published | Votes 9,647 · Interval (±) ±7.0 |
| LMArena Text: software and IT | 1450 Elo | Not published | Votes 14,375 · Interval (±) ±6.0 |
| LMArena Text: mathematical work | 1433 Elo | Not published | Votes 2,041 · Interval (±) ±13.5 |
| LMArena Text: science | 1451 Elo | Not published | Votes 5,856 · Interval (±) ±8.3 |
| LMArena Text: medicine and healthcare | 1438 Elo | Not published | Votes 2,610 · Interval (±) ±12.2 |
| LMArena Text: legal and government | 1431 Elo | Not published | Votes 3,060 · Interval (±) ±11.4 |
| LMArena Text: business and finance | 1422 Elo | Not published | Votes 6,602 · Interval (±) ±8.0 |
| LMArena Text: writing and language | 1427 Elo | Not published | Votes 9,785 · Interval (±) ±7.1 |
| LMArena Text: entertainment and media | 1414 Elo | Not published | Votes 9,265 · Interval (±) ±7.3 |
| LMArena WebDev: React | 1408 Elo | Not published | Votes 147 · Interval (±) ±52.5 |
| LMArena WebDev: from an image | 1448 Elo | Not published | Votes 1,603 · Interval (±) ±15.3 |
| LMArena Vision: English | 1269 Elo | Not published | Votes 3,159 · Interval (±) ±11.7 |
| LMArena Vision: Chinese | 1311 Elo | Not published | Votes 524 · Interval (±) ±26.7 |
| LMArena Vision: reading text | 1280 Elo | Not published | Votes 6,262 · Interval (±) ±8.4 |
| LMArena Vision: diagrams | 1284 Elo | Not published | Votes 2,334 · Interval (±) ±12.9 |
| LMArena Vision: homework | 1291 Elo | Not published | Votes 1,010 · Interval (±) ±19.0 |
| LMArena Vision: humor | 1287 Elo | Not published | Votes 396 · Interval (±) ±30.0 |
| LMArena Vision: creative writing | 1260 Elo | Not published | Votes 862 · Interval (±) ±21.1 |