| Vals Multimodal Index | 62.9% | $1.01 per test | Duration, as printed 4m 26s |
| DeepSWE | 37.4% | $7.3418 mean cost per task | Solved in 4 tries 66.4% · Output tokens per task 275,778 · Agent steps per task 86 |
| WeirdML | 62.6% | $0.756 per run | Median lines of code 286 |
| ARC-AGI | 92.5% | $0.4278 per task | Nothing else |
| ARC-AGI-2 | 72.1% | $0.8503 per task | Nothing else |
| ProofBench | 31.0% | $0.5699 per test | Time per proof 6m 34s |
| Surface Evolver Bench | 58.1% | $6.6382 of the run | Pass rate 37.5% · Tokens for the run 3.1M |
| ALE-Bench | 911.0 | $0.4419 per problem | Tokens per problem 51,880 |
| LMArena WebDev | 1499 Elo | Not published | Votes 9,382 · Interval (±) ±7.3 |
| GPQA Diamond | 92.7% | Not published | Latency, as printed 28 s |
| MMLU Pro | 89.5% | Not published | Latency, as printed 26 s |
| Design Arena: websites | 1268 Elo | Not published | Battles 20,793 |
| Design Arena: UI components | 1273 Elo | Not published | Battles 3,192 |
| Design Arena: game dev | 1263 Elo | Not published | Battles 6,101 |
| Design Arena: data viz | 1236 Elo | Not published | Battles 2,023 |
| Design Arena: 3D | 1244 Elo | Not published | Battles 7,356 |
| Design Arena: all code categories | 1266 Elo | Not published | Battles 36,840 |
| Design Arena: SVG | 1253 Elo | Not published | Battles 3,389 |
| Design Arena: ASCII art | 1254 Elo | Not published | Battles 1,384 |
| Design Arena: agents building web apps | 1202 Elo | Not published | Battles 5,699 |
| Design Arena: agents building full-stack apps | 1197 Elo | Not published | Battles 4,032 |
| Design Arena: agents building mobile apps | 1176 Elo | Not published | Battles 1,344 |
| Design Arena: agents building Android apps | 1200 Elo | Not published | Battles 2,407 |
| Design Arena: agents building Godot games | 1098 Elo | Not published | Battles 1,345 |
| Design Arena: agents building games | 1180 Elo | Not published | Battles 3,583 |
| Design Arena: HTML slides | 1142 Elo | Not published | Battles 2,196 |
| Design Arena: PowerPoint slides | 1178 Elo | Not published | Battles 4,040 |
| LiveCodeBench (Vals AI) | 87.6% | Not published | Latency, as printed 1m 04s |
| ProgramBench (Vals AI) | 0.0% | Not published | Duration, as printed 18m 25s |
| MMMU Pro (Vals AI) | 88.3% | Not published | Latency, as printed 12 s |
| SAGE (Vals AI) | 49.9% | Not published | Latency, as printed 33 s |
| LegalBench (Vals AI) | 83.6% | Not published | Latency, as printed 35 s |
| CorpFin (Vals AI) | 64.7% | Not published | Latency, as printed 8.7 s |
| TaxEval (Vals AI) | 74.4% | Not published | Latency, as printed 20 s |
| MortgageTax (Vals AI) | 68.1% | Not published | Latency, as printed 11 s |
| MedCode (Vals AI) | 55.8% | Not published | Latency, as printed 25 s |
| MedScribe (Vals AI) | 76.6% | Not published | Latency, as printed 57 s |
| APEX-Agents | 27.5% | Not published | Mean score 44.3% |
| LMArena Text | 1482 Elo | Not published | Votes 48,486 · Interval (±) ±3.9 |
| LMArena Text: coding | 1493 Elo | Not published | Votes 13,847 · Interval (±) ±6.0 |
| LMArena Text: hard prompts | 1488 Elo | Not published | Votes 32,403 · Interval (±) ±4.5 |
| LMArena Text: math | 1503 Elo | Not published | Votes 2,385 · Interval (±) ±12.4 |
| LMArena Text: instruction following | 1467 Elo | Not published | Votes 17,406 · Interval (±) ±5.6 |
| LMArena Text: creative writing | 1470 Elo | Not published | Votes 9,481 · Interval (±) ±7.3 |
| LMArena Vision | 1308 Elo | Not published | Votes 13,862 · Interval (±) ±6.8 |
| LMArena Text: English | 1481 Elo | Not published | Votes 20,571 · Interval (±) ±5.2 |
| LMArena Text: non-English | 1475 Elo | Not published | Votes 27,913 · Interval (±) ±4.7 |
| LMArena Text: Chinese | 1526 Elo | Not published | Votes 3,441 · Interval (±) ±10.7 |
| LMArena Text: German | 1493 Elo | Not published | Votes 758 · Interval (±) ±22.5 |
| LMArena Text: Japanese | 1486 Elo | Not published | Votes 695 · Interval (±) ±24.1 |
| LMArena Text: Korean | 1449 Elo | Not published | Votes 872 · Interval (±) ±20.9 |
| LMArena Text: French | 1490 Elo | Not published | Votes 1,544 · Interval (±) ±16.5 |
| LMArena Text: Spanish | 1480 Elo | Not published | Votes 1,430 · Interval (±) ±16.6 |
| LMArena Text: Russian | 1492 Elo | Not published | Votes 5,474 · Interval (±) ±8.6 |
| LMArena Text: Polish | 1517 Elo | Not published | Votes 799 · Interval (±) ±21.3 |
| LMArena Text: multi-turn | 1481 Elo | Not published | Votes 8,090 · Interval (±) ±7.4 |
| LMArena Text: longer queries | 1483 Elo | Not published | Votes 22,808 · Interval (±) ±5.3 |
| LMArena Text: expert | 1495 Elo | Not published | Votes 5,582 · Interval (±) ±8.5 |
| LMArena Text: hard prompts in English | 1482 Elo | Not published | Votes 13,789 · Interval (±) ±6.0 |
| LMArena Text: software and IT | 1494 Elo | Not published | Votes 19,417 · Interval (±) ±5.3 |
| LMArena Text: mathematical work | 1494 Elo | Not published | Votes 2,700 · Interval (±) ±12.0 |
| LMArena Text: science | 1494 Elo | Not published | Votes 7,792 · Interval (±) ±7.4 |
| LMArena Text: medicine and healthcare | 1483 Elo | Not published | Votes 3,559 · Interval (±) ±10.6 |
| LMArena Text: legal and government | 1488 Elo | Not published | Votes 3,849 · Interval (±) ±10.2 |
| LMArena Text: business and finance | 1467 Elo | Not published | Votes 9,395 · Interval (±) ±6.8 |
| LMArena Text: writing and language | 1478 Elo | Not published | Votes 12,654 · Interval (±) ±6.3 |
| LMArena Text: entertainment and media | 1459 Elo | Not published | Votes 12,062 · Interval (±) ±6.6 |
| LMArena WebDev: React | 1495 Elo | Not published | Votes 6,781 · Interval (±) ±8.4 |
| LMArena WebDev: HTML | 1522 Elo | Not published | Votes 1,342 · Interval (±) ±17.1 |
| LMArena WebDev: from an image | 1504 Elo | Not published | Votes 2,865 · Interval (±) ±11.7 |
| LMArena Vision: English | 1305 Elo | Not published | Votes 5,040 · Interval (±) ±9.9 |
| LMArena Vision: Chinese | 1377 Elo | Not published | Votes 847 · Interval (±) ±22.3 |
| LMArena Vision: reading text | 1317 Elo | Not published | Votes 9,712 · Interval (±) ±7.1 |
| LMArena Vision: diagrams | 1323 Elo | Not published | Votes 3,618 · Interval (±) ±10.6 |
| LMArena Vision: homework | 1330 Elo | Not published | Votes 1,553 · Interval (±) ±15.3 |
| LMArena Vision: humor | 1321 Elo | Not published | Votes 577 · Interval (±) ±25.4 |
| LMArena Vision: creative writing | 1301 Elo | Not published | Votes 1,180 · Interval (±) ±18.3 |
| LMArena Document | 1463 Elo | Not published | Votes 6,500 · Interval (±) ±7.9 |