| SREBench (Vals AI) | 4.6% | $21.47 per test | Duration, as printed 1h 50m |
| IOI (Vals AI) | 67.8% | $3.40 per test | Duration, as printed 21m 09s |
| Terminal-Bench 2.1 (Vals AI) | 77.5% | $1.02 per test | Duration, as printed 8m 12s |
| SkillsBench (Vals AI) | 65.9% | $1.80 per test | Duration, as printed 3m 06s |
| CyberBench (Vals AI) | 43.8% | $2.15 per test | Duration, as printed 7m 34s |
| Finance Agent (Vals AI) | 59.0% | $1.48 per test | Duration, as printed 3m 01s |
| Tax Agent Bench (Vals AI) | 22.8% | $0.48 per test | Duration, as printed 1m 27s |
| Legal Research Bench (Vals AI) | 34.6% | $0.76 per test | Duration, as printed 4m 49s |
| Excel Modeling Benchmark (Vals AI) | 71.3% | $5.69 per test | Duration, as printed 10m 51s |
| Terminal-Bench-Science (Vals AI) | 7.1% | $7.19 per test | Duration, as printed 1h 20m |
| DeepSWE | 65.5% | $2.0251 mean cost per task | Solved in 4 tries 83.2% · Output tokens per task 93,991 · Agent steps per task 117 |
| FrontierSWE | 20.3% | $34.14 average cost per task | Best of 5 runs 31.2% · Hours per task 7.9 h |
| ProofBench | 58.0% | $0.5585 per test | Time per proof 7m 04s |
| ALE-Bench | 904.3 | $0.2436 per problem | Tokens per problem 35,110 |
| LMArena WebDev | 1591 Elo | Not published | Votes 12,636 · Interval (±) ±6.8 |
| GPQA Diamond | 93.9% | Not published | Latency, as printed 8.8 s |
| MMLU Pro | 90.1% | Not published | Latency, as printed 4.2 s |
| Design Arena: websites | 1304 Elo | Not published | Battles 57,032 |
| Design Arena: UI components | 1301 Elo | Not published | Battles 1,904 |
| Design Arena: game dev | 1318 Elo | Not published | Battles 14,101 |
| Design Arena: data viz | 1315 Elo | Not published | Battles 1,703 |
| Design Arena: 3D | 1307 Elo | Not published | Battles 7,625 |
| Design Arena: all code categories | 1309 Elo | Not published | Battles 77,346 |
| Design Arena: SVG | 1283 Elo | Not published | Battles 3,551 |
| Design Arena: ASCII art | 1276 Elo | Not published | Battles 545 |
| Design Arena: agents building web apps | 1221 Elo | Not published | Battles 1,236 |
| Design Arena: agents building full-stack apps | 1209 Elo | Not published | Battles 682 |
| Design Arena: agents building mobile apps | 1227 Elo | Not published | Battles 650 |
| Design Arena: agents building Android apps | 1256 Elo | Not published | Battles 2,229 |
| Design Arena: agents building Godot games | 1264 Elo | Not published | Battles 461 |
| Design Arena: agents building games | 1235 Elo | Not published | Battles 4,709 |
| Design Arena: spreadsheets | 1157 Elo | Not published | Battles 22 |
| LiveCodeBench (Vals AI) | 88.7% | Not published | Latency, as printed 15 s |
| MMMU Pro (Vals AI) | 89.0% | Not published | Latency, as printed 6.3 s |
| SAGE (Vals AI) | 49.2% | Not published | Latency, as printed 9.8 s |
| LegalBench (Vals AI) | 87.3% | Not published | Latency, as printed 2.2 s |
| TaxEval (Vals AI) | 74.7% | Not published | Latency, as printed 7.8 s |
| MortgageTax (Vals AI) | 66.7% | Not published | Latency, as printed 4.1 s |
| MedCode (Vals AI) | 53.4% | Not published | Latency, as printed 9.2 s |
| MedScribe (Vals AI) | 83.9% | Not published | Latency, as printed 17 s |
| APEX-Agents | 67.8% | Not published | Mean score 79.4% |
| LMArena Text | 1487 Elo | Not published | Votes 27,232 · Interval (±) ±4.9 |
| LMArena Text: coding | 1498 Elo | Not published | Votes 7,459 · Interval (±) ±7.7 |
| LMArena Text: hard prompts | 1495 Elo | Not published | Votes 17,784 · Interval (±) ±5.7 |
| LMArena Text: math | 1510 Elo | Not published | Votes 1,390 · Interval (±) ±16.1 |
| LMArena Text: instruction following | 1484 Elo | Not published | Votes 9,766 · Interval (±) ±7.0 |
| LMArena Text: creative writing | 1489 Elo | Not published | Votes 6,003 · Interval (±) ±8.8 |
| LMArena Vision | 1314 Elo | Not published | Votes 5,369 · Interval (±) ±9.2 |
| LMArena Text: English | 1483 Elo | Not published | Votes 10,911 · Interval (±) ±6.6 |
| LMArena Text: non-English | 1485 Elo | Not published | Votes 16,312 · Interval (±) ±5.9 |
| LMArena Text: Chinese | 1551 Elo | Not published | Votes 2,124 · Interval (±) ±13.6 |
| LMArena Text: German | 1503 Elo | Not published | Votes 418 · Interval (±) ±28.8 |
| LMArena Text: Japanese | 1512 Elo | Not published | Votes 435 · Interval (±) ±30.5 |
| LMArena Text: Korean | 1481 Elo | Not published | Votes 503 · Interval (±) ±27.6 |
| LMArena Text: French | 1502 Elo | Not published | Votes 844 · Interval (±) ±21.7 |
| LMArena Text: Spanish | 1491 Elo | Not published | Votes 862 · Interval (±) ±20.9 |
| LMArena Text: Russian | 1518 Elo | Not published | Votes 3,394 · Interval (±) ±10.7 |
| LMArena Text: Polish | 1502 Elo | Not published | Votes 426 · Interval (±) ±28.5 |
| LMArena Text: multi-turn | 1487 Elo | Not published | Votes 4,139 · Interval (±) ±9.9 |
| LMArena Text: longer queries | 1492 Elo | Not published | Votes 12,678 · Interval (±) ±6.6 |
| LMArena Text: expert | 1510 Elo | Not published | Votes 3,121 · Interval (±) ±11.1 |
| LMArena Text: hard prompts in English | 1487 Elo | Not published | Votes 7,112 · Interval (±) ±7.8 |
| LMArena Text: software and IT | 1498 Elo | Not published | Votes 10,449 · Interval (±) ±6.7 |
| LMArena Text: mathematical work | 1501 Elo | Not published | Votes 1,672 · Interval (±) ±14.9 |
| LMArena Text: science | 1510 Elo | Not published | Votes 4,565 · Interval (±) ±9.3 |
| LMArena Text: medicine and healthcare | 1492 Elo | Not published | Votes 1,957 · Interval (±) ±14.0 |
| LMArena Text: legal and government | 1495 Elo | Not published | Votes 2,302 · Interval (±) ±12.9 |
| LMArena Text: business and finance | 1478 Elo | Not published | Votes 4,953 · Interval (±) ±9.0 |
| LMArena Text: writing and language | 1491 Elo | Not published | Votes 7,589 · Interval (±) ±7.9 |
| LMArena Text: entertainment and media | 1479 Elo | Not published | Votes 7,249 · Interval (±) ±8.1 |
| LMArena WebDev: React | 1587 Elo | Not published | Votes 8,109 · Interval (±) ±8.0 |
| LMArena WebDev: HTML | 1593 Elo | Not published | Votes 1,850 · Interval (±) ±15.4 |
| LMArena WebDev: from an image | 1599 Elo | Not published | Votes 2,661 · Interval (±) ±12.2 |
| LMArena Vision: English | 1309 Elo | Not published | Votes 1,848 · Interval (±) ±14.7 |
| LMArena Vision: Chinese | 1394 Elo | Not published | Votes 302 · Interval (±) ±34.1 |
| LMArena Vision: reading text | 1322 Elo | Not published | Votes 3,653 · Interval (±) ±10.3 |
| LMArena Vision: diagrams | 1329 Elo | Not published | Votes 1,364 · Interval (±) ±16.7 |
| LMArena Vision: homework | 1320 Elo | Not published | Votes 665 · Interval (±) ±22.7 |
| LMArena Vision: humor | 1299 Elo | Not published | Votes 215 · Interval (±) ±41.5 |
| LMArena Vision: creative writing | 1312 Elo | Not published | Votes 505 · Interval (±) ±27.9 |