| SREBench (Vals AI) | 0.4% | $18.49 per test | Duration, as printed 3h 53m |
| IOI (Vals AI) | 45.0% | $12.89 per test | Duration, as printed 1h 00m |
| Terminal-Bench 2.1 (Vals AI) | 74.5% | $0.53 per test | Duration, as printed 10m 35s |
| Vibe Code Bench 1-100 (Vals AI) | 13.8% | $71.15 per test | Duration, as printed 4h 16m |
| SkillsBench (Vals AI) | 46.5% | $2.90 per test | Duration, as printed 15m 12s |
| CyberBench (Vals AI) | 70.3% | $4.84 per test | Duration, as printed 22m 57s |
| Finance Agent (Vals AI) | 53.9% | $0.75 per test | Duration, as printed 13m 12s |
| Tax Agent Bench (Vals AI) | 29.4% | $1.79 per test | Duration, as printed 19m 19s |
| Legal Research Bench (Vals AI) | 41.8% | $2.72 per test | Duration, as printed 25m 46s |
| Excel Modeling Benchmark (Vals AI) | 66.3% | $10.29 per test | Duration, as printed 49m 46s |
| Terminal-Bench-Science (Vals AI) | 5.7% | $30.30 per test | Duration, as printed 3h 06m |
| Public Benefits Bench (Vals AI) | 66.0% | $1.29 per test | Nothing else |
| Vals Multimodal Index | 68.8% | $6.53 per test | Duration, as printed 16m 52s |
| DeepSWE | 53.8% | $26.3999 mean cost per task | Solved in 4 tries 78.8% · Output tokens per task 214,118 · Agent steps per task 268 |
| WeirdML | 68.8% | $0.8955 per run | Median lines of code 233 |
| ProofBench | 77.0% | $1.3737 per test | Time per proof 14m 58s |
| Surface Evolver Bench | 60.0% | $11.9389 of the run | Pass rate 18.8% · Tokens for the run 3.8M |
| ALE-Bench | 1463.1 | $0.9605 per problem | Tokens per problem 67,361 |
| LMArena WebDev | 1540 Elo | Not published | Votes 15,755 · Interval (±) ±6.0 |
| GPQA Diamond | 88.9% | Not published | Latency, as printed 1m 03s |
| MMLU Pro | 87.5% | Not published | Latency, as printed 25 s |
| Design Arena: websites | 1274 Elo | Not published | Battles 13,569 |
| Design Arena: UI components | 1279 Elo | Not published | Battles 2,552 |
| Design Arena: game dev | 1279 Elo | Not published | Battles 3,429 |
| Design Arena: data viz | 1252 Elo | Not published | Battles 1,549 |
| Design Arena: 3D | 1261 Elo | Not published | Battles 5,326 |
| Design Arena: all code categories | 1276 Elo | Not published | Battles 24,122 |
| Design Arena: SVG | 1193 Elo | Not published | Battles 2,574 |
| Design Arena: ASCII art | 1208 Elo | Not published | Battles 701 |
| Design Arena: agents building web apps | 1246 Elo | Not published | Battles 4,597 |
| Design Arena: agents building full-stack apps | 1249 Elo | Not published | Battles 3,746 |
| Design Arena: agents building mobile apps | 1214 Elo | Not published | Battles 1,942 |
| Design Arena: agents building Android apps | 1239 Elo | Not published | Battles 950 |
| Design Arena: agents building Godot games | 1225 Elo | Not published | Battles 1,573 |
| Design Arena: agents building games | 1227 Elo | Not published | Battles 1,405 |
| Design Arena: HTML slides | 1218 Elo | Not published | Battles 2,104 |
| Design Arena: PowerPoint slides | 1216 Elo | Not published | Battles 2,123 |
| Design Arena: spreadsheets | 1138 Elo | Not published | Battles 42 |
| LiveCodeBench (Vals AI) | 82.4% | Not published | Latency, as printed 1m 17s |
| MMMU Pro (Vals AI) | 83.0% | Not published | Latency, as printed 19 s |
| SAGE (Vals AI) | 48.9% | Not published | Latency, as printed 7m 14s |
| LegalBench (Vals AI) | 83.9% | Not published | Latency, as printed 4.9 s |
| CorpFin (Vals AI) | 67.0% | Not published | Latency, as printed 19 s |
| TaxEval (Vals AI) | 75.6% | Not published | Latency, as printed 3m 22s |
| MortgageTax (Vals AI) | 70.0% | Not published | Latency, as printed 29 s |
| MedCode (Vals AI) | 47.5% | Not published | Latency, as printed 2m 15s |
| MedScribe (Vals AI) | 76.0% | Not published | Latency, as printed 4m 12s |
| APEX-Agents | 54.5% | Not published | Mean score 67.4% |
| LMArena Text | 1442 Elo | Not published | Votes 49,595 · Interval (±) ±4.1 |
| LMArena Text: coding | 1483 Elo | Not published | Votes 13,270 · Interval (±) ±6.2 |
| LMArena Text: hard prompts | 1461 Elo | Not published | Votes 32,631 · Interval (±) ±4.8 |
| LMArena Text: math | 1467 Elo | Not published | Votes 2,246 · Interval (±) ±12.6 |
| LMArena Text: instruction following | 1452 Elo | Not published | Votes 17,466 · Interval (±) ±5.6 |
| LMArena Text: creative writing | 1417 Elo | Not published | Votes 10,285 · Interval (±) ±7.0 |
| LMArena Vision | 1273 Elo | Not published | Votes 14,034 · Interval (±) ±6.8 |
| LMArena Text: English | 1450 Elo | Not published | Votes 20,842 · Interval (±) ±5.3 |
| LMArena Text: non-English | 1431 Elo | Not published | Votes 28,747 · Interval (±) ±4.8 |
| LMArena Text: Chinese | 1478 Elo | Not published | Votes 3,823 · Interval (±) ±10.2 |
| LMArena Text: German | 1442 Elo | Not published | Votes 799 · Interval (±) ±21.8 |
| LMArena Text: Japanese | 1425 Elo | Not published | Votes 737 · Interval (±) ±24.0 |
| LMArena Text: Korean | 1413 Elo | Not published | Votes 873 · Interval (±) ±20.9 |
| LMArena Text: French | 1464 Elo | Not published | Votes 1,635 · Interval (±) ±16.2 |
| LMArena Text: Spanish | 1437 Elo | Not published | Votes 1,400 · Interval (±) ±16.6 |
| LMArena Text: Russian | 1450 Elo | Not published | Votes 5,671 · Interval (±) ±8.4 |
| LMArena Text: Polish | 1426 Elo | Not published | Votes 710 · Interval (±) ±22.1 |
| LMArena Text: multi-turn | 1453 Elo | Not published | Votes 8,377 · Interval (±) ±7.3 |
| LMArena Text: longer queries | 1463 Elo | Not published | Votes 22,955 · Interval (±) ±5.4 |
| LMArena Text: expert | 1491 Elo | Not published | Votes 5,522 · Interval (±) ±8.6 |
| LMArena Text: hard prompts in English | 1465 Elo | Not published | Votes 13,726 · Interval (±) ±6.1 |
| LMArena Text: software and IT | 1474 Elo | Not published | Votes 19,172 · Interval (±) ±5.5 |
| LMArena Text: mathematical work | 1482 Elo | Not published | Votes 2,702 · Interval (±) ±11.7 |
| LMArena Text: science | 1460 Elo | Not published | Votes 8,222 · Interval (±) ±7.3 |
| LMArena Text: medicine and healthcare | 1443 Elo | Not published | Votes 3,585 · Interval (±) ±10.6 |
| LMArena Text: legal and government | 1455 Elo | Not published | Votes 4,252 · Interval (±) ±9.7 |
| LMArena Text: business and finance | 1435 Elo | Not published | Votes 9,531 · Interval (±) ±6.9 |
| LMArena Text: writing and language | 1436 Elo | Not published | Votes 13,577 · Interval (±) ±6.2 |
| LMArena Text: entertainment and media | 1411 Elo | Not published | Votes 12,785 · Interval (±) ±6.5 |
| LMArena WebDev: React | 1541 Elo | Not published | Votes 10,721 · Interval (±) ±6.9 |
| LMArena WebDev: HTML | 1527 Elo | Not published | Votes 2,085 · Interval (±) ±14.2 |
| LMArena WebDev: from an image | 1540 Elo | Not published | Votes 8,124 · Interval (±) ±7.6 |
| LMArena Vision: English | 1275 Elo | Not published | Votes 5,335 · Interval (±) ±9.7 |
| LMArena Vision: Chinese | 1331 Elo | Not published | Votes 847 · Interval (±) ±21.9 |
| LMArena Vision: reading text | 1288 Elo | Not published | Votes 9,827 · Interval (±) ±7.1 |
| LMArena Vision: diagrams | 1293 Elo | Not published | Votes 3,718 · Interval (±) ±10.4 |
| LMArena Vision: homework | 1311 Elo | Not published | Votes 1,500 · Interval (±) ±15.7 |
| LMArena Vision: humor | 1261 Elo | Not published | Votes 628 · Interval (±) ±24.5 |
| LMArena Vision: creative writing | 1246 Elo | Not published | Votes 1,124 · Interval (±) ±18.8 |
| LMArena Document | 1466 Elo | Not published | Votes 7,411 · Interval (±) ±7.6 |