| ProgramBench (Vals AI) | 0.0% | $0.80 per test | Duration, as printed 5h 30m |
| SREBench (Vals AI) | 0.8% | $2.29 per test | Duration, as printed 3h 15m |
| IOI (Vals AI) | 52.5% | $0.43 per test | Duration, as printed 1h 32m |
| Terminal-Bench 2.1 (Vals AI) | 62.9% | $0.03 per test | Duration, as printed 16m 06s |
| Vibe Code Bench 1-100 (Vals AI) | 16.0% | $0.46 per test | Duration, as printed 39m 03s |
| SkillsBench (Vals AI) | 40.2% | $0.04 per test | Duration, as printed 12m 09s |
| CyberBench (Vals AI) | 67.9% | $0.14 per test | Duration, as printed 35m 48s |
| Finance Agent (Vals AI) | 57.9% | $0.05 per test | Duration, as printed 14m 51s |
| Tax Agent Bench (Vals AI) | 31.6% | $0.14 per test | Duration, as printed 21m 37s |
| Legal Research Bench (Vals AI) | 45.2% | $0.12 per test | Duration, as printed 51m 07s |
| Harvey's Legal Agent Benchmark (Vals AI) | 10.4% | $0.32 per test | Duration, as printed 12m 25s |
| Excel Modeling Benchmark (Vals AI) | 55.9% | $0.71 per test | Duration, as printed 1h 15m |
| Terminal-Bench-Science (Vals AI) | 2.9% | $0.52 per test | Duration, as printed 3h 28m |
| FrontierSWE | 18.1% | $11.03 average cost per task | Best of 5 runs 28.4% · Hours per task 16.4 h |
| ProofBench | 21.0% | $0.2242 per test | Time per proof 1h 11m |
| Surface Evolver Bench | 52.5% | $0.3085 of the run | Pass rate 18.8% · Tokens for the run 2.6M |
| ALE-Bench | 303.6 | $0.0109 per problem | Tokens per problem 23,975 |
| LMArena WebDev | 1607 Elo | Not published | Votes 18,264 · Interval (±) ±6.6 |
| GPQA Diamond | 86.4% | Not published | Latency, as printed 2m 11s |
| MMLU Pro | 86.1% | Not published | Latency, as printed 45 s |
| LiveCodeBench (Vals AI) | 80.5% | Not published | Latency, as printed 5m 02s |
| MMMU Pro (Vals AI) | 86.0% | Not published | Latency, as printed 28 s |
| LegalBench (Vals AI) | 83.9% | Not published | Latency, as printed 13 s |
| TaxEval (Vals AI) | 75.6% | Not published | Latency, as printed 53 s |
| MedScribe (Vals AI) | 88.9% | Not published | Latency, as printed 1m 27s |
| APEX-Agents | 52.8% | Not published | Mean score 66.8% |
| LMArena Text | 1471 Elo | Not published | Votes 36,095 · Interval (±) ±4.8 |
| LMArena Text: coding | 1507 Elo | Not published | Votes 9,192 · Interval (±) ±7.2 |
| LMArena Text: hard prompts | 1490 Elo | Not published | Votes 22,985 · Interval (±) ±5.5 |
| LMArena Text: math | 1503 Elo | Not published | Votes 1,820 · Interval (±) ±14.2 |
| LMArena Text: instruction following | 1478 Elo | Not published | Votes 12,492 · Interval (±) ±6.5 |
| LMArena Text: creative writing | 1441 Elo | Not published | Votes 7,729 · Interval (±) ±7.8 |
| LMArena Vision | 1294 Elo | Not published | Votes 16,254 · Interval (±) ±6.4 |
| LMArena Text: English | 1474 Elo | Not published | Votes 13,229 · Interval (±) ±6.2 |
| LMArena Text: non-English | 1462 Elo | Not published | Votes 22,856 · Interval (±) ±5.5 |
| LMArena Text: Chinese | 1531 Elo | Not published | Votes 2,838 · Interval (±) ±11.8 |
| LMArena Text: German | 1462 Elo | Not published | Votes 614 · Interval (±) ±24.4 |
| LMArena Text: Japanese | 1444 Elo | Not published | Votes 692 · Interval (±) ±24.6 |
| LMArena Text: Korean | 1436 Elo | Not published | Votes 635 · Interval (±) ±24.2 |
| LMArena Text: French | 1491 Elo | Not published | Votes 1,348 · Interval (±) ±17.6 |
| LMArena Text: Spanish | 1475 Elo | Not published | Votes 1,360 · Interval (±) ±16.8 |
| LMArena Text: Russian | 1465 Elo | Not published | Votes 5,071 · Interval (±) ±9.0 |
| LMArena Text: Polish | 1450 Elo | Not published | Votes 610 · Interval (±) ±23.4 |
| LMArena Text: multi-turn | 1469 Elo | Not published | Votes 5,514 · Interval (±) ±8.7 |
| LMArena Text: longer queries | 1481 Elo | Not published | Votes 15,938 · Interval (±) ±6.3 |
| LMArena Text: expert | 1511 Elo | Not published | Votes 3,726 · Interval (±) ±10.3 |
| LMArena Text: hard prompts in English | 1488 Elo | Not published | Votes 8,456 · Interval (±) ±7.3 |
| LMArena Text: software and IT | 1500 Elo | Not published | Votes 13,518 · Interval (±) ±6.3 |
| LMArena Text: mathematical work | 1497 Elo | Not published | Votes 2,086 · Interval (±) ±13.3 |
| LMArena Text: science | 1484 Elo | Not published | Votes 5,949 · Interval (±) ±8.3 |
| LMArena Text: medicine and healthcare | 1475 Elo | Not published | Votes 2,450 · Interval (±) ±12.4 |
| LMArena Text: legal and government | 1473 Elo | Not published | Votes 2,957 · Interval (±) ±11.5 |
| LMArena Text: business and finance | 1460 Elo | Not published | Votes 6,577 · Interval (±) ±8.0 |
| LMArena Text: writing and language | 1455 Elo | Not published | Votes 9,977 · Interval (±) ±7.0 |
| LMArena Text: entertainment and media | 1440 Elo | Not published | Votes 9,197 · Interval (±) ±7.3 |
| LMArena WebDev: React | 1624 Elo | Not published | Votes 11,613 · Interval (±) ±7.4 |
| LMArena WebDev: HTML | 1577 Elo | Not published | Votes 2,703 · Interval (±) ±13.1 |
| LMArena WebDev: from an image | 1578 Elo | Not published | Votes 5,623 · Interval (±) ±9.1 |
| LMArena Vision: English | 1295 Elo | Not published | Votes 5,043 · Interval (±) ±9.8 |
| LMArena Vision: Chinese | 1363 Elo | Not published | Votes 699 · Interval (±) ±23.3 |
| LMArena Vision: reading text | 1299 Elo | Not published | Votes 11,021 · Interval (±) ±6.6 |
| LMArena Vision: diagrams | 1317 Elo | Not published | Votes 3,995 · Interval (±) ±10.1 |
| LMArena Vision: homework | 1318 Elo | Not published | Votes 2,229 · Interval (±) ±12.8 |
| LMArena Vision: humor | 1279 Elo | Not published | Votes 671 · Interval (±) ±23.5 |
| LMArena Vision: creative writing | 1270 Elo | Not published | Votes 1,355 · Interval (±) ±16.9 |