| Terminal-Bench 2.1 (Vals AI) | 72.3% | $0.66 per test | Duration, as printed 14m 18s |
| CyberBench (Vals AI) | 69.4% | $4.26 per test | Duration, as printed 24m 53s |
| Finance Agent (Vals AI) | 58.9% | $0.74 per test | Duration, as printed 5m 42s |
| Tax Agent Bench (Vals AI) | 36.0% | $0.32 per test | Duration, as printed 8m 25s |
| Legal Research Bench (Vals AI) | 40.9% | $0.65 per test | Duration, as printed 8m 51s |
| Excel Modeling Benchmark (Vals AI) | 62.7% | $3.55 per test | Duration, as printed 22m 55s |
| Terminal-Bench-Science (Vals AI) | 4.3% | $4.41 per test | Duration, as printed 1h 08m |
| FrontierSWE | 25.8% | $243.34 average cost per task | Best of 5 runs 40.9% · Hours per task 17.0 h |
| ProofBench | 58.0% | $0.479 per test | Time per proof 9m 29s |
| ALE-Bench | 1688.3 | $0.2209 per problem | Tokens per problem 68,223 |
| LMArena WebDev | 1659 Elo | Not published | Votes 9,407 · Interval (±) ±7.9 |
| Design Arena: websites | 1356 Elo | Not published | Battles 27,827 |
| Design Arena: UI components | 1352 Elo | Not published | Battles 1,346 |
| Design Arena: game dev | 1329 Elo | Not published | Battles 12,050 |
| Design Arena: data viz | 1343 Elo | Not published | Battles 1,363 |
| Design Arena: 3D | 1359 Elo | Not published | Battles 5,490 |
| Design Arena: all code categories | 1353 Elo | Not published | Battles 44,398 |
| Design Arena: SVG | 1301 Elo | Not published | Battles 1,385 |
| Design Arena: ASCII art | 1283 Elo | Not published | Battles 214 |
| Design Arena: agents building web apps | 1296 Elo | Not published | Battles 5,087 |
| Design Arena: agents building full-stack apps | 1295 Elo | Not published | Battles 4,009 |
| Design Arena: agents building mobile apps | 1218 Elo | Not published | Battles 819 |
| Design Arena: PowerPoint slides | 1244 Elo | Not published | Battles 3,771 |
| APEX-Agents | 58.6% | Not published | Mean score 70.4% |
| LMArena Text | 1490 Elo | Not published | Votes 17,561 · Interval (±) ±5.6 |
| LMArena Text: coding | 1510 Elo | Not published | Votes 4,556 · Interval (±) ±9.2 |
| LMArena Text: hard prompts | 1502 Elo | Not published | Votes 11,392 · Interval (±) ±6.6 |
| LMArena Text: math | 1496 Elo | Not published | Votes 854 · Interval (±) ±19.9 |
| LMArena Text: instruction following | 1478 Elo | Not published | Votes 6,317 · Interval (±) ±8.1 |
| LMArena Text: creative writing | 1460 Elo | Not published | Votes 3,844 · Interval (±) ±10.5 |
| LMArena Vision | 1308 Elo | Not published | Votes 5,392 · Interval (±) ±9.2 |
| LMArena Text: English | 1493 Elo | Not published | Votes 6,959 · Interval (±) ±7.7 |
| LMArena Text: non-English | 1481 Elo | Not published | Votes 10,597 · Interval (±) ±6.7 |
| LMArena Text: Chinese | 1528 Elo | Not published | Votes 1,372 · Interval (±) ±16.3 |
| LMArena Text: German | 1523 Elo | Not published | Votes 258 · Interval (±) ±36.4 |
| LMArena Text: Japanese | 1481 Elo | Not published | Votes 293 · Interval (±) ±36.9 |
| LMArena Text: Korean | 1497 Elo | Not published | Votes 322 · Interval (±) ±33.3 |
| LMArena Text: French | 1519 Elo | Not published | Votes 549 · Interval (±) ±26.3 |
| LMArena Text: Spanish | 1496 Elo | Not published | Votes 554 · Interval (±) ±25.6 |
| LMArena Text: Russian | 1488 Elo | Not published | Votes 2,291 · Interval (±) ±12.7 |
| LMArena Text: Polish | 1483 Elo | Not published | Votes 253 · Interval (±) ±37.3 |
| LMArena Text: multi-turn | 1486 Elo | Not published | Votes 2,622 · Interval (±) ±11.9 |
| LMArena Text: longer queries | 1488 Elo | Not published | Votes 7,962 · Interval (±) ±7.6 |
| LMArena Text: expert | 1517 Elo | Not published | Votes 1,934 · Interval (±) ±13.7 |
| LMArena Text: hard prompts in English | 1496 Elo | Not published | Votes 4,471 · Interval (±) ±9.3 |
| LMArena Text: software and IT | 1511 Elo | Not published | Votes 6,549 · Interval (±) ±7.9 |
| LMArena Text: mathematical work | 1494 Elo | Not published | Votes 1,020 · Interval (±) ±18.4 |
| LMArena Text: science | 1504 Elo | Not published | Votes 2,879 · Interval (±) ±11.4 |
| LMArena Text: medicine and healthcare | 1488 Elo | Not published | Votes 1,222 · Interval (±) ±17.3 |
| LMArena Text: legal and government | 1501 Elo | Not published | Votes 1,500 · Interval (±) ±15.6 |
| LMArena Text: business and finance | 1493 Elo | Not published | Votes 3,190 · Interval (±) ±10.8 |
| LMArena Text: writing and language | 1468 Elo | Not published | Votes 4,941 · Interval (±) ±9.2 |
| LMArena Text: entertainment and media | 1455 Elo | Not published | Votes 4,509 · Interval (±) ±9.7 |
| LMArena WebDev: React | 1672 Elo | Not published | Votes 6,046 · Interval (±) ±9.3 |
| LMArena WebDev: HTML | 1653 Elo | Not published | Votes 1,275 · Interval (±) ±18.9 |
| LMArena WebDev: from an image | 1640 Elo | Not published | Votes 5,679 · Interval (±) ±9.1 |
| LMArena Vision: English | 1298 Elo | Not published | Votes 1,877 · Interval (±) ±14.7 |
| LMArena Vision: Chinese | 1384 Elo | Not published | Votes 257 · Interval (±) ±36.2 |
| LMArena Vision: reading text | 1319 Elo | Not published | Votes 3,701 · Interval (±) ±10.4 |
| LMArena Vision: diagrams | 1330 Elo | Not published | Votes 1,352 · Interval (±) ±16.6 |
| LMArena Vision: homework | 1296 Elo | Not published | Votes 680 · Interval (±) ±22.9 |
| LMArena Vision: humor | 1293 Elo | Not published | Votes 208 · Interval (±) ±41.7 |
| LMArena Vision: creative writing | 1296 Elo | Not published | Votes 493 · Interval (±) ±27.8 |