| SREBench (Vals AI) | 33.6% | $34.65 per test | Duration, as printed 1h 37m |
| IOI (Vals AI) | 95.1% | $5.26 per test | Duration, as printed 17m 15s |
| Terminal-Bench 2.1 (Vals AI) | 87.6% | $0.50 per test | Duration, as printed 6m 23s |
| SWE-bench Multimodal (Vals AI) | 70.2% | $4.92 per test | Duration, as printed 18m 32s |
| Vibe Code Bench 1-100 (Vals AI) | 30.4% | $44.12 per test | Duration, as printed 2h 28m |
| CyberBench (Vals AI) | 74.6% | $4.17 per test | Duration, as printed 23m 02s |
| Finance Agent (Vals AI) | 58.6% | $9.22 per test | Duration, as printed 33m 08s |
| Tax Agent Bench (Vals AI) | 45.6% | $15.09 per test | Duration, as printed 1h 07m |
| Legal Research Bench (Vals AI) | 50.5% | $25.16 per test | Duration, as printed 1h 52m |
| Harvey's Legal Agent Benchmark (Vals AI) | 9.2% | $21.38 per test | Duration, as printed 58m 27s |
| Excel Modeling Benchmark (Vals AI) | 75.9% | $11.02 per test | Duration, as printed 35m 06s |
| BioMysteryBench (Vals AI) | 79.3% | $3.64 per test | Duration, as printed 12m 19s |
| Terminal-Bench-Science (Vals AI) | 47.1% | $19.12 per test | Duration, as printed 2h 28m |
| Vals Science Index | 58.7% | $9.13 per test | Duration, as printed 1h 00m |
| Public Benefits Bench (Vals AI) | 70.6% | $5.95 per test | Nothing else |
| MysteryMechanism (Vals AI) | 49.5% | $4.62 per test | Duration, as printed 19m 38s |
| FrontierSWE | 62.3% | $98.87 average cost per task | Best of 5 runs 71.5% · Hours per task 14.3 h |
| ProofBench | 100.0% | $0.9616 per test | Time per proof 5m 51s |
| ALE-Bench | 2147.4 | $0.2712 per problem | Tokens per problem 16,891 |
| LMArena WebDev | 1807 Elo | Not published | Votes 2,925 · Interval (±) ±13.8 |
| Design Arena: websites | 1336 Elo | Not published | Battles 2,127 |
| Design Arena: UI components | 1386 Elo | Not published | Battles 371 |
| Design Arena: game dev | 1458 Elo | Not published | Battles 765 |
| Design Arena: data viz | 1397 Elo | Not published | Battles 638 |
| Design Arena: 3D | 1477 Elo | Not published | Battles 857 |
| Design Arena: all code categories | 1390 Elo | Not published | Battles 4,531 |
| Design Arena: SVG | 1332 Elo | Not published | Battles 998 |
| Design Arena: agents building web apps | 1318 Elo | Not published | Battles 507 |
| Design Arena: agents building mobile apps | 1323 Elo | Not published | Battles 610 |
| SAGE (Vals AI) | 45.8% | Not published | Latency, as printed 1m 54s |
| MedCode (Vals AI) | 49.8% | Not published | Latency, as printed 4m 07s |
| MedScribe (Vals AI) | 91.4% | Not published | Latency, as printed 7m 22s |
| APEX-Agents | 73.5% | Not published | Mean score 81.3% |
| LMArena Text | 1516 Elo | Not published | Votes 8,300 · Interval (±) ±7.3 |
| LMArena Text: coding | 1545 Elo | Not published | Votes 1,894 · Interval (±) ±13.8 |
| LMArena Text: hard prompts | 1535 Elo | Not published | Votes 5,157 · Interval (±) ±9.0 |
| LMArena Text: math | 1508 Elo | Not published | Votes 416 · Interval (±) ±28.3 |
| LMArena Text: instruction following | 1536 Elo | Not published | Votes 2,851 · Interval (±) ±11.8 |
| LMArena Text: creative writing | 1534 Elo | Not published | Votes 1,945 · Interval (±) ±15.0 |
| LMArena Vision | 1321 Elo | Not published | Votes 3,035 · Interval (±) ±11.7 |
| LMArena Text: English | 1517 Elo | Not published | Votes 3,165 · Interval (±) ±11.1 |
| LMArena Text: non-English | 1507 Elo | Not published | Votes 5,130 · Interval (±) ±9.0 |
| LMArena Text: Chinese | 1584 Elo | Not published | Votes 767 · Interval (±) ±22.0 |
| LMArena Text: French | 1505 Elo | Not published | Votes 284 · Interval (±) ±35.2 |
| LMArena Text: Spanish | 1519 Elo | Not published | Votes 294 · Interval (±) ±33.5 |
| LMArena Text: Russian | 1519 Elo | Not published | Votes 1,089 · Interval (±) ±18.2 |
| LMArena Text: multi-turn | 1502 Elo | Not published | Votes 1,088 · Interval (±) ±18.4 |
| LMArena Text: longer queries | 1531 Elo | Not published | Votes 3,519 · Interval (±) ±11.0 |
| LMArena Text: expert | 1550 Elo | Not published | Votes 907 · Interval (±) ±19.9 |
| LMArena Text: hard prompts in English | 1533 Elo | Not published | Votes 1,990 · Interval (±) ±13.8 |
| LMArena Text: software and IT | 1538 Elo | Not published | Votes 2,904 · Interval (±) ±11.3 |
| LMArena Text: mathematical work | 1506 Elo | Not published | Votes 467 · Interval (±) ±26.2 |
| LMArena Text: science | 1522 Elo | Not published | Votes 1,439 · Interval (±) ±16.1 |
| LMArena Text: medicine and healthcare | 1513 Elo | Not published | Votes 564 · Interval (±) ±26.0 |
| LMArena Text: legal and government | 1510 Elo | Not published | Votes 712 · Interval (±) ±23.0 |
| LMArena Text: business and finance | 1492 Elo | Not published | Votes 1,479 · Interval (±) ±15.8 |
| LMArena Text: writing and language | 1534 Elo | Not published | Votes 2,477 · Interval (±) ±13.1 |
| LMArena Text: entertainment and media | 1511 Elo | Not published | Votes 2,212 · Interval (±) ±13.8 |
| LMArena WebDev: React | 1855 Elo | Not published | Votes 2,007 · Interval (±) ±17.3 |
| LMArena WebDev: HTML | 1753 Elo | Not published | Votes 135 · Interval (±) ±60.8 |
| LMArena WebDev: from an image | 1753 Elo | Not published | Votes 781 · Interval (±) ±24.0 |
| LMArena Vision: English | 1317 Elo | Not published | Votes 992 · Interval (±) ±19.9 |
| LMArena Vision: reading text | 1326 Elo | Not published | Votes 2,118 · Interval (±) ±13.5 |
| LMArena Vision: diagrams | 1345 Elo | Not published | Votes 711 · Interval (±) ±22.9 |
| LMArena Vision: homework | 1362 Elo | Not published | Votes 422 · Interval (±) ±29.4 |
| LMArena Vision: creative writing | 1320 Elo | Not published | Votes 283 · Interval (±) ±37.4 |
| LMArena Search | 1213 Elo | Not published | Votes 10,842 · Interval (±) ±7.1 |