| ProofBench | 5.0% | $0.0159 per test | Time per proof 8m 45s |
| ALE-Bench | 1004.5 | $0.0271 per problem | Tokens per problem 24,378 |
| GPQA Diamond | 77.5% | Not published | Latency, as printed 30 s |
| AIME | 88.8% | Not published | Latency, as printed 1m 06s |
| MMLU Pro | 77.2% | Not published | Latency, as printed 8.2 s |
| LiveCodeBench (Vals AI) | 84.0% | Not published | Latency, as printed 1m 00s |
| MMMU Pro (Vals AI) | 73.6% | Not published | Latency, as printed 22 s |
| SAGE (Vals AI) | 38.1% | Not published | Latency, as printed 34 s |
| LegalBench (Vals AI) | 77.9% | Not published | Latency, as printed 2.7 s |
| CaseLaw (Vals AI) | 51.9% | Not published | Latency, as printed 7.6 s |
| CorpFin (Vals AI) | 61.2% | Not published | Latency, as printed 9.4 s |
| TaxEval (Vals AI) | 67.4% | Not published | Latency, as printed 16 s |
| MortgageTax (Vals AI) | 59.1% | Not published | Latency, as printed 15 s |
| MedCode (Vals AI) | 41.0% | Not published | Latency, as printed 8.0 s |
| MedScribe (Vals AI) | 77.1% | Not published | Latency, as printed 21 s |
| LMArena Text | 1372 Elo | Not published | Votes 62,396 · Interval (±) ±3.8 |
| LMArena Text: coding | 1404 Elo | Not published | Votes 17,665 · Interval (±) ±5.9 |
| LMArena Text: hard prompts | 1380 Elo | Not published | Votes 41,331 · Interval (±) ±4.5 |
| LMArena Text: math | 1406 Elo | Not published | Votes 3,264 · Interval (±) ±10.8 |
| LMArena Text: instruction following | 1362 Elo | Not published | Votes 21,487 · Interval (±) ±5.5 |
| LMArena Text: creative writing | 1314 Elo | Not published | Votes 10,371 · Interval (±) ±7.2 |
| LMArena Vision | 1196 Elo | Not published | Votes 25,624 · Interval (±) ±6.3 |
| LMArena Text: English | 1381 Elo | Not published | Votes 28,906 · Interval (±) ±5.0 |
| LMArena Text: non-English | 1359 Elo | Not published | Votes 33,490 · Interval (±) ±4.7 |
| LMArena Text: Chinese | 1391 Elo | Not published | Votes 3,844 · Interval (±) ±10.4 |
| LMArena Text: German | 1368 Elo | Not published | Votes 936 · Interval (±) ±20.6 |
| LMArena Text: Japanese | 1343 Elo | Not published | Votes 610 · Interval (±) ±25.6 |
| LMArena Text: Korean | 1321 Elo | Not published | Votes 1,034 · Interval (±) ±19.7 |
| LMArena Text: French | 1396 Elo | Not published | Votes 2,092 · Interval (±) ±14.9 |
| LMArena Text: Spanish | 1371 Elo | Not published | Votes 1,914 · Interval (±) ±15.0 |
| LMArena Text: Russian | 1362 Elo | Not published | Votes 6,868 · Interval (±) ±8.0 |
| LMArena Text: Polish | 1365 Elo | Not published | Votes 1,129 · Interval (±) ±18.2 |
| LMArena Text: multi-turn | 1382 Elo | Not published | Votes 11,780 · Interval (±) ±6.8 |
| LMArena Text: longer queries | 1366 Elo | Not published | Votes 27,722 · Interval (±) ±5.3 |
| LMArena Text: expert | 1396 Elo | Not published | Votes 6,384 · Interval (±) ±8.3 |
| LMArena Text: hard prompts in English | 1387 Elo | Not published | Votes 19,941 · Interval (±) ±5.7 |
| LMArena Text: software and IT | 1402 Elo | Not published | Votes 24,954 · Interval (±) ±5.2 |
| LMArena Text: mathematical work | 1408 Elo | Not published | Votes 3,479 · Interval (±) ±10.8 |
| LMArena Text: science | 1374 Elo | Not published | Votes 10,518 · Interval (±) ±6.9 |
| LMArena Text: medicine and healthcare | 1369 Elo | Not published | Votes 4,788 · Interval (±) ±9.5 |
| LMArena Text: legal and government | 1368 Elo | Not published | Votes 4,975 · Interval (±) ±9.3 |
| LMArena Text: business and finance | 1366 Elo | Not published | Votes 12,592 · Interval (±) ±6.5 |
| LMArena Text: writing and language | 1338 Elo | Not published | Votes 15,395 · Interval (±) ±6.1 |
| LMArena Text: entertainment and media | 1324 Elo | Not published | Votes 13,668 · Interval (±) ±6.5 |
| LMArena Vision: English | 1202 Elo | Not published | Votes 10,341 · Interval (±) ±8.5 |
| LMArena Vision: Chinese | 1232 Elo | Not published | Votes 1,739 · Interval (±) ±17.0 |
| LMArena Vision: reading text | 1204 Elo | Not published | Votes 18,222 · Interval (±) ±6.3 |
| LMArena Vision: diagrams | 1210 Elo | Not published | Votes 6,840 · Interval (±) ±8.9 |
| LMArena Vision: homework | 1225 Elo | Not published | Votes 3,429 · Interval (±) ±11.2 |
| LMArena Vision: humor | 1161 Elo | Not published | Votes 923 · Interval (±) ±21.0 |
| LMArena Vision: recognizing things | 1141 Elo | Not published | Votes 178 · Interval (±) ±42.4 |
| LMArena Vision: creative writing | 1159 Elo | Not published | Votes 1,531 · Interval (±) ±16.7 |