As of October 20, 2026, OpenAI GPT-4.1 ranks #134 of 213 models overall with 12.7 on the Artificial Analysis Intelligence Index. Its strongest category is knowledge, where it ranks #84 of 147. OpenAI GPT-4.1 costs $2.00 per million input tokens and $8.00 per million output tokens. It was released on April 14, 2025.
Its output price ranks 275 of 349 priced models, counting from the cheapest.
GPT-4.1 is a flagship large language model optimized for advanced instruction following, real-world software engineering, and long-context reasoning. It supports a 1 million token context window and outperforms GPT-4o and...
openai/gpt-4.1 The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.
Measured in 5 of 6 categories. A place counts only the models measured on that board.
The index averages only the coding benchmarks that have a result; the others are skipped, never filled in. How it is weighted
Not measured on SWE-bench Lite, SWE-bench (full test set), SWE-bench Multilingual, AA Coding Index, SWE-bench Verified (Vals AI), Terminal-Bench 4 (Vals AI), Vibe Code Bench (Vals AI), Code migration (Vals AI), ProgramBench (Vals AI), IOI (Vals AI), Terminal-Bench 2.1 (Vals AI), SWE-bench Multimodal (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), CyberBench (Vals AI), SciCode, Terminal-Bench, DeepSWE, FrontierCode, FrontierSWE, GSO-Bench, MirrorCode, Cybench, LMArena WebDev: React, LMArena WebDev: HTML, LMArena WebDev: from an image
Not measured on AA Agentic Index, Design Arena: agents building web apps, Design Arena: agents building full-stack apps, Design Arena: agents building mobile apps, Design Arena: agents building Android apps, Design Arena: agents building Godot games, Design Arena: agents building games, Design Arena: HTML slides, Design Arena: PowerPoint slides, Design Arena: spreadsheets, LiveBench research, LiveBench browser, LiveBench long agentic, SREBench (Vals AI), Finance Agent (Vals AI), Tax Agent Bench (Vals AI), Legal Research Bench (Vals AI), Harvey's Legal Agent Benchmark (Vals AI), Excel Modeling Benchmark (Vals AI), BioMysteryBench (Vals AI), Terminal-Bench-Science (Vals AI), Vals Science Index, Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), APEX-Agents, METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, BALROG, DeepResearch Bench, PostTrainBench, TheAgentCompany, OSWorld, SpireClimb, Vending-Bench 2, LMArena Search
Not measured on LiveBench reasoning, MysteryMechanism (Vals AI), Mystery game puzzles, EBR-bench, VPCT, BIG-Bench Hard
Not measured on FrontierMath, tier 4, ProofBench, GSM8K
Not measured on MedCode (Vals AI), MMLU, AI2 Reasoning Challenge
Not measured on Design Arena: SVG, Design Arena: ASCII art, LiveBench design
Not measured on Vals Index, LiveBench data analysis, Public Benefits Bench (Vals AI), SAGE (Vals AI), MedScribe (Vals AI), Vals Multimodal Index, Creative writing (Lech Mazur), CL-bench, Surface Evolver Bench, Furniture assembly, ExploitBench, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Document
Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit
Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.
| Benchmark | Result | Index weight |
|---|---|---|
| Aider polyglotCoding | 52.4% | 35% |
| SWE-bench VerifiedCoding | 39.6% | 30% |
| SWE-bench LiteCoding | Not measured | Not in index |
| SWE-bench (full test set)Coding | Not measured | Not in index |
| SWE-bench MultimodalCoding | 31.1% | Not in index |
| SWE-bench MultilingualCoding | Not measured | Not in index |
| LiveBench codingCoding | Not measured | 20% |
| LMArena WebDevCoding | Not measured | 15% |
| Vals IndexGeneral | Not measured | Not in index |
| GPQA DiamondReasoning | 65.4% | Not in index |
| AIMEMath | 39.6% | Not in index |
| MMLU ProKnowledge | 80.5% | Not in index |
| AA Intelligence IndexIntelligence | 12.7 | Not in index |
| AA Coding IndexCoding | Not measured | Not in index |
| AA Agentic IndexAgentic work | Not measured | Not in index |
| Design Arena: websitesWeb design | 1039 | Not in index |
| Design Arena: UI componentsWeb design | 1001 | Not in index |
| Design Arena: game devWeb design | 1080 | Not in index |
| Design Arena: data vizWeb design | 1104 | Not in index |
| Design Arena: 3DWeb design | 850 | Not in index |
| Design Arena: all code categoriesWeb design | 1026 | Not in index |
| Design Arena: SVGWeb design | Not measured | Not in index |
| Design Arena: ASCII artWeb design | Not measured | Not in index |
| Design Arena: agents building web appsAgentic work | Not measured | Not in index |
| Design Arena: agents building full-stack appsAgentic work | Not measured | Not in index |
| Design Arena: agents building mobile appsAgentic work | Not measured | Not in index |
| Design Arena: agents building Android appsAgentic work | Not measured | Not in index |
| Design Arena: agents building Godot gamesAgentic work | Not measured | Not in index |
| Design Arena: agents building gamesAgentic work | Not measured | Not in index |
| Design Arena: HTML slidesAgentic work | Not measured | Not in index |
| Design Arena: PowerPoint slidesAgentic work | Not measured | Not in index |
| Design Arena: spreadsheetsAgentic work | Not measured | Not in index |
| Design Arena: imagesImage generation | Not measured | Not in index |
| Design Arena: graphic designImage generation | Not measured | Not in index |
| Design Arena: logosImage generation | Not measured | Not in index |
| LiveBench reasoningReasoning | Not measured | Not in index |
| LiveBench data analysisGeneral | Not measured | Not in index |
| LiveBench researchAgentic work | Not measured | Not in index |
| LiveBench browserAgentic work | Not measured | Not in index |
| LiveBench long agenticAgentic work | Not measured | Not in index |
| LiveBench designWeb design | Not measured | Not in index |
| LiveCodeBench (Vals AI)Coding | 54.7% | Not in index |
| SWE-bench Verified (Vals AI)Coding | Not measured | Not in index |
| Terminal-Bench 4 (Vals AI)Coding | Not measured | Not in index |
| Vibe Code Bench (Vals AI)Coding | Not measured | Not in index |
| Code migration (Vals AI)Coding | Not measured | Not in index |
| ProgramBench (Vals AI)Coding | Not measured | Not in index |
| SREBench (Vals AI)Agentic work | Not measured | Not in index |
| IOI (Vals AI)Coding | Not measured | Not in index |
| Terminal-Bench 2.1 (Vals AI)Coding | Not measured | Not in index |
| SWE-bench Multimodal (Vals AI)Coding | Not measured | Not in index |
| Vibe Code Bench 1-100 (Vals AI)Coding | Not measured | Not in index |
| SkillsBench (Vals AI)Coding | Not measured | Not in index |
| CyberBench (Vals AI)Coding | Not measured | Not in index |
| Finance Agent (Vals AI)Agentic work | Not measured | Not in index |
| Tax Agent Bench (Vals AI)Agentic work | Not measured | Not in index |
| Legal Research Bench (Vals AI)Agentic work | Not measured | Not in index |
| Harvey's Legal Agent Benchmark (Vals AI)Agentic work | Not measured | Not in index |
| Excel Modeling Benchmark (Vals AI)Agentic work | Not measured | Not in index |
| BioMysteryBench (Vals AI)Agentic work | Not measured | Not in index |
| Terminal-Bench-Science (Vals AI)Agentic work | Not measured | Not in index |
| Vals Science IndexAgentic work | Not measured | Not in index |
| Time Horizon Index (Vals AI)Agentic work | Not measured | Not in index |
| CUA-bench (Vals AI)Agentic work | Not measured | Not in index |
| Robo-bench (Vals AI)Agentic work | Not measured | Not in index |
| Public Benefits Bench (Vals AI)General | Not measured | Not in index |
| MysteryMechanism (Vals AI)Reasoning | Not measured | Not in index |
| MMMU Pro (Vals AI)Reasoning | 72.4% | Not in index |
| MATH 500 (Vals AI)Math | 87.2% | Not in index |
| MGSM (Vals AI)Math | 87.7% | Not in index |
| SAGE (Vals AI)General | Not measured | Not in index |
| LegalBench (Vals AI)Knowledge | 83.1% | Not in index |
| CaseLaw (Vals AI)Knowledge | 69.9% | Not in index |
| CorpFin (Vals AI)Knowledge | 63.0% | Not in index |
| TaxEval (Vals AI)Knowledge | 75.1% | Not in index |
| MortgageTax (Vals AI)Knowledge | 65.9% | Not in index |
| MedQA (Vals AI)Knowledge | 91.2% | Not in index |
| MedCode (Vals AI)Knowledge | Not measured | Not in index |
| MedScribe (Vals AI)General | Not measured | Not in index |
| Vals Multimodal IndexGeneral | Not measured | Not in index |
| AA Math IndexMath | 34.7 | Not in index |
| GPQA Diamond (Artificial Analysis run)Reasoning | 66.6% | Not in index |
| Humanity's Last Exam (Artificial Analysis run)Reasoning | 4.2% | Not in index |
| MMLU Pro (Artificial Analysis run)Knowledge | 80.6% | Not in index |
| LiveCodeBench (Artificial Analysis run)Coding | 45.7% | Not in index |
| SciCodeCoding | Not measured | Not in index |
| Terminal-Bench Hard (Artificial Analysis run)Coding | 13.6% | Not in index |
| IFBenchGeneral | 43.0% | Not in index |
| Long context reasoning (AA-LCR)General | 68.3% | Not in index |
| τ²-Bench TelecomAgentic work | 47.1% | Not in index |
| AIME 2025 (Artificial Analysis run)Math | 34.7% | Not in index |
| Terminal-BenchCoding | Not measured | Not in index |
| DeepSWECoding | Not measured | Not in index |
| FrontierCodeCoding | Not measured | Not in index |
| FrontierSWECoding | Not measured | Not in index |
| GSO-BenchCoding | Not measured | Not in index |
| WeirdMLCoding | 39.0% | Not in index |
| MirrorCodeCoding | Not measured | Not in index |
| APEX-AgentsAgentic work | Not measured | Not in index |
| METR time horizonsAgentic work | Not measured | Not in index |
| Remote Labor IndexAgentic work | Not measured | Not in index |
| GDPvalAgentic work | Not measured | Not in index |
| OSWorld 2.0Agentic work | Not measured | Not in index |
| BALROGAgentic work | Not measured | Not in index |
| DeepResearch BenchAgentic work | Not measured | Not in index |
| PostTrainBenchAgentic work | Not measured | Not in index |
| GPQA Diamond (Epoch AI run)Reasoning | 66.9% | Not in index |
| ARC-AGIReasoning | 5.5% | Not in index |
| ARC-AGI-2Reasoning | 0.4% | Not in index |
| Humanity's Last ExamReasoning | 5.4% | Not in index |
| SimpleBenchReasoning | 27.0% | Not in index |
| Chess puzzlesReasoning | 3.0% | Not in index |
| Mystery game puzzlesReasoning | Not measured | Not in index |
| EBR-benchReasoning | Not measured | Not in index |
| OTIS Mock AIMEMath | 38.3% | Not in index |
| FrontierMath, tiers 1 to 3Math | 6.0% | Not in index |
| FrontierMath, tier 4Math | Not measured | Not in index |
| ProofBenchMath | Not measured | Not in index |
| MATH level 5Math | 83.0% | Not in index |
| GSM8KMath | Not measured | Not in index |
| SimpleQA VerifiedKnowledge | 31.1% | Not in index |
| MMLUKnowledge | Not measured | Not in index |
| GeoBenchKnowledge | 72.0% | Not in index |
| DTBenchGeneral | 68.3% | Not in index |
| LMCAGeneral | 25.6% | Not in index |
| Fiction.LiveBenchGeneral | 63.9% | Not in index |
| Creative writing (Lech Mazur)General | Not measured | Not in index |
| CL-benchGeneral | Not measured | Not in index |
| Surface Evolver BenchGeneral | Not measured | Not in index |
| Furniture assemblyGeneral | Not measured | Not in index |
| ExploitBenchGeneral | Not measured | Not in index |
| CybenchCoding | Not measured | Not in index |
| TheAgentCompanyAgentic work | Not measured | Not in index |
| OSWorldAgentic work | Not measured | Not in index |
| SpireClimbAgentic work | Not measured | Not in index |
| VPCTReasoning | Not measured | Not in index |
| BIG-Bench HardReasoning | Not measured | Not in index |
| AI2 Reasoning ChallengeKnowledge | Not measured | Not in index |
| HellaSwagGeneral | Not measured | Not in index |
| WinoGrandeGeneral | Not measured | Not in index |
| PIQAGeneral | Not measured | Not in index |
| CL-bench LifeGeneral | Not measured | Not in index |
| ALE-BenchCoding | 558.1 | Not in index |
| Vending-Bench 2Agentic work | Not measured | Not in index |
| Epoch Capabilities IndexIntelligence | 136.8 | Not in index |
| LMArena TextGeneral | 1383 | Not in index |
| LMArena Text: codingCoding | 1391 | Not in index |
| LMArena Text: hard promptsReasoning | 1384 | Not in index |
| LMArena Text: mathMath | 1369 | Not in index |
| LMArena Text: instruction followingGeneral | 1367 | Not in index |
| LMArena Text: creative writingGeneral | 1363 | Not in index |
| LMArena VisionGeneral | 1210 | Not in index |
| LMArena Text: EnglishGeneral | 1392 | Not in index |
| LMArena Text: non-EnglishGeneral | 1370 | Not in index |
| LMArena Text: ChineseGeneral | 1382 | Not in index |
| LMArena Text: GermanGeneral | 1381 | Not in index |
| LMArena Text: JapaneseGeneral | 1319 | Not in index |
| LMArena Text: KoreanGeneral | 1339 | Not in index |
| LMArena Text: FrenchGeneral | 1382 | Not in index |
| LMArena Text: SpanishGeneral | 1376 | Not in index |
| LMArena Text: RussianGeneral | 1377 | Not in index |
| LMArena Text: PolishGeneral | 1389 | Not in index |
| LMArena Text: multi-turnGeneral | 1398 | Not in index |
| LMArena Text: longer queriesGeneral | 1385 | Not in index |
| LMArena Text: expertReasoning | 1364 | Not in index |
| LMArena Text: hard prompts in EnglishReasoning | 1393 | Not in index |
| LMArena Text: software and ITCoding | 1391 | Not in index |
| LMArena Text: mathematical workMath | 1360 | Not in index |
| LMArena Text: scienceKnowledge | 1382 | Not in index |
| LMArena Text: medicine and healthcareKnowledge | 1379 | Not in index |
| LMArena Text: legal and governmentKnowledge | 1399 | Not in index |
| LMArena Text: business and financeKnowledge | 1369 | Not in index |
| LMArena Text: writing and languageGeneral | 1371 | Not in index |
| LMArena Text: entertainment and mediaGeneral | 1365 | Not in index |
| LMArena WebDev: ReactCoding | Not measured | Not in index |
| LMArena WebDev: HTMLCoding | Not measured | Not in index |
| LMArena WebDev: from an imageCoding | Not measured | Not in index |
| LMArena Vision: EnglishGeneral | 1209 | Not in index |
| LMArena Vision: ChineseGeneral | 1226 | Not in index |
| LMArena Vision: reading textGeneral | 1218 | Not in index |
| LMArena Vision: diagramsReasoning | 1215 | Not in index |
| LMArena Vision: homeworkReasoning | 1248 | Not in index |
| LMArena Vision: humorGeneral | 1196 | Not in index |
| LMArena Vision: captioningGeneral | 1207 | Not in index |
| LMArena Vision: recognizing thingsGeneral | 1208 | Not in index |
| LMArena Vision: creative writingGeneral | 1210 | Not in index |
| LMArena SearchAgentic work | Not measured | Not in index |
| LMArena DocumentGeneral | Not measured | Not in index |
| LMArena Text to ImageImage generation | Not measured | Not in index |
| LMArena Image EditImage generation | Not measured | Not in index |
A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.
Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.
| Board | Result | What the run cost | Also published |
|---|---|---|---|
| Aider polyglot | 52.4% | $9.86 of the run | Solved on the first try 20.0% · Edits well formed 98.2% · Time per exercise 21 s |
| SWE-bench Verified | 39.6% | $0.1463 per attempt | Nothing else |
| WeirdML | 39.0% | $0.097 per run | Median lines of code 138 |
| ARC-AGI | 5.5% | $0.039 per task | Nothing else |
| ARC-AGI-2 | 0.4% | $0.0691 per task | Nothing else |
| ALE-Bench | 558.1 | $0.0269 per problem | Tokens per problem 5,651 |
| GPQA Diamond | 65.4% | Not published | Latency, as printed 23 s |
| AIME | 39.6% | Not published | Latency, as printed 2m 41s |
| MMLU Pro | 80.5% | Not published | Latency, as printed 8.2 s |
| Design Arena: websites | 1039 Elo | Not published | Battles 1,146 |
| Design Arena: UI components | 1001 Elo | Not published | Battles 155 |
| Design Arena: game dev | 1080 Elo | Not published | Battles 181 |
| Design Arena: 3D | 850 Elo | Not published | Battles 181 |
|---|---|---|---|
| Design Arena: all code categories | 1026 Elo | Not published | Battles 1,747 |
| LiveCodeBench (Vals AI) | 54.7% | Not published | Latency, as printed 31 s |
| MMMU Pro (Vals AI) | 72.4% | Not published | Latency, as printed 12 s |
| MATH 500 (Vals AI) | 87.2% | Not published | Latency, as printed 13 s |
| MGSM (Vals AI) | 87.7% | Not published | Latency, as printed 2.2 s |
| LegalBench (Vals AI) | 83.1% | Not published | Latency, as printed 0.5 s |
| CaseLaw (Vals AI) | 69.9% | Not published | Latency, as printed 6.7 s |
| CorpFin (Vals AI) | 63.0% | Not published | Latency, as printed 10 s |
| TaxEval (Vals AI) | 75.1% | Not published | Latency, as printed 7.9 s |
| MortgageTax (Vals AI) | 65.9% | Not published | Latency, as printed 5.0 s |
| MedQA (Vals AI) | 91.2% | Not published | Latency, as printed 3.1 s |
| LMArena Text | 1383 Elo | Not published | Votes 50,312 · Interval (±) ±3.7 |
| LMArena Text: coding | 1391 Elo | Not published | Votes 9,248 · Interval (±) ±6.6 |
| LMArena Text: hard prompts | 1384 Elo | Not published | Votes 22,029 · Interval (±) ±4.9 |
| LMArena Text: math | 1369 Elo | Not published | Votes 3,229 · Interval (±) ±10.2 |
| LMArena Text: instruction following | 1367 Elo | Not published | Votes 13,304 · Interval (±) ±5.7 |
| LMArena Text: creative writing | 1363 Elo | Not published | Votes 6,650 · Interval (±) ±7.7 |
| LMArena Vision | 1210 Elo | Not published | Votes 40,998 · Interval (±) ±6.7 |
| LMArena Text: English | 1392 Elo | Not published | Votes 23,360 · Interval (±) ±4.8 |
| LMArena Text: non-English | 1370 Elo | Not published | Votes 26,908 · Interval (±) ±4.6 |
| LMArena Text: Chinese | 1382 Elo | Not published | Votes 3,312 · Interval (±) ±10.5 |
| LMArena Text: German | 1381 Elo | Not published | Votes 1,284 · Interval (±) ±16.6 |
| LMArena Text: Japanese | 1319 Elo | Not published | Votes 1,136 · Interval (±) ±18.6 |
| LMArena Text: Korean | 1339 Elo | Not published | Votes 1,059 · Interval (±) ±18.8 |
| LMArena Text: French | 1382 Elo | Not published | Votes 742 · Interval (±) ±22.2 |
| LMArena Text: Spanish | 1376 Elo | Not published | Votes 1,132 · Interval (±) ±18.1 |
| LMArena Text: Russian | 1377 Elo | Not published | Votes 3,810 · Interval (±) ±9.4 |
| LMArena Text: Polish | 1389 Elo | Not published | Votes 3,051 · Interval (±) ±11.5 |
| LMArena Text: multi-turn | 1398 Elo | Not published | Votes 8,733 · Interval (±) ±6.8 |
| LMArena Text: longer queries | 1385 Elo | Not published | Votes 9,965 · Interval (±) ±6.4 |
| LMArena Text: expert | 1364 Elo | Not published | Votes 2,639 · Interval (±) ±11.6 |
| LMArena Text: hard prompts in English | 1393 Elo | Not published | Votes 10,446 · Interval (±) ±6.3 |
| LMArena Text: software and IT | 1391 Elo | Not published | Votes 16,447 · Interval (±) ±5.4 |
| LMArena Text: mathematical work | 1360 Elo | Not published | Votes 3,085 · Interval (±) ±10.5 |
| LMArena Text: science | 1382 Elo | Not published | Votes 8,492 · Interval (±) ±6.9 |
| LMArena Text: medicine and healthcare | 1379 Elo | Not published | Votes 2,773 · Interval (±) ±11.6 |
| LMArena Text: legal and government | 1399 Elo | Not published | Votes 3,236 · Interval (±) ±10.6 |
| LMArena Text: business and finance | 1369 Elo | Not published | Votes 8,237 · Interval (±) ±7.0 |
| LMArena Text: writing and language | 1371 Elo | Not published | Votes 11,339 · Interval (±) ±6.2 |
| LMArena Text: entertainment and media | 1365 Elo | Not published | Votes 9,014 · Interval (±) ±6.7 |
| LMArena Vision: English | 1209 Elo | Not published | Votes 19,011 · Interval (±) ±9.0 |
| LMArena Vision: Chinese | 1226 Elo | Not published | Votes 1,978 · Interval (±) ±16.8 |
| LMArena Vision: reading text | 1218 Elo | Not published | Votes 11,355 · Interval (±) ±8.9 |
| LMArena Vision: diagrams | 1215 Elo | Not published | Votes 2,758 · Interval (±) ±13.0 |
| LMArena Vision: homework | 1248 Elo | Not published | Votes 1,478 · Interval (±) ±16.4 |
| LMArena Vision: humor | 1196 Elo | Not published | Votes 1,365 · Interval (±) ±20.8 |
| LMArena Vision: captioning | 1207 Elo | Not published | Votes 422 · Interval (±) ±31.1 |
| LMArena Vision: recognizing things | 1208 Elo | Not published | Votes 392 · Interval (±) ±32.2 |
| LMArena Vision: creative writing | 1210 Elo | Not published | Votes 1,283 · Interval (±) ±19.7 |