LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

OpenAI GPT-4.1 Nano

  • OpenAI
  • Released April 14, 2025
  • No public weights listed
  • 1.05M context

As of October 20, 2026, OpenAI GPT-4.1 Nano ranks #171 of 213 models overall with 7.8 on the Artificial Analysis Intelligence Index. Its strongest category is math, where it ranks #97 of 116. OpenAI GPT-4.1 Nano costs $0.10 per million input tokens and $0.40 per million output tokens. It was released on April 14, 2025.

Its output price ranks 71 of 349 priced models, counting from the cheapest.

  • Coding index 8.9 Thin, 1 benchmark
  • Cost per solved task Not computable No published attempt cost
  • Output, per million tokens $0.40 71 of 349 from the cheapest
  • Input, per million tokens $0.10 OpenRouter list price
  • Context window 1.05M Tokens per request

About and specs

For tasks that demand low latency, GPT‑4.1 nano is the fastest and cheapest model in the GPT-4.1 series. It delivers exceptional performance at a small size with its 1 million...

API model id openai/gpt-4.1-nano
  • Tool callingListed
  • Structured outputsListed
  • JSON modeListed
  • Reasoning modeNot listed
  • Web searchNot listed
Takes in
Images, Text, Files
Gives back
Text
Context window
1.05M tokens
Max output
33K tokens
Knowledge cutoff
June 30, 2024
Cached input $/Mtok
$0.025
Cache write $/Mtok
No cache write price listed
Reasoning $/Mtok
Not priced apart
Web search, per request
$0.01
Tokenizer
GPT
Requests moderated
Yes, by the provider
Withdrawn on
No date announced
Parameters
Not published
Downloads, all time
No public weights
Training compute
No estimate published
Output speed
Not measured
Time to first token
Not measured
Speed on OpenRouter
84 tokens/s via OpenAI, 30-minute median
First token on OpenRouter
0.8 s via OpenAI, 30-minute median

Benchmarks: 69 of 190 measured

The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.

Where it stands

Full leaderboard
#171of 213 overall 7.8AA Intelligence Index

Measured in 5 of 6 categories. A place counts only the models measured on that board.

Coding index

8.9
  • Aider polyglot 8.9% 9 of 100
  • SWE-bench Verified Not measured
  • LiveBench coding Not measured
  • LMArena WebDev Elo, scaled from 1200 to 1900 Not measured

The index averages only the coding benchmarks that have a result; the others are skipped, never filled in. How it is weighted

Other public boards

All rankings

Best placings

  1. MATH level 5#15 of 28
  2. LiveCodeBench (Artificial Analysis run)#55 of 84
  3. AA Math Index#50 of 72
  4. AIME 2025 (Artificial Analysis run)#50 of 72

Lowest placings

  1. Chess puzzles#81 of 81
  2. SimpleQA Verified#76 of 76
  3. ARC-AGI#73 of 73

Coding7 of 34 boards

1 more coding boards

Not measured on SWE-bench Lite, SWE-bench (full test set), SWE-bench Multimodal, SWE-bench Multilingual, SWE-bench Verified (Vals AI), Terminal-Bench 4 (Vals AI), Vibe Code Bench (Vals AI), Code migration (Vals AI), ProgramBench (Vals AI), IOI (Vals AI), Terminal-Bench 2.1 (Vals AI), SWE-bench Multimodal (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), CyberBench (Vals AI), SciCode, Terminal-Bench, DeepSWE, FrontierCode, FrontierSWE, GSO-Bench, MirrorCode, Cybench, ALE-Bench, LMArena WebDev: React, LMArena WebDev: HTML, LMArena WebDev: from an image

Intelligence2 of 2 boards

Agentic work1 of 39 boards

Not measured on AA Agentic Index, Design Arena: agents building web apps, Design Arena: agents building full-stack apps, Design Arena: agents building mobile apps, Design Arena: agents building Android apps, Design Arena: agents building Godot games, Design Arena: agents building games, Design Arena: HTML slides, Design Arena: PowerPoint slides, Design Arena: spreadsheets, LiveBench research, LiveBench browser, LiveBench long agentic, SREBench (Vals AI), Finance Agent (Vals AI), Tax Agent Bench (Vals AI), Legal Research Bench (Vals AI), Harvey's Legal Agent Benchmark (Vals AI), Excel Modeling Benchmark (Vals AI), BioMysteryBench (Vals AI), Terminal-Bench-Science (Vals AI), Vals Science Index, Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), APEX-Agents, METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, BALROG, DeepResearch Bench, PostTrainBench, TheAgentCompany, OSWorld, SpireClimb, Vending-Bench 2, LMArena Search

Reasoning11 of 21 boards

5 more reasoning boards

Not measured on LiveBench reasoning, MysteryMechanism (Vals AI), Humanity's Last Exam, SimpleBench, Mystery game puzzles, EBR-bench, VPCT, BIG-Bench Hard, LMArena Vision: diagrams, LMArena Vision: homework

Math9 of 13 boards

3 more math boards

Not measured on FrontierMath, tiers 1 to 3, FrontierMath, tier 4, ProofBench, GSM8K

Knowledge12 of 17 boards

6 more knowledge boards

Not measured on CaseLaw (Vals AI), MedCode (Vals AI), MMLU, GeoBench, AI2 Reasoning Challenge

Web design6 of 9 boards

Not measured on Design Arena: SVG, Design Arena: ASCII art, LiveBench design

General20 of 46 boards

14 more general boards

Not measured on Vals Index, LiveBench data analysis, Public Benefits Bench (Vals AI), SAGE (Vals AI), MedScribe (Vals AI), Vals Multimodal Index, Creative writing (Lech Mazur), CL-bench, Surface Evolver Bench, Furniture assembly, ExploitBench, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Text: Korean, LMArena Text: French, LMArena Text: Spanish, LMArena Text: Polish, LMArena Vision: Chinese, LMArena Vision: reading text, LMArena Vision: humor, LMArena Vision: captioning, LMArena Vision: recognizing things, LMArena Vision: creative writing, LMArena Document

Image generation0 of 5 boards

Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit

Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.

All 190 benchmarks as a table
Benchmark results for OpenAI GPT-4.1 Nano
BenchmarkResultIndex weight
Aider polyglotCoding 8.9% 35%
SWE-bench VerifiedCoding Not measured 30%
SWE-bench LiteCoding Not measured Not in index
SWE-bench (full test set)Coding Not measured Not in index
SWE-bench MultimodalCoding Not measured Not in index
SWE-bench MultilingualCoding Not measured Not in index
LiveBench codingCoding Not measured 20%
LMArena WebDevCoding Not measured 15%
Vals IndexGeneral Not measured Not in index
GPQA DiamondReasoning 50.8% Not in index
AIMEMath 26.5% Not in index
MMLU ProKnowledge 63.5% Not in index
AA Intelligence IndexIntelligence 7.8 Not in index
AA Coding IndexCoding 11.1 Not in index
AA Agentic IndexAgentic work Not measured Not in index
Design Arena: websitesWeb design 973 Not in index
Design Arena: UI componentsWeb design 916 Not in index
Design Arena: game devWeb design 970 Not in index
Design Arena: data vizWeb design 891 Not in index
Design Arena: 3DWeb design 925 Not in index
Design Arena: all code categoriesWeb design 963 Not in index
Design Arena: SVGWeb design Not measured Not in index
Design Arena: ASCII artWeb design Not measured Not in index
Design Arena: agents building web appsAgentic work Not measured Not in index
Design Arena: agents building full-stack appsAgentic work Not measured Not in index
Design Arena: agents building mobile appsAgentic work Not measured Not in index
Design Arena: agents building Android appsAgentic work Not measured Not in index
Design Arena: agents building Godot gamesAgentic work Not measured Not in index
Design Arena: agents building gamesAgentic work Not measured Not in index
Design Arena: HTML slidesAgentic work Not measured Not in index
Design Arena: PowerPoint slidesAgentic work Not measured Not in index
Design Arena: spreadsheetsAgentic work Not measured Not in index
Design Arena: imagesImage generation Not measured Not in index
Design Arena: graphic designImage generation Not measured Not in index
Design Arena: logosImage generation Not measured Not in index
LiveBench reasoningReasoning Not measured Not in index
LiveBench data analysisGeneral Not measured Not in index
LiveBench researchAgentic work Not measured Not in index
LiveBench browserAgentic work Not measured Not in index
LiveBench long agenticAgentic work Not measured Not in index
LiveBench designWeb design Not measured Not in index
LiveCodeBench (Vals AI)Coding 42.7% Not in index
SWE-bench Verified (Vals AI)Coding Not measured Not in index
Terminal-Bench 4 (Vals AI)Coding Not measured Not in index
Vibe Code Bench (Vals AI)Coding Not measured Not in index
Code migration (Vals AI)Coding Not measured Not in index
ProgramBench (Vals AI)Coding Not measured Not in index
SREBench (Vals AI)Agentic work Not measured Not in index
IOI (Vals AI)Coding Not measured Not in index
Terminal-Bench 2.1 (Vals AI)Coding Not measured Not in index
SWE-bench Multimodal (Vals AI)Coding Not measured Not in index
Vibe Code Bench 1-100 (Vals AI)Coding Not measured Not in index
SkillsBench (Vals AI)Coding Not measured Not in index
CyberBench (Vals AI)Coding Not measured Not in index
Finance Agent (Vals AI)Agentic work Not measured Not in index
Tax Agent Bench (Vals AI)Agentic work Not measured Not in index
Legal Research Bench (Vals AI)Agentic work Not measured Not in index
Harvey's Legal Agent Benchmark (Vals AI)Agentic work Not measured Not in index
Excel Modeling Benchmark (Vals AI)Agentic work Not measured Not in index
BioMysteryBench (Vals AI)Agentic work Not measured Not in index
Terminal-Bench-Science (Vals AI)Agentic work Not measured Not in index
Vals Science IndexAgentic work Not measured Not in index
Time Horizon Index (Vals AI)Agentic work Not measured Not in index
CUA-bench (Vals AI)Agentic work Not measured Not in index
Robo-bench (Vals AI)Agentic work Not measured Not in index
Public Benefits Bench (Vals AI)General Not measured Not in index
MysteryMechanism (Vals AI)Reasoning Not measured Not in index
MMMU Pro (Vals AI)Reasoning 55.0% Not in index
MATH 500 (Vals AI)Math 80.2% Not in index
MGSM (Vals AI)Math 69.3% Not in index
SAGE (Vals AI)General Not measured Not in index
LegalBench (Vals AI)Knowledge 61.1% Not in index
CaseLaw (Vals AI)Knowledge Not measured Not in index
CorpFin (Vals AI)Knowledge 42.1% Not in index
TaxEval (Vals AI)Knowledge 60.8% Not in index
MortgageTax (Vals AI)Knowledge 52.8% Not in index
MedQA (Vals AI)Knowledge 68.2% Not in index
MedCode (Vals AI)Knowledge Not measured Not in index
MedScribe (Vals AI)General Not measured Not in index
Vals Multimodal IndexGeneral Not measured Not in index
AA Math IndexMath 24.0 Not in index
GPQA Diamond (Artificial Analysis run)Reasoning 51.2% Not in index
Humanity's Last Exam (Artificial Analysis run)Reasoning 3.8% Not in index
MMLU Pro (Artificial Analysis run)Knowledge 65.7% Not in index
LiveCodeBench (Artificial Analysis run)Coding 32.6% Not in index
SciCodeCoding Not measured Not in index
Terminal-Bench Hard (Artificial Analysis run)Coding 3.8% Not in index
IFBenchGeneral 32.0% Not in index
Long context reasoning (AA-LCR)General 20.3% Not in index
τ²-Bench TelecomAgentic work 17.3% Not in index
AIME 2025 (Artificial Analysis run)Math 24.0% Not in index
Terminal-BenchCoding Not measured Not in index
DeepSWECoding Not measured Not in index
FrontierCodeCoding Not measured Not in index
FrontierSWECoding Not measured Not in index
GSO-BenchCoding Not measured Not in index
WeirdMLCoding 19.0% Not in index
MirrorCodeCoding Not measured Not in index
APEX-AgentsAgentic work Not measured Not in index
METR time horizonsAgentic work Not measured Not in index
Remote Labor IndexAgentic work Not measured Not in index
GDPvalAgentic work Not measured Not in index
OSWorld 2.0Agentic work Not measured Not in index
BALROGAgentic work Not measured Not in index
DeepResearch BenchAgentic work Not measured Not in index
PostTrainBenchAgentic work Not measured Not in index
GPQA Diamond (Epoch AI run)Reasoning 48.9% Not in index
ARC-AGIReasoning 0.0% Not in index
ARC-AGI-2Reasoning 0.0% Not in index
Humanity's Last ExamReasoning Not measured Not in index
SimpleBenchReasoning Not measured Not in index
Chess puzzlesReasoning 0.0% Not in index
Mystery game puzzlesReasoning Not measured Not in index
EBR-benchReasoning Not measured Not in index
OTIS Mock AIMEMath 28.9% Not in index
FrontierMath, tiers 1 to 3Math Not measured Not in index
FrontierMath, tier 4Math Not measured Not in index
ProofBenchMath Not measured Not in index
MATH level 5Math 70.0% Not in index
GSM8KMath Not measured Not in index
SimpleQA VerifiedKnowledge 6.0% Not in index
MMLUKnowledge Not measured Not in index
GeoBenchKnowledge Not measured Not in index
DTBenchGeneral 52.5% Not in index
LMCAGeneral 5.5% Not in index
Fiction.LiveBenchGeneral 25.0% Not in index
Creative writing (Lech Mazur)General Not measured Not in index
CL-benchGeneral Not measured Not in index
Surface Evolver BenchGeneral Not measured Not in index
Furniture assemblyGeneral Not measured Not in index
ExploitBenchGeneral Not measured Not in index
CybenchCoding Not measured Not in index
TheAgentCompanyAgentic work Not measured Not in index
OSWorldAgentic work Not measured Not in index
SpireClimbAgentic work Not measured Not in index
VPCTReasoning Not measured Not in index
BIG-Bench HardReasoning Not measured Not in index
AI2 Reasoning ChallengeKnowledge Not measured Not in index
HellaSwagGeneral Not measured Not in index
WinoGrandeGeneral Not measured Not in index
PIQAGeneral Not measured Not in index
CL-bench LifeGeneral Not measured Not in index
ALE-BenchCoding Not measured Not in index
Vending-Bench 2Agentic work Not measured Not in index
Epoch Capabilities IndexIntelligence 129.6 Not in index
LMArena TextGeneral 1285 Not in index
LMArena Text: codingCoding 1305 Not in index
LMArena Text: hard promptsReasoning 1286 Not in index
LMArena Text: mathMath 1274 Not in index
LMArena Text: instruction followingGeneral 1266 Not in index
LMArena Text: creative writingGeneral 1260 Not in index
LMArena VisionGeneral 1063 Not in index
LMArena Text: EnglishGeneral 1303 Not in index
LMArena Text: non-EnglishGeneral 1260 Not in index
LMArena Text: ChineseGeneral 1270 Not in index
LMArena Text: GermanGeneral 1288 Not in index
LMArena Text: JapaneseGeneral 1198 Not in index
LMArena Text: KoreanGeneral Not measured Not in index
LMArena Text: FrenchGeneral Not measured Not in index
LMArena Text: SpanishGeneral Not measured Not in index
LMArena Text: RussianGeneral 1261 Not in index
LMArena Text: PolishGeneral Not measured Not in index
LMArena Text: multi-turnGeneral 1277 Not in index
LMArena Text: longer queriesGeneral 1283 Not in index
LMArena Text: expertReasoning 1271 Not in index
LMArena Text: hard prompts in EnglishReasoning 1292 Not in index
LMArena Text: software and ITCoding 1305 Not in index
LMArena Text: mathematical workMath 1274 Not in index
LMArena Text: scienceKnowledge 1297 Not in index
LMArena Text: medicine and healthcareKnowledge 1276 Not in index
LMArena Text: legal and governmentKnowledge 1300 Not in index
LMArena Text: business and financeKnowledge 1267 Not in index
LMArena Text: writing and languageGeneral 1261 Not in index
LMArena Text: entertainment and mediaGeneral 1243 Not in index
LMArena WebDev: ReactCoding Not measured Not in index
LMArena WebDev: HTMLCoding Not measured Not in index
LMArena WebDev: from an imageCoding Not measured Not in index
LMArena Vision: EnglishGeneral 1101 Not in index
LMArena Vision: ChineseGeneral Not measured Not in index
LMArena Vision: reading textGeneral Not measured Not in index
LMArena Vision: diagramsReasoning Not measured Not in index
LMArena Vision: homeworkReasoning Not measured Not in index
LMArena Vision: humorGeneral Not measured Not in index
LMArena Vision: captioningGeneral Not measured Not in index
LMArena Vision: recognizing thingsGeneral Not measured Not in index
LMArena Vision: creative writingGeneral Not measured Not in index
LMArena SearchAgentic work Not measured Not in index
LMArena DocumentGeneral Not measured Not in index
LMArena Text to ImageImage generation Not measured Not in index
LMArena Image EditImage generation Not measured Not in index

What it costs

A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.

Output price against the market

GPT-4.1 Nano pricing
$0.0112Dashed line: median $1.80, log scale$600.00
$0.40 per million output tokens is cheaper than 78% of the 344 paid models in the catalog.

Cost per solved task

How it is computed

Neither board that publishes what a SWE-bench Verified attempt costs, Vals AI and swebench.com, has run this model. We leave the number out rather than estimate it.

Nearly as good as GPT-4.1 Nano, for less

What the boards say about its runs

Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.

What each board publishes about the runs behind OpenAI: GPT-4.1 Nano's results
BoardResultWhat the run costAlso published
Aider polyglot 8.9% $0.43 of the run Solved on the first try 3.1% · Edits well formed 94.2% · Time per exercise 12 s
WeirdML 19.0% $0.0026 per run Median lines of code 88
ARC-AGI 0.0% $0.0021 per task Nothing else
ARC-AGI-2 0.0% $0.0036 per task Nothing else
GPQA Diamond 50.8% Not published Latency, as printed 4.2 s
AIME 26.5% Not published Latency, as printed 12 s
MMLU Pro 63.5% Not published Latency, as printed 2.4 s
Design Arena: websites 973 Elo Not published Battles 1,158
Design Arena: UI components 916 Elo Not published Battles 173
Design Arena: game dev 970 Elo Not published Battles 250
Design Arena: data viz 891 Elo Not published Battles 107
Design Arena: 3D 925 Elo Not published Battles 213
36 more boards
What each board publishes about the runs behind OpenAI: GPT-4.1 Nano's results, continued
Design Arena: all code categories 963 Elo Not published Battles 1,901
LiveCodeBench (Vals AI) 42.7% Not published Latency, as printed 12 s
MMMU Pro (Vals AI) 55.0% Not published Latency, as printed 7.3 s
MATH 500 (Vals AI) 80.2% Not published Latency, as printed 3.4 s
MGSM (Vals AI) 69.3% Not published Latency, as printed 1.5 s
LegalBench (Vals AI) 61.1% Not published Latency, as printed 0.4 s
CorpFin (Vals AI) 42.1% Not published Latency, as printed 5.0 s
TaxEval (Vals AI) 60.8% Not published Latency, as printed 3.0 s
MortgageTax (Vals AI) 52.8% Not published Latency, as printed 3.9 s
MedQA (Vals AI) 68.2% Not published Latency, as printed 1.4 s
LMArena Text 1285 Elo Not published Votes 6,103 · Interval (±) ±7.6
LMArena Text: coding 1305 Elo Not published Votes 807 · Interval (±) ±19.3
LMArena Text: hard prompts 1286 Elo Not published Votes 1,669 · Interval (±) ±13.5
LMArena Text: math 1274 Elo Not published Votes 582 · Interval (±) ±23.0
LMArena Text: instruction following 1266 Elo Not published Votes 2,015 · Interval (±) ±12.4
LMArena Text: creative writing 1260 Elo Not published Votes 1,005 · Interval (±) ±18.2
LMArena Vision 1063 Elo Not published Votes 1,211 · Interval (±) ±18.3
LMArena Text: English 1303 Elo Not published Votes 3,528 · Interval (±) ±9.8
LMArena Text: non-English 1260 Elo Not published Votes 2,575 · Interval (±) ±11.1
LMArena Text: Chinese 1270 Elo Not published Votes 246 · Interval (±) ±35.8
LMArena Text: German 1288 Elo Not published Votes 222 · Interval (±) ±36.7
LMArena Text: Japanese 1198 Elo Not published Votes 160 · Interval (±) ±45.1
LMArena Text: Russian 1261 Elo Not published Votes 702 · Interval (±) ±20.7
LMArena Text: multi-turn 1277 Elo Not published Votes 1,000 · Interval (±) ±18.0
LMArena Text: longer queries 1283 Elo Not published Votes 730 · Interval (±) ±19.9
LMArena Text: expert 1271 Elo Not published Votes 328 · Interval (±) ±30.1
LMArena Text: hard prompts in English 1292 Elo Not published Votes 1,062 · Interval (±) ±17.0
LMArena Text: software and IT 1305 Elo Not published Votes 1,454 · Interval (±) ±14.7
LMArena Text: mathematical work 1274 Elo Not published Votes 534 · Interval (±) ±23.9
LMArena Text: science 1297 Elo Not published Votes 1,162 · Interval (±) ±16.3
LMArena Text: medicine and healthcare 1276 Elo Not published Votes 302 · Interval (±) ±32.2
LMArena Text: legal and government 1300 Elo Not published Votes 382 · Interval (±) ±28.1
LMArena Text: business and finance 1267 Elo Not published Votes 651 · Interval (±) ±21.9
LMArena Text: writing and language 1261 Elo Not published Votes 1,583 · Interval (±) ±14.2
LMArena Text: entertainment and media 1243 Elo Not published Votes 1,061 · Interval (±) ±17.2
LMArena Vision: English 1101 Elo Not published Votes 461 · Interval (±) ±26.5

Compare with models of a similar score

All 135 comparisons for GPT-4.1 Nano