LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

OpenAI GPT-5.4 Nano

  • OpenAI
  • Released March 17, 2026
  • No public weights listed
  • 400K context

As of October 20, 2026, OpenAI GPT-5.4 Nano ranks #97 of 213 models overall with 20.7 on the Artificial Analysis Intelligence Index. Its strongest category is math, where it ranks #55 of 116. OpenAI GPT-5.4 Nano costs $0.20 per million input tokens and $1.25 per million output tokens. It was released on March 17, 2026.

Its output price ranks 158 of 349 priced models, counting from the cheapest.

  • Coding index Not benchmarked No benchmark coverage
  • Cost per solved task $0.14 One SWE-bench Verified task, solved
  • Output, per million tokens $1.25 158 of 349 from the cheapest
  • Input, per million tokens $0.20 OpenRouter list price
  • Context window 400K Tokens per request

About and specs

GPT-5.4 nano is the most lightweight and cost-efficient variant of the GPT-5.4 family, optimized for speed-critical and high-volume tasks. It supports text and image inputs and is designed for low-latency...

API model id openai/gpt-5.4-nano
  • Tool callingListed
  • Structured outputsListed
  • JSON modeListed
  • Reasoning modeListed
  • Web searchNot listed
Takes in
Files, Images, Text
Gives back
Text
Context window
400K tokens
Max output
128K tokens
Knowledge cutoff
August 31, 2025
Cached input $/Mtok
$0.02
Cache write $/Mtok
No cache write price listed
Reasoning $/Mtok
Not priced apart
Web search, per request
$0.01
Tokenizer
GPT
Requests moderated
Yes, by the provider
Withdrawn on
No date announced
Parameters
Not published
Downloads, all time
No public weights
Training compute
No estimate published
Output speed
Not measured
Time to first token
Not measured
Speed on OpenRouter
92 tokens/s via OpenAI, 30-minute median
First token on OpenRouter
0.9 s via OpenAI, 30-minute median

Benchmarks: 84 of 190 measured

The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.

Coding index

Not benchmarked
  • Aider polyglot Not measured
  • SWE-bench Verified Not measured
  • LiveBench coding Not measured
  • LMArena WebDev Elo, scaled from 1200 to 1900 Not measured

No coding benchmark has measured this model, so there is no index. We do not estimate one from its price, its maker or its siblings. How it is weighted

Other public boards

All rankings

Coding12 of 34 boards

6 more coding boards

Not measured on SWE-bench Lite, SWE-bench (full test set), SWE-bench Multimodal, SWE-bench Multilingual, Terminal-Bench 4 (Vals AI), ProgramBench (Vals AI), IOI (Vals AI), SWE-bench Multimodal (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), CyberBench (Vals AI), LiveCodeBench (Artificial Analysis run), Terminal-Bench, DeepSWE, FrontierCode, FrontierSWE, GSO-Bench, MirrorCode, Cybench, LMArena WebDev: React, LMArena WebDev: HTML, LMArena WebDev: from an image

Intelligence2 of 2 boards

Agentic work6 of 39 boards

Not measured on Design Arena: agents building web apps, Design Arena: agents building full-stack apps, Design Arena: agents building mobile apps, Design Arena: agents building Android apps, Design Arena: agents building Godot games, Design Arena: agents building games, Design Arena: HTML slides, Design Arena: PowerPoint slides, Design Arena: spreadsheets, LiveBench research, LiveBench browser, LiveBench long agentic, SREBench (Vals AI), Harvey's Legal Agent Benchmark (Vals AI), BioMysteryBench (Vals AI), Terminal-Bench-Science (Vals AI), Vals Science Index, Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), APEX-Agents, METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, BALROG, DeepResearch Bench, PostTrainBench, TheAgentCompany, OSWorld, SpireClimb, Vending-Bench 2, LMArena Search

Reasoning14 of 21 boards

8 more reasoning boards

Not measured on LiveBench reasoning, MysteryMechanism (Vals AI), Humanity's Last Exam, SimpleBench, EBR-bench, VPCT, BIG-Bench Hard

Math7 of 13 boards

1 more math boards

Not measured on MATH 500 (Vals AI), MGSM (Vals AI), AA Math Index, AIME 2025 (Artificial Analysis run), MATH level 5, GSM8K

Knowledge12 of 17 boards

6 more knowledge boards

Not measured on MedQA (Vals AI), MMLU Pro (Artificial Analysis run), MMLU, GeoBench, AI2 Reasoning Challenge

Web design0 of 9 boards

Not measured on Design Arena: websites, Design Arena: UI components, Design Arena: game dev, Design Arena: data viz, Design Arena: 3D, Design Arena: all code categories, Design Arena: SVG, Design Arena: ASCII art, LiveBench design

General31 of 46 boards

25 more general boards

Not measured on Vals Index, LiveBench data analysis, Public Benefits Bench (Vals AI), Fiction.LiveBench, Creative writing (Lech Mazur), CL-bench, Surface Evolver Bench, Furniture assembly, ExploitBench, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Vision: captioning, LMArena Document

Image generation0 of 5 boards

Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit

Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.

All 190 benchmarks as a table
Benchmark results for OpenAI GPT-5.4 Nano
BenchmarkResultIndex weight
Aider polyglotCoding Not measured 35%
SWE-bench VerifiedCoding Not measured 30%
SWE-bench LiteCoding Not measured Not in index
SWE-bench (full test set)Coding Not measured Not in index
SWE-bench MultimodalCoding Not measured Not in index
SWE-bench MultilingualCoding Not measured Not in index
LiveBench codingCoding Not measured 20%
LMArena WebDevCoding Not measured 15%
Vals IndexGeneral Not measured Not in index
GPQA DiamondReasoning 77.5% Not in index
AIMEMath 88.8% Not in index
MMLU ProKnowledge 77.2% Not in index
AA Intelligence IndexIntelligence 20.7 Not in index
AA Coding IndexCoding 56.1 Not in index
AA Agentic IndexAgentic work 16.0 Not in index
Design Arena: websitesWeb design Not measured Not in index
Design Arena: UI componentsWeb design Not measured Not in index
Design Arena: game devWeb design Not measured Not in index
Design Arena: data vizWeb design Not measured Not in index
Design Arena: 3DWeb design Not measured Not in index
Design Arena: all code categoriesWeb design Not measured Not in index
Design Arena: SVGWeb design Not measured Not in index
Design Arena: ASCII artWeb design Not measured Not in index
Design Arena: agents building web appsAgentic work Not measured Not in index
Design Arena: agents building full-stack appsAgentic work Not measured Not in index
Design Arena: agents building mobile appsAgentic work Not measured Not in index
Design Arena: agents building Android appsAgentic work Not measured Not in index
Design Arena: agents building Godot gamesAgentic work Not measured Not in index
Design Arena: agents building gamesAgentic work Not measured Not in index
Design Arena: HTML slidesAgentic work Not measured Not in index
Design Arena: PowerPoint slidesAgentic work Not measured Not in index
Design Arena: spreadsheetsAgentic work Not measured Not in index
Design Arena: imagesImage generation Not measured Not in index
Design Arena: graphic designImage generation Not measured Not in index
Design Arena: logosImage generation Not measured Not in index
LiveBench reasoningReasoning Not measured Not in index
LiveBench data analysisGeneral Not measured Not in index
LiveBench researchAgentic work Not measured Not in index
LiveBench browserAgentic work Not measured Not in index
LiveBench long agenticAgentic work Not measured Not in index
LiveBench designWeb design Not measured Not in index
LiveCodeBench (Vals AI)Coding 84.0% Not in index
SWE-bench Verified (Vals AI)Coding 69.8% Not in index
Terminal-Bench 4 (Vals AI)Coding Not measured Not in index
Vibe Code Bench (Vals AI)Coding 26.1% Not in index
Code migration (Vals AI)Coding 14.5% Not in index
ProgramBench (Vals AI)Coding Not measured Not in index
SREBench (Vals AI)Agentic work Not measured Not in index
IOI (Vals AI)Coding Not measured Not in index
Terminal-Bench 2.1 (Vals AI)Coding 41.6% Not in index
SWE-bench Multimodal (Vals AI)Coding Not measured Not in index
Vibe Code Bench 1-100 (Vals AI)Coding Not measured Not in index
SkillsBench (Vals AI)Coding Not measured Not in index
CyberBench (Vals AI)Coding Not measured Not in index
Finance Agent (Vals AI)Agentic work 38.2% Not in index
Tax Agent Bench (Vals AI)Agentic work 5.0% Not in index
Legal Research Bench (Vals AI)Agentic work 6.3% Not in index
Harvey's Legal Agent Benchmark (Vals AI)Agentic work Not measured Not in index
Excel Modeling Benchmark (Vals AI)Agentic work 44.8% Not in index
BioMysteryBench (Vals AI)Agentic work Not measured Not in index
Terminal-Bench-Science (Vals AI)Agentic work Not measured Not in index
Vals Science IndexAgentic work Not measured Not in index
Time Horizon Index (Vals AI)Agentic work Not measured Not in index
CUA-bench (Vals AI)Agentic work Not measured Not in index
Robo-bench (Vals AI)Agentic work Not measured Not in index
Public Benefits Bench (Vals AI)General Not measured Not in index
MysteryMechanism (Vals AI)Reasoning Not measured Not in index
MMMU Pro (Vals AI)Reasoning 73.6% Not in index
MATH 500 (Vals AI)Math Not measured Not in index
MGSM (Vals AI)Math Not measured Not in index
SAGE (Vals AI)General 38.1% Not in index
LegalBench (Vals AI)Knowledge 77.9% Not in index
CaseLaw (Vals AI)Knowledge 51.9% Not in index
CorpFin (Vals AI)Knowledge 61.2% Not in index
TaxEval (Vals AI)Knowledge 67.4% Not in index
MortgageTax (Vals AI)Knowledge 59.1% Not in index
MedQA (Vals AI)Knowledge Not measured Not in index
MedCode (Vals AI)Knowledge 41.0% Not in index
MedScribe (Vals AI)General 77.1% Not in index
Vals Multimodal IndexGeneral 47.6% Not in index
AA Math IndexMath Not measured Not in index
GPQA Diamond (Artificial Analysis run)Reasoning 81.7% Not in index
Humanity's Last Exam (Artificial Analysis run)Reasoning 28.3% Not in index
MMLU Pro (Artificial Analysis run)Knowledge Not measured Not in index
LiveCodeBench (Artificial Analysis run)Coding Not measured Not in index
SciCodeCoding 47.2% Not in index
Terminal-Bench Hard (Artificial Analysis run)Coding 42.4% Not in index
IFBenchGeneral 75.9% Not in index
Long context reasoning (AA-LCR)General 76.7% Not in index
τ²-Bench TelecomAgentic work 76.0% Not in index
AIME 2025 (Artificial Analysis run)Math Not measured Not in index
Terminal-BenchCoding Not measured Not in index
DeepSWECoding Not measured Not in index
FrontierCodeCoding Not measured Not in index
FrontierSWECoding Not measured Not in index
GSO-BenchCoding Not measured Not in index
WeirdMLCoding 49.2% Not in index
MirrorCodeCoding Not measured Not in index
APEX-AgentsAgentic work Not measured Not in index
METR time horizonsAgentic work Not measured Not in index
Remote Labor IndexAgentic work Not measured Not in index
GDPvalAgentic work Not measured Not in index
OSWorld 2.0Agentic work Not measured Not in index
BALROGAgentic work Not measured Not in index
DeepResearch BenchAgentic work Not measured Not in index
PostTrainBenchAgentic work Not measured Not in index
GPQA Diamond (Epoch AI run)Reasoning 78.5% Not in index
ARC-AGIReasoning 51.5% Not in index
ARC-AGI-2Reasoning 5.7% Not in index
Humanity's Last ExamReasoning Not measured Not in index
SimpleBenchReasoning Not measured Not in index
Chess puzzlesReasoning 45.0% Not in index
Mystery game puzzlesReasoning 9.0% Not in index
EBR-benchReasoning Not measured Not in index
OTIS Mock AIMEMath 87.8% Not in index
FrontierMath, tiers 1 to 3Math 44.9% Not in index
FrontierMath, tier 4Math 12.2% Not in index
ProofBenchMath 5.0% Not in index
MATH level 5Math Not measured Not in index
GSM8KMath Not measured Not in index
SimpleQA VerifiedKnowledge 11.7% Not in index
MMLUKnowledge Not measured Not in index
GeoBenchKnowledge Not measured Not in index
DTBenchGeneral 80.3% Not in index
LMCAGeneral 36.9% Not in index
Fiction.LiveBenchGeneral Not measured Not in index
Creative writing (Lech Mazur)General Not measured Not in index
CL-benchGeneral Not measured Not in index
Surface Evolver BenchGeneral Not measured Not in index
Furniture assemblyGeneral Not measured Not in index
ExploitBenchGeneral Not measured Not in index
CybenchCoding Not measured Not in index
TheAgentCompanyAgentic work Not measured Not in index
OSWorldAgentic work Not measured Not in index
SpireClimbAgentic work Not measured Not in index
VPCTReasoning Not measured Not in index
BIG-Bench HardReasoning Not measured Not in index
AI2 Reasoning ChallengeKnowledge Not measured Not in index
HellaSwagGeneral Not measured Not in index
WinoGrandeGeneral Not measured Not in index
PIQAGeneral Not measured Not in index
CL-bench LifeGeneral Not measured Not in index
ALE-BenchCoding 1004.5 Not in index
Vending-Bench 2Agentic work Not measured Not in index
Epoch Capabilities IndexIntelligence 146.1 Not in index
LMArena TextGeneral 1372 Not in index
LMArena Text: codingCoding 1404 Not in index
LMArena Text: hard promptsReasoning 1380 Not in index
LMArena Text: mathMath 1406 Not in index
LMArena Text: instruction followingGeneral 1362 Not in index
LMArena Text: creative writingGeneral 1314 Not in index
LMArena VisionGeneral 1196 Not in index
LMArena Text: EnglishGeneral 1381 Not in index
LMArena Text: non-EnglishGeneral 1359 Not in index
LMArena Text: ChineseGeneral 1391 Not in index
LMArena Text: GermanGeneral 1368 Not in index
LMArena Text: JapaneseGeneral 1343 Not in index
LMArena Text: KoreanGeneral 1321 Not in index
LMArena Text: FrenchGeneral 1396 Not in index
LMArena Text: SpanishGeneral 1371 Not in index
LMArena Text: RussianGeneral 1362 Not in index
LMArena Text: PolishGeneral 1365 Not in index
LMArena Text: multi-turnGeneral 1382 Not in index
LMArena Text: longer queriesGeneral 1366 Not in index
LMArena Text: expertReasoning 1396 Not in index
LMArena Text: hard prompts in EnglishReasoning 1387 Not in index
LMArena Text: software and ITCoding 1402 Not in index
LMArena Text: mathematical workMath 1408 Not in index
LMArena Text: scienceKnowledge 1374 Not in index
LMArena Text: medicine and healthcareKnowledge 1369 Not in index
LMArena Text: legal and governmentKnowledge 1368 Not in index
LMArena Text: business and financeKnowledge 1366 Not in index
LMArena Text: writing and languageGeneral 1338 Not in index
LMArena Text: entertainment and mediaGeneral 1324 Not in index
LMArena WebDev: ReactCoding Not measured Not in index
LMArena WebDev: HTMLCoding Not measured Not in index
LMArena WebDev: from an imageCoding Not measured Not in index
LMArena Vision: EnglishGeneral 1202 Not in index
LMArena Vision: ChineseGeneral 1232 Not in index
LMArena Vision: reading textGeneral 1204 Not in index
LMArena Vision: diagramsReasoning 1210 Not in index
LMArena Vision: homeworkReasoning 1225 Not in index
LMArena Vision: humorGeneral 1161 Not in index
LMArena Vision: captioningGeneral Not measured Not in index
LMArena Vision: recognizing thingsGeneral 1141 Not in index
LMArena Vision: creative writingGeneral 1159 Not in index
LMArena SearchAgentic work Not measured Not in index
LMArena DocumentGeneral Not measured Not in index
LMArena Text to ImageImage generation Not measured Not in index
LMArena Image EditImage generation Not measured Not in index

What it costs

A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.

Output price against the market

GPT-5.4 Nano pricing
$0.0112Dashed line: median $1.80, log scale$600.00
$1.25 per million output tokens is cheaper than 55% of the 344 paid models in the catalog.

Cost per solved task

How it is computed
$0.10one attempt, Vals AI 69.8%tasks solved $0.14per solved task

Nearly as good as GPT-5.4 Nano, for less

What the boards say about its runs

Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.

What each board publishes about the runs behind OpenAI: GPT-5.4 Nano's results
BoardResultWhat the run costAlso published
SWE-bench Verified (Vals AI) 69.8% $0.10 per test Duration, as printed 4m 23s
Vibe Code Bench (Vals AI) 26.1% $1.28 per test Duration, as printed 54m 36s
Code migration (Vals AI) 14.5% $0.42 per test Duration, as printed 26m 34s
Terminal-Bench 2.1 (Vals AI) 41.6% $0.07 per test Duration, as printed 12m 37s
Finance Agent (Vals AI) 38.2% $0.16 per test Duration, as printed 5m 35s
Tax Agent Bench (Vals AI) 5.0% $0.07 per test Duration, as printed 3m 40s
Legal Research Bench (Vals AI) 6.3% $0.14 per test Duration, as printed 8m 47s
Excel Modeling Benchmark (Vals AI) 44.8% $0.57 per test Duration, as printed 29m 27s
Vals Multimodal Index 47.6% $0.23 per test Duration, as printed 11m 11s
WeirdML 49.2% $0.0477 per run Median lines of code 279
ARC-AGI 51.5% $0.13 per task Nothing else
ARC-AGI-2 5.7% $0.16 per task Nothing else
52 more boards
What each board publishes about the runs behind OpenAI: GPT-5.4 Nano's results, continued
ProofBench 5.0% $0.0159 per test Time per proof 8m 45s
ALE-Bench 1004.5 $0.0271 per problem Tokens per problem 24,378
GPQA Diamond 77.5% Not published Latency, as printed 30 s
AIME 88.8% Not published Latency, as printed 1m 06s
MMLU Pro 77.2% Not published Latency, as printed 8.2 s
LiveCodeBench (Vals AI) 84.0% Not published Latency, as printed 1m 00s
MMMU Pro (Vals AI) 73.6% Not published Latency, as printed 22 s
SAGE (Vals AI) 38.1% Not published Latency, as printed 34 s
LegalBench (Vals AI) 77.9% Not published Latency, as printed 2.7 s
CaseLaw (Vals AI) 51.9% Not published Latency, as printed 7.6 s
CorpFin (Vals AI) 61.2% Not published Latency, as printed 9.4 s
TaxEval (Vals AI) 67.4% Not published Latency, as printed 16 s
MortgageTax (Vals AI) 59.1% Not published Latency, as printed 15 s
MedCode (Vals AI) 41.0% Not published Latency, as printed 8.0 s
MedScribe (Vals AI) 77.1% Not published Latency, as printed 21 s
LMArena Text 1372 Elo Not published Votes 62,396 · Interval (±) ±3.8
LMArena Text: coding 1404 Elo Not published Votes 17,665 · Interval (±) ±5.9
LMArena Text: hard prompts 1380 Elo Not published Votes 41,331 · Interval (±) ±4.5
LMArena Text: math 1406 Elo Not published Votes 3,264 · Interval (±) ±10.8
LMArena Text: instruction following 1362 Elo Not published Votes 21,487 · Interval (±) ±5.5
LMArena Text: creative writing 1314 Elo Not published Votes 10,371 · Interval (±) ±7.2
LMArena Vision 1196 Elo Not published Votes 25,624 · Interval (±) ±6.3
LMArena Text: English 1381 Elo Not published Votes 28,906 · Interval (±) ±5.0
LMArena Text: non-English 1359 Elo Not published Votes 33,490 · Interval (±) ±4.7
LMArena Text: Chinese 1391 Elo Not published Votes 3,844 · Interval (±) ±10.4
LMArena Text: German 1368 Elo Not published Votes 936 · Interval (±) ±20.6
LMArena Text: Japanese 1343 Elo Not published Votes 610 · Interval (±) ±25.6
LMArena Text: Korean 1321 Elo Not published Votes 1,034 · Interval (±) ±19.7
LMArena Text: French 1396 Elo Not published Votes 2,092 · Interval (±) ±14.9
LMArena Text: Spanish 1371 Elo Not published Votes 1,914 · Interval (±) ±15.0
LMArena Text: Russian 1362 Elo Not published Votes 6,868 · Interval (±) ±8.0
LMArena Text: Polish 1365 Elo Not published Votes 1,129 · Interval (±) ±18.2
LMArena Text: multi-turn 1382 Elo Not published Votes 11,780 · Interval (±) ±6.8
LMArena Text: longer queries 1366 Elo Not published Votes 27,722 · Interval (±) ±5.3
LMArena Text: expert 1396 Elo Not published Votes 6,384 · Interval (±) ±8.3
LMArena Text: hard prompts in English 1387 Elo Not published Votes 19,941 · Interval (±) ±5.7
LMArena Text: software and IT 1402 Elo Not published Votes 24,954 · Interval (±) ±5.2
LMArena Text: mathematical work 1408 Elo Not published Votes 3,479 · Interval (±) ±10.8
LMArena Text: science 1374 Elo Not published Votes 10,518 · Interval (±) ±6.9
LMArena Text: medicine and healthcare 1369 Elo Not published Votes 4,788 · Interval (±) ±9.5
LMArena Text: legal and government 1368 Elo Not published Votes 4,975 · Interval (±) ±9.3
LMArena Text: business and finance 1366 Elo Not published Votes 12,592 · Interval (±) ±6.5
LMArena Text: writing and language 1338 Elo Not published Votes 15,395 · Interval (±) ±6.1
LMArena Text: entertainment and media 1324 Elo Not published Votes 13,668 · Interval (±) ±6.5
LMArena Vision: English 1202 Elo Not published Votes 10,341 · Interval (±) ±8.5
LMArena Vision: Chinese 1232 Elo Not published Votes 1,739 · Interval (±) ±17.0
LMArena Vision: reading text 1204 Elo Not published Votes 18,222 · Interval (±) ±6.3
LMArena Vision: diagrams 1210 Elo Not published Votes 6,840 · Interval (±) ±8.9
LMArena Vision: homework 1225 Elo Not published Votes 3,429 · Interval (±) ±11.2
LMArena Vision: humor 1161 Elo Not published Votes 923 · Interval (±) ±21.0
LMArena Vision: recognizing things 1141 Elo Not published Votes 178 · Interval (±) ±42.4
LMArena Vision: creative writing 1159 Elo Not published Votes 1,531 · Interval (±) ±16.7

On these lists

No comparison page of its own yet: one needs a coding index on both sides, and GPT-5.4 Nano has none. Compare GPT-5.4 Nano with any model