GPT-5.1 vs GPT-5.4 Nano

GPT-5.4 Nano leads GPT-5.1 on coding, 44.8 to 40.4 on the Vibe Coding Index, and GPT-5.4 Nano costs 8.0x less per output token ($1.25 vs $10.00 per million). Updated October 22, 2026; 71 benchmarks have a result for both.

Replace GPT-5.1 Replace GPT-5.4 Nano

GPT-5.1OpenAI

Coding: 40.4
Overall: 55.0
Output $/M: $10.00

GPT-5.4 NanoOpenAI

Coding: 44.8
Overall: 45.7
Output $/M: $1.25

vs boards won of 71 shared, 1 tied

GPT-5.1 or GPT-5.4 Nano: which to pick

Pick GPT-5.4 Nano for coding: it scores 44.8 on the Vibe Coding Index against 40.4 for GPT-5.1, though on 2 benchmarks against 3.

Pick GPT-5.1 for work measured by LiveCodeBench (Vals AI) or Terminal-Bench Hard (Artificial Analysis run), where it leads.

Model AGPT-5.1OpenAI40.4/1003 independent benchmarks$1.02 per solved task Model BGPT-5.4 NanoOpenAI44.8/1002 independent benchmarks$0.14 per solved task

713014

Shared results: 71
GPT-5.1 only: 30
GPT-5.4 Nano only: 14
Like-for-like categories: 7 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, six public coding benchmarks
GPT-5.4 Nano
GPT-5.4 Nano scores 44.8 against 40.4.
3 and 2 benchmarks behind the scores
Intelligence
AA Intelligence Index
GPT-5.1
GPT-5.1 leads, 24.7 against 20.7.
Same board, both measured
Agentic work
AA Agentic Index
No call
Only GPT-5.4 Nano has a AA Agentic Index result, 16.0.
Directional only
Reasoning
GPQA Diamond
GPT-5.1
GPT-5.1 leads, 86.6% against 77.5%.
Same board, both measured
Math
AIME
GPT-5.1
GPT-5.1 leads, 93.3% against 88.8%.
Same board, both measured
Knowledge
MMLU Pro
GPT-5.1
GPT-5.1 leads, 86.4% against 77.2%.
Same board, both measured
Web design
Design Arena: websites
No call
Only GPT-5.1 has a Design Arena: websites result, 1187.
Directional only
Long documents
Listed context window
No call
Both take 400K tokens.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
GPT-5.4 Nano
GPT-5.1 $0.0063, GPT-5.4 Nano $0.0008 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
GPT-5.4 Nano
GPT-5.1 $1.02, GPT-5.4 Nano $0.14.
Published attempt cost and pass rate

At a glance

Coding index: GPT-5.1 40.4 from 3 benchmarks, GPT-5.4 Nano 44.8 from 2 benchmarks.
Widest category: Knowledge, 12.8 points apart on average over 12 shared benchmarks.
Widest single gap: SimpleQA Verified: GPT-5.1 48.0% against GPT-5.4 Nano 11.7%, 36.3 points apart on a 0 to 100 scale.
Output price: GPT-5.1 $10.00 against GPT-5.4 Nano $1.25 per million output tokens, 8.0x apart.
Context window: Both take 400K tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	GPT-5.1	GPT-5.4 Nano	Ties
Coding	5	2	1 tie
Intelligence	2	0
Agentic work	1	0
Reasoning	13	1
Math	4	0
Knowledge	12	0
General	29	1
All shared boards	66	4	1 tie

CodingLike-for-likeSix of these boards feed the Vibe Coding Index52

Coding benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
SWE-bench Verified	66.0%	Not measured	Only GPT-5.1 measured
LMArena WebDev	1396	Not measured	Only GPT-5.1 measured
AA Coding Index	49.4	56.1	GPT-5.4 Nano
LiveCodeBench (Vals AI)	86.5%	84.0%	GPT-5.1
SWE-bench Verified (Vals AI)	69.8%	69.8%	Tie
Vibe Code Bench (Vals AI)	24.6%	26.1%	GPT-5.4 Nano
Code migration (Vals AI)	Not measured	14.5%	Only GPT-5.4 Nano measured
Terminal-Bench 2.1 (Vals AI)	Not measured	41.6%	Only GPT-5.4 Nano measured
LiveCodeBench (Artificial Analysis run)	86.8%	Not measured	Only GPT-5.1 measured
SciCode	Not measured	47.2%	Only GPT-5.4 Nano measured
Terminal-Bench Hard (Artificial Analysis run)	45.5%	42.4%	GPT-5.1
Terminal-Bench	47.6%	Not measured	Only GPT-5.1 measured
GSO-Bench	13.7%	Not measured	Only GPT-5.1 measured
WeirdML	60.8%	49.2%	GPT-5.1
ALE-Bench	Not measured	1004.5	Only GPT-5.4 Nano measured
LMArena Text: coding	1453	1404	GPT-5.1
LMArena Text: software and IT	1454	1402	GPT-5.1
LMArena WebDev: React	1307	Not measured	Only GPT-5.1 measured
LMArena WebDev: HTML	1405	Not measured	Only GPT-5.1 measured
LMArena WebDev: from an image	1421	Not measured	Only GPT-5.1 measured
Neither model has a result on the other 19 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20

Intelligence benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
AA Intelligence Index	24.7	20.7	GPT-5.1
Epoch Capabilities Index	149.8	146.0	GPT-5.1

Agentic workLike-for-likePublic boards, shown as published, kept out of the index10

Agentic work benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
AA Agentic Index	Not measured	16.0	Only GPT-5.4 Nano measured
Finance Agent (Vals AI)	Not measured	38.2%	Only GPT-5.4 Nano measured
Tax Agent Bench (Vals AI)	Not measured	5.0%	Only GPT-5.4 Nano measured
Legal Research Bench (Vals AI)	Not measured	6.3%	Only GPT-5.4 Nano measured
Excel Modeling Benchmark (Vals AI)	Not measured	44.8%	Only GPT-5.4 Nano measured
τ²-Bench Telecom	81.9%	76.0%	GPT-5.1
DeepResearch Bench	42.8%	Not measured	Only GPT-5.1 measured
Vending-Bench 2	$1,473	Not measured	Only GPT-5.1 measured
Neither model has a result on the other 33 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index131

Reasoning benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
GPQA Diamond	86.6%	77.5%	GPT-5.1
MMMU Pro (Vals AI)	83.2%	73.6%	GPT-5.1
GPQA Diamond (Artificial Analysis run)	87.3%	81.7%	GPT-5.1
Humanity's Last Exam (Artificial Analysis run)	28.5%	28.3%	GPT-5.1
GPQA Diamond (Epoch AI run)	87.6%	78.5%	GPT-5.1
ARC-AGI	72.8%	51.5%	GPT-5.1
ARC-AGI-2	17.6%	5.7%	GPT-5.1
SimpleBench	53.2%	Not measured	Only GPT-5.1 measured
Chess puzzles	42.0%	45.0%	GPT-5.4 Nano
Mystery game puzzles	19.0%	9.0%	GPT-5.1
VPCT	58.7%	Not measured	Only GPT-5.1 measured
LMArena Text: hard prompts	1457	1381	GPT-5.1
LMArena Text: expert	1470	1396	GPT-5.1
LMArena Text: hard prompts in English	1462	1387	GPT-5.1
LMArena Vision: diagrams	1264	1210	GPT-5.1
LMArena Vision: homework	1272	1225	GPT-5.1
Kagi LLM Benchmark	Not measured	39.7%	Only GPT-5.4 Nano measured
Neither model has a result on the other 5 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index40

Math benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
AIME	93.3%	88.8%	GPT-5.1
MGSM (Vals AI)	93.0%	Not measured	Only GPT-5.1 measured
AA Math Index	94.0	Not measured	Only GPT-5.1 measured
AIME 2025 (Artificial Analysis run)	94.0%	Not measured	Only GPT-5.1 measured
OTIS Mock AIME	88.6%	87.8%	GPT-5.1
FrontierMath, tiers 1 to 3	Not measured	44.9%	Only GPT-5.4 Nano measured
FrontierMath, tier 4	Not measured	12.2%	Only GPT-5.4 Nano measured
ProofBench	Not measured	5.0%	Only GPT-5.4 Nano measured
LMArena Text: math	1446	1405	GPT-5.1
LMArena Text: mathematical work	1449	1409	GPT-5.1
Neither model has a result on the other 3 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index120

Knowledge benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
MMLU Pro	86.4%	77.2%	GPT-5.1
LegalBench (Vals AI)	85.7%	77.9%	GPT-5.1
CaseLaw (Vals AI)	73.4%	51.9%	GPT-5.1
CorpFin (Vals AI)	63.8%	61.2%	GPT-5.1
TaxEval (Vals AI)	74.9%	67.4%	GPT-5.1
MortgageTax (Vals AI)	61.4%	59.1%	GPT-5.1
MedQA (Vals AI)	96.4%	Not measured	Only GPT-5.1 measured
MedCode (Vals AI)	52.7%	41.0%	GPT-5.1
MMLU Pro (Artificial Analysis run)	87.0%	Not measured	Only GPT-5.1 measured
SimpleQA Verified	48.0%	11.7%	GPT-5.1
LMArena Text: science	1459	1374	GPT-5.1
LMArena Text: medicine and healthcare	1456	1369	GPT-5.1
LMArena Text: legal and government	1459	1368	GPT-5.1
LMArena Text: business and finance	1431	1366	GPT-5.1
FACTS Benchmark Suite	45.0%	Not measured	Only GPT-5.1 measured
Neither model has a result on the other 3 boards here

Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared

Web design benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
Design Arena: websites	1187	Not measured	Only GPT-5.1 measured
Design Arena: UI components	1163	Not measured	Only GPT-5.1 measured
Design Arena: game dev	1178	Not measured	Only GPT-5.1 measured
Design Arena: data viz	1204	Not measured	Only GPT-5.1 measured
Design Arena: 3D	1060	Not measured	Only GPT-5.1 measured
Design Arena: all code categories	1170	Not measured	Only GPT-5.1 measured
Design Arena: SVG	1149	Not measured	Only GPT-5.1 measured
Design Arena: ASCII art	1119	Not measured	Only GPT-5.1 measured
Neither model has a result on the other 1 board here

GeneralLike-for-likePublic boards, shown as published, kept out of the index291

General benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
SAGE (Vals AI)	43.2%	38.1%	GPT-5.1
MedScribe (Vals AI)	88.1%	77.1%	GPT-5.1
Vals Multimodal Index	Not measured	47.6%	Only GPT-5.4 Nano measured
IFBench	72.9%	75.9%	GPT-5.4 Nano
Long context reasoning (AA-LCR)	80.0%	76.7%	GPT-5.1
DTBench	90.1%	80.3%	GPT-5.1
LMCA	43.9%	36.9%	GPT-5.1
CL-bench	23.7%	Not measured	Only GPT-5.1 measured
CL-bench Life	17.3%	Not measured	Only GPT-5.1 measured
LMArena Text	1443	1372	GPT-5.1
LMArena Text: instruction following	1443	1362	GPT-5.1
LMArena Text: creative writing	1427	1315	GPT-5.1
LMArena Vision	1250	1196	GPT-5.1
LMArena Text: English	1451	1381	GPT-5.1
LMArena Text: non-English	1431	1359	GPT-5.1
LMArena Text: Chinese	1495	1391	GPT-5.1
LMArena Text: German	1438	1368	GPT-5.1
LMArena Text: Japanese	1453	1343	GPT-5.1
LMArena Text: Korean	1401	1321	GPT-5.1
LMArena Text: French	1450	1395	GPT-5.1
LMArena Text: Spanish	1433	1371	GPT-5.1
LMArena Text: Russian	1435	1363	GPT-5.1
LMArena Text: Polish	1440	1366	GPT-5.1
LMArena Text: multi-turn	1450	1382	GPT-5.1
LMArena Text: longer queries	1448	1365	GPT-5.1
LMArena Text: writing and language	1428	1338	GPT-5.1
LMArena Text: entertainment and media	1415	1325	GPT-5.1
LMArena Vision: English	1252	1202	GPT-5.1
LMArena Vision: Chinese	1270	1232	GPT-5.1
LMArena Vision: reading text	1255	1204	GPT-5.1
LMArena Vision: humor	1263	1161	GPT-5.1
LMArena Vision: captioning	1252	Not measured	Only GPT-5.1 measured
LMArena Vision: recognizing things	1232	1141	GPT-5.1
LMArena Vision: creative writing	1266	1159	GPT-5.1
LMArena Document	1403	Not measured	Only GPT-5.1 measured
Neither model has a result on the other 11 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for GPT-5.1 and GPT-5.4 Nano
Benchmark	GPT-5.1	GPT-5.4 Nano	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-5.1$0.0063Fits in one request

GPT-5.4 Nano$0.0008Fits in one request

GPT-5.4 Nano costs less

Repository review

50K input + 3K output tokens

GPT-5.1$0.092Fits in one request

GPT-5.4 Nano$0.014Fits in one request

GPT-5.4 Nano costs less

Agent loop

200K input + 10K output tokens

GPT-5.1$0.350Fits in one request

GPT-5.4 Nano$0.052Fits in one request

GPT-5.4 Nano costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-5.1 and GPT-5.4 Nano
Specification	OpenAI GPT-5.1	OpenAI GPT-5.4 Nano
Maker	OpenAI	OpenAI
Weights	No public weights listed	No public weights listed
Released	November 13, 2025	March 17, 2026
Context window	400K	400K
Input $/Mtok	$1.25	$0.20
Output $/Mtok	$10.00	$1.25
Coding index	40.4	44.8
Independent measurements behind it	3	2
Cost per solved task	$1.02	$0.14
Source	OpenRouter listing	OpenRouter listing

Questions

Is GPT-5.1 better than GPT-5.4 Nano for coding?

Pick GPT-5.4 Nano for coding: it scores 44.8 on the Vibe Coding Index against 40.4 for GPT-5.1, though on 2 benchmarks against 3. Pick GPT-5.1 for work measured by LiveCodeBench (Vals AI) or Terminal-Bench Hard (Artificial Analysis run), where it leads.

Which is cheaper, GPT-5.1 or GPT-5.4 Nano?

GPT-5.1 costs $1.25 per million input tokens and $10.00 per million output tokens; GPT-5.4 Nano costs $0.20 and $1.25. Per solved SWE-bench Verified task, GPT-5.1 costs $1.02 and GPT-5.4 Nano $0.14.

Which has the bigger context window, GPT-5.1 or GPT-5.4 Nano?

Neither: both take 400K tokens.

How many benchmarks is the GPT-5.1 vs GPT-5.4 Nano comparison based on?

71 benchmarks have a result for both models as of October 22, 2026. GPT-5.1's coding index rests on 3 independent benchmarks and GPT-5.4 Nano's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/gpt-5-1-vs-gpt-5-4-nano" title="GPT-5.1 vs GPT-5.4 Nano, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/gpt-5-1-vs-gpt-5-4-nano">LLMBenchmark.ai, GPT-5.1 vs GPT-5.4 Nano</a></p>

GPT-5.1 or GPT-5.4 Nano: which to pick

Which one for your work

Coding

Intelligence

Agentic work

Reasoning

Math

Knowledge

Web design

Long documents

Everyday cost

Cost per solved task

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next