GPT-5.4 vs GPT-6.1 Sol

GPT-6.1 Sol leads GPT-5.4 on coding, 82.4 to 64.4 on the Vibe Coding Index, and GPT-6.1 Sol costs 1.5x less per output token ($10.00 vs $15.00 per million). Updated October 22, 2026; 68 benchmarks have a result for both.

Replace GPT-5.4 Replace GPT-6.1 Sol

GPT-5.4OpenAI

Coding: 64.4
Overall: 69.6
Output $/M: $15.00

GPT-6.1 SolOpenAI

Coding: 82.4
Overall: 81.4
Output $/M: $10.00

vs boards won of 68 shared

GPT-5.4 or GPT-6.1 Sol: which to pick

Pick GPT-6.1 Sol for coding: it scores 82.4 on the Vibe Coding Index against 64.4 for GPT-5.4.

Pick GPT-5.4 for work measured by LMArena Text: coding or LMArena Text: software and IT, where it leads.

Model AGPT-5.4OpenAI64.4/1003 independent benchmarks$1.02 per solved task Model BGPT-6.1 SolOpenAI82.4/1005 independent benchmarksNo cost per solved task

684230

Shared results: 68
GPT-5.4 only: 42
GPT-6.1 Sol only: 30
Like-for-like categories: 8 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, six public coding benchmarks
GPT-6.1 Sol
GPT-6.1 Sol scores 82.4 against 64.4.
3 and 5 benchmarks behind the scores
Intelligence
AA Intelligence Index
GPT-6.1 Sol
GPT-6.1 Sol leads, 51.8 against 39.0.
Same board, both measured
Reasoning
GPQA Diamond
No call
Only GPT-5.4 has a GPQA Diamond result, 91.7%.
Directional only
Math
AIME
No call
Only GPT-5.4 has a AIME result, 96.7%.
Directional only
Knowledge
MMLU Pro
No call
Only GPT-5.4 has a MMLU Pro result, 87.5%.
Directional only
Web design
Design Arena: websites
GPT-6.1 Sol
GPT-6.1 Sol leads, 1321 against 1198.
Same board, both measured
General
Vals Index
No call
Only GPT-6.1 Sol has a Vals Index result, 63.9%.
Directional only
Long documents
Listed context window
No call
Both take 1.05M tokens.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
GPT-6.1 Sol
GPT-5.4 $0.010, GPT-6.1 Sol $0.0070 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
No call
Only GPT-5.4 has the number, $1.02.
Directional only

At a glance

Coding index: GPT-5.4 64.4 from 3 benchmarks, GPT-6.1 Sol 82.4 from 5 benchmarks.
Widest category: Web design, 22.3 points apart on average over 6 shared benchmarks.
Widest single gap: FrontierMath, tier 4: GPT-5.4 49.0% against GPT-6.1 Sol 100.0%, 51.0 points apart on a 0 to 100 scale.
Output price: GPT-5.4 $15.00 against GPT-6.1 Sol $10.00 per million output tokens, 1.5x apart.
Context window: Both take 1.05M tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	GPT-5.4	GPT-6.1 Sol
Coding	2	8
Intelligence	0	2
Agentic work	0	3
Reasoning	4	8
Math	0	6
Knowledge	4	2
Web design	0	6
General	16	7
All shared boards	26	42

CodingLike-for-likeSix of these boards feed the Vibe Coding Index28

Coding benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
LiveBench coding	Not measured	96.0%	Only GPT-6.1 Sol measured
LMArena WebDev	1464	1753	GPT-6.1 Sol
AA Coding Index	71.1	Not measured	Only GPT-5.4 measured
LiveCodeBench (Vals AI)	84.1%	Not measured	Only GPT-5.4 measured
SWE-bench Verified (Vals AI)	78.2%	Not measured	Only GPT-5.4 measured
Terminal-Bench 4 (Vals AI)	Not measured	55.0%	Only GPT-6.1 Sol measured
Vibe Code Bench (Vals AI)	67.4%	88.9%	GPT-6.1 Sol
Code migration (Vals AI)	35.0%	65.1%	GPT-6.1 Sol
ProgramBench (Vals AI)	0.5%	3.0%	GPT-6.1 Sol
IOI (Vals AI)	Not measured	96.9%	Only GPT-6.1 Sol measured
SWE-bench Multimodal (Vals AI)	Not measured	43.5%	Only GPT-6.1 Sol measured
SkillsBench (Vals AI)	51.7%	Not measured	Only GPT-5.4 measured
CyberBench (Vals AI)	Not measured	39.3%	Only GPT-6.1 Sol measured
SciCode	Not measured	55.8%	Only GPT-6.1 Sol measured
Terminal-Bench Hard (Artificial Analysis run)	57.6%	Not measured	Only GPT-5.4 measured
Terminal-Bench	81.8%	Not measured	Only GPT-5.4 measured
FrontierCode	Not measured	50.2%	Only GPT-6.1 Sol measured
GSO-Bench	31.4%	Not measured	Only GPT-5.4 measured
WeirdML	77.7%	Not measured	Only GPT-5.4 measured
MirrorCode	15.6%	Not measured	Only GPT-5.4 measured
ALE-Bench	1607.0	2743.8	GPT-6.1 Sol
LMArena Text: coding	1496	1478	GPT-5.4
LMArena Text: software and IT	1491	1476	GPT-5.4
LMArena WebDev: React	1454	1754	GPT-6.1 Sol
LMArena WebDev: HTML	1478	1800	GPT-6.1 Sol
LMArena WebDev: from an image	1436	1702	GPT-6.1 Sol
SciCode	Not measured	9.2%	Only GPT-6.1 Sol measured
Neither model has a result on the other 12 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02

Intelligence benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
AA Intelligence Index	39.0	51.8	GPT-6.1 Sol
Epoch Capabilities Index	157.3	168.4	GPT-6.1 Sol

Agentic workLike-for-likePublic boards, shown as published, kept out of the index03

Agentic work benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
Design Arena: agents building web apps	1059	1306	GPT-6.1 Sol
Design Arena: agents building full-stack apps	1017	Not measured	Only GPT-5.4 measured
Design Arena: agents building mobile apps	1087	1213	GPT-6.1 Sol
Design Arena: agents building Android apps	1031	Not measured	Only GPT-5.4 measured
Design Arena: agents building Godot games	1135	Not measured	Only GPT-5.4 measured
Design Arena: spreadsheets	Not measured	1259	Only GPT-6.1 Sol measured
LiveBench research	Not measured	83.5%	Only GPT-6.1 Sol measured
LiveBench browser	Not measured	88.0%	Only GPT-6.1 Sol measured
LiveBench long agentic	Not measured	73.0%	Only GPT-6.1 Sol measured
SREBench (Vals AI)	Not measured	50.8%	Only GPT-6.1 Sol measured
Finance Agent (Vals AI)	Not measured	52.0%	Only GPT-6.1 Sol measured
Tax Agent Bench (Vals AI)	Not measured	21.8%	Only GPT-6.1 Sol measured
Legal Research Bench (Vals AI)	Not measured	38.5%	Only GPT-6.1 Sol measured
Harvey's Legal Agent Benchmark (Vals AI)	Not measured	6.3%	Only GPT-6.1 Sol measured
Excel Modeling Benchmark (Vals AI)	Not measured	70.8%	Only GPT-6.1 Sol measured
BioMysteryBench (Vals AI)	Not measured	79.6%	Only GPT-6.1 Sol measured
Terminal-Bench-Science (Vals AI)	Not measured	52.9%	Only GPT-6.1 Sol measured
Vals Science Index	Not measured	59.6%	Only GPT-6.1 Sol measured
Robo-bench (Vals AI)	Not measured	28.3%	Only GPT-6.1 Sol measured
τ²-Bench Telecom	87.1%	Not measured	Only GPT-5.4 measured
APEX-Agents	52.4%	60.0%	GPT-6.1 Sol
METR time horizons	74.3%	Not measured	Only GPT-5.4 measured
DeepResearch Bench	35.1%	Not measured	Only GPT-5.4 measured
PostTrainBench	19.0%	Not measured	Only GPT-5.4 measured
SpireClimb	Not measured	24.7%	Only GPT-6.1 Sol measured
Vending-Bench 2	$6,144	Not measured	Only GPT-5.4 measured
Neither model has a result on the other 15 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index48

Reasoning benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
GPQA Diamond	91.7%	Not measured	Only GPT-5.4 measured
LiveBench reasoning	Not measured	92.6%	Only GPT-6.1 Sol measured
MysteryMechanism (Vals AI)	Not measured	46.4%	Only GPT-6.1 Sol measured
MMMU Pro (Vals AI)	87.5%	Not measured	Only GPT-5.4 measured
GPQA Diamond (Artificial Analysis run)	92.0%	Not measured	Only GPT-5.4 measured
Humanity's Last Exam (Artificial Analysis run)	43.7%	52.9%	GPT-6.1 Sol
GPQA Diamond (Epoch AI run)	93.3%	95.4%	GPT-6.1 Sol
ARC-AGI	93.7%	98.5%	GPT-6.1 Sol
ARC-AGI-2	74.0%	94.2%	GPT-6.1 Sol
Chess puzzles	48.0%	68.0%	GPT-6.1 Sol
Mystery game puzzles	37.0%	80.0%	GPT-6.1 Sol
EBR-bench	25.4%	54.3%	GPT-6.1 Sol
LMArena Text: hard prompts	1485	1463	GPT-5.4
LMArena Text: expert	1507	1489	GPT-5.4
LMArena Text: hard prompts in English	1479	1465	GPT-5.4
LMArena Vision: diagrams	1327	1306	GPT-5.4
LMArena Vision: homework	1336	1356	GPT-6.1 Sol
Kagi LLM Benchmark	63.8%	Not measured	Only GPT-5.4 measured
Neither model has a result on the other 4 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index06

Math benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
AIME	96.7%	Not measured	Only GPT-5.4 measured
OTIS Mock AIME	97.8%	100.0%	GPT-6.1 Sol
FrontierMath, tiers 1 to 3	78.6%	93.7%	GPT-6.1 Sol
FrontierMath, tier 4	49.0%	100.0%	GPT-6.1 Sol
ProofBench	56.0%	99.0%	GPT-6.1 Sol
LMArena Text: math	1488	1489	GPT-6.1 Sol
LMArena Text: mathematical work	1497	1513	GPT-6.1 Sol
Neither model has a result on the other 6 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index42

Knowledge benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
MMLU Pro	87.5%	Not measured	Only GPT-5.4 measured
LegalBench (Vals AI)	86.0%	Not measured	Only GPT-5.4 measured
CaseLaw (Vals AI)	63.8%	Not measured	Only GPT-5.4 measured
CorpFin (Vals AI)	65.3%	Not measured	Only GPT-5.4 measured
TaxEval (Vals AI)	74.0%	Not measured	Only GPT-5.4 measured
MortgageTax (Vals AI)	68.3%	Not measured	Only GPT-5.4 measured
MedQA (Vals AI)	96.1%	Not measured	Only GPT-5.4 measured
MedCode (Vals AI)	41.3%	48.8%	GPT-6.1 Sol
SimpleQA Verified	45.1%	73.9%	GPT-6.1 Sol
LMArena Text: science	1479	1444	GPT-5.4
LMArena Text: medicine and healthcare	1458	1433	GPT-5.4
LMArena Text: legal and government	1486	1471	GPT-5.4
LMArena Text: business and finance	1474	1445	GPT-5.4
FACTS Benchmark Suite	Not measured	75.3%	Only GPT-6.1 Sol measured
Neither model has a result on the other 4 boards here

Web designLike-for-likePublic boards, shown as published, kept out of the index06

Web design benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
Design Arena: websites	1198	1321	GPT-6.1 Sol
Design Arena: UI components	1212	1317	GPT-6.1 Sol
Design Arena: game dev	1194	1389	GPT-6.1 Sol
Design Arena: data viz	1196	1281	GPT-6.1 Sol
Design Arena: 3D	1065	1460	GPT-6.1 Sol
Design Arena: all code categories	1179	1345	GPT-6.1 Sol
Design Arena: SVG	1141	Not measured	Only GPT-5.4 measured
Design Arena: ASCII art	1188	Not measured	Only GPT-5.4 measured
LiveBench design	Not measured	82.1%	Only GPT-6.1 Sol measured

GeneralLike-for-likePublic boards, shown as published, kept out of the index167

General benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
Vals Index	Not measured	63.9%	Only GPT-6.1 Sol measured
LiveBench data analysis	Not measured	82.7%	Only GPT-6.1 Sol measured
Public Benefits Bench (Vals AI)	Not measured	59.3%	Only GPT-6.1 Sol measured
SAGE (Vals AI)	43.3%	46.5%	GPT-6.1 Sol
MedScribe (Vals AI)	77.5%	86.5%	GPT-6.1 Sol
IFBench	73.9%	Not measured	Only GPT-5.4 measured
Long context reasoning (AA-LCR)	82.0%	84.0%	GPT-6.1 Sol
DTBench	94.4%	96.5%	GPT-6.1 Sol
LMCA	52.0%	62.8%	GPT-6.1 Sol
CL-bench	27.9%	Not measured	Only GPT-5.4 measured
Furniture assembly	37.5%	80.0%	GPT-6.1 Sol
CL-bench Life	21.7%	Not measured	Only GPT-5.4 measured
LMArena Text	1469	1443	GPT-5.4
LMArena Text: instruction following	1469	1466	GPT-5.4
LMArena Text: creative writing	1439	1425	GPT-5.4
LMArena Vision	1303	1288	GPT-5.4
LMArena Text: English	1467	1450	GPT-5.4
LMArena Text: non-English	1465	1433	GPT-5.4
LMArena Text: Chinese	1520	1487	GPT-5.4
LMArena Text: German	1472	Not measured	Only GPT-5.4 measured
LMArena Text: Japanese	1485	Not measured	Only GPT-5.4 measured
LMArena Text: Korean	1449	Not measured	Only GPT-5.4 measured
LMArena Text: French	1493	1460	GPT-5.4
LMArena Text: Spanish	1452	1439	GPT-5.4
LMArena Text: Russian	1480	1457	GPT-5.4
LMArena Text: Polish	1472	Not measured	Only GPT-5.4 measured
LMArena Text: multi-turn	1482	1442	GPT-5.4
LMArena Text: longer queries	1473	1458	GPT-5.4
LMArena Text: writing and language	1458	1444	GPT-5.4
LMArena Text: entertainment and media	1438	1426	GPT-5.4
LMArena Vision: English	1301	1274	GPT-5.4
LMArena Vision: Chinese	1354	Not measured	Only GPT-5.4 measured
LMArena Vision: reading text	1312	1289	GPT-5.4
LMArena Vision: humor	1284	Not measured	Only GPT-5.4 measured
LMArena Vision: recognizing things	1251	Not measured	Only GPT-5.4 measured
LMArena Vision: creative writing	1283	1301	GPT-6.1 Sol
LMArena Document	1471	Not measured	Only GPT-5.4 measured
Neither model has a result on the other 9 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for GPT-5.4 and GPT-6.1 Sol
Benchmark	GPT-5.4	GPT-6.1 Sol	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-5.4$0.010Fits in one request

GPT-6.1 Sol$0.0070Fits in one request

GPT-6.1 Sol costs less

Repository review

50K input + 3K output tokens

GPT-5.4$0.170Fits in one request

GPT-6.1 Sol$0.130Fits in one request

GPT-6.1 Sol costs less

Agent loop

200K input + 10K output tokens

GPT-5.4$0.650Fits in one request

GPT-6.1 Sol$0.500Fits in one request

GPT-6.1 Sol costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-5.4 and GPT-6.1 Sol
Specification	OpenAI GPT-5.4	OpenAI GPT-6.1 Sol
Maker	OpenAI	OpenAI
Weights	No public weights listed	No public weights listed
Released	March 5, 2026	September 29, 2026
Context window	1.05M	1.05M
Input $/Mtok	$2.50	$2.00
Output $/Mtok	$15.00	$10.00
Coding index	64.4	82.4
Independent measurements behind it	3	5
Cost per solved task	$1.02	Not computable
Source	OpenRouter listing	OpenRouter listing

Questions

Is GPT-5.4 better than GPT-6.1 Sol for coding?

Pick GPT-6.1 Sol for coding: it scores 82.4 on the Vibe Coding Index against 64.4 for GPT-5.4. Pick GPT-5.4 for work measured by LMArena Text: coding or LMArena Text: software and IT, where it leads.

Which is cheaper, GPT-5.4 or GPT-6.1 Sol?

GPT-5.4 costs $2.50 per million input tokens and $15.00 per million output tokens; GPT-6.1 Sol costs $2.00 and $10.00. Cost per solved task is known for GPT-5.4 only.

Which has the bigger context window, GPT-5.4 or GPT-6.1 Sol?

Neither: both take 1.05M tokens.

How many benchmarks is the GPT-5.4 vs GPT-6.1 Sol comparison based on?

68 benchmarks have a result for both models as of October 22, 2026. GPT-5.4's coding index rests on 3 independent benchmarks and GPT-6.1 Sol's on 5. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/gpt-5-4-vs-gpt-6-1-sol" title="GPT-5.4 vs GPT-6.1 Sol, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/gpt-5-4-vs-gpt-6-1-sol">LLMBenchmark.ai, GPT-5.4 vs GPT-6.1 Sol</a></p>

GPT-5.4 or GPT-6.1 Sol: which to pick

Which one for your work

Coding

Intelligence

Reasoning

Math

Knowledge

Web design

General

Long documents

Everyday cost

Cost per solved task

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next