Gemini 3 Flash Preview vs GPT-5.4 Nano

GPT-5.4 Nano leads Gemini 3 Flash Preview on coding, 44.8 to 43.7 on the Vibe Coding Index, and GPT-5.4 Nano costs 2.4x less per output token ($1.25 vs $3.00 per million). Updated October 21, 2026; 43 benchmarks have a result for both.

Replace Gemini 3 Flash Preview Replace GPT-5.4 Nano

Gemini 3 Flash PreviewGoogle

Coding: 43.7
Overall: 55.0
Output $/M: $3.00

GPT-5.4 NanoOpenAI

Coding: 44.8
Overall: 45.7
Output $/M: $1.25

vs boards won of 43 shared

Gemini 3 Flash Preview or GPT-5.4 Nano: which to pick

Gemini 3 Flash Preview and GPT-5.4 Nano are level for coding, 43.7 against 44.8 on the Vibe Coding Index, so price and context decide.

Pick Gemini 3 Flash Preview for a larger context window (1.05M against 400K tokens) and work measured by LiveCodeBench (Vals AI) or SWE-bench Verified (Vals AI), where it leads. Pick GPT-5.4 Nano for output tokens 2.4x cheaper ($1.25 vs $3.00 per million) and a lower cost per solved task ($0.14 against $0.37).

Model AGemini 3 Flash PreviewGoogle43.7/1002 independent benchmarks$0.37 per solved task Model BGPT-5.4 NanoOpenAI44.8/1002 independent benchmarks$0.14 per solved task

432842

Shared results: 43
Gemini 3 Flash Preview only: 28
GPT-5.4 Nano only: 42
Like-for-like categories: 7 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, six public coding benchmarks
No call
Level: 43.7 against 44.8, inside 2 points.
2 benchmarks behind each score
Intelligence
AA Intelligence Index
Gemini 3 Flash Preview
Gemini 3 Flash Preview leads, 26.3 against 20.7.
Same board, both measured
Agentic work
AA Agentic Index
No call
Only GPT-5.4 Nano has a AA Agentic Index result, 16.0.
Directional only
Reasoning
GPQA Diamond
Gemini 3 Flash Preview
Gemini 3 Flash Preview leads, 87.9% against 77.5%.
Same board, both measured
Math
AIME
Gemini 3 Flash Preview
Gemini 3 Flash Preview leads, 95.6% against 88.8%.
Same board, both measured
Knowledge
MMLU Pro
Gemini 3 Flash Preview
Gemini 3 Flash Preview leads, 88.6% against 77.2%.
Same board, both measured
Web design
Design Arena: websites
No call
Only Gemini 3 Flash Preview has a Design Arena: websites result, 1196.
Directional only
Long documents
Listed context window
Gemini 3 Flash Preview
Gemini 3 Flash Preview takes 1.05M tokens against 400K.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
GPT-5.4 Nano
Gemini 3 Flash Preview $0.0020, GPT-5.4 Nano $0.0008 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
GPT-5.4 Nano
Gemini 3 Flash Preview $0.37, GPT-5.4 Nano $0.14.
Published attempt cost and pass rate

At a glance

Coding index: Gemini 3 Flash Preview 43.7 from 2 benchmarks, GPT-5.4 Nano 44.8 from 2 benchmarks.
Widest category: Reasoning, 15.1 points apart on average over 9 shared benchmarks.
Widest single gap: SimpleQA Verified: Gemini 3 Flash Preview 66.8% against GPT-5.4 Nano 11.7%, 55.1 points apart on a 0 to 100 scale.
Output price: Gemini 3 Flash Preview $3.00 against GPT-5.4 Nano $1.25 per million output tokens, 2.4x apart.
Context window: Gemini 3 Flash Preview takes 1.05M tokens, GPT-5.4 Nano 400K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	Gemini 3 Flash Preview	GPT-5.4 Nano
Coding	5	3
Intelligence	1	0
Agentic work	4	1
Reasoning	8	1
Math	5	0
Knowledge	8	0
General	6	1
All shared boards	37	6

CodingLike-for-likeSix of these boards feed the Vibe Coding Index53

Coding benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
SWE-bench Verified	75.8%	Not measured	Only Gemini 3 Flash Preview measured
AA Coding Index	Not measured	56.1	Only GPT-5.4 Nano measured
LiveCodeBench (Vals AI)	85.6%	84.0%	Gemini 3 Flash Preview
SWE-bench Verified (Vals AI)	75.0%	69.8%	Gemini 3 Flash Preview
Vibe Code Bench (Vals AI)	20.2%	26.1%	GPT-5.4 Nano
Code migration (Vals AI)	6.4%	14.5%	GPT-5.4 Nano
ProgramBench (Vals AI)	0.0%	Not measured	Only Gemini 3 Flash Preview measured
Terminal-Bench 2.1 (Vals AI)	53.9%	41.6%	Gemini 3 Flash Preview
LiveCodeBench (Artificial Analysis run)	90.8%	Not measured	Only Gemini 3 Flash Preview measured
SciCode	Not measured	47.2%	Only GPT-5.4 Nano measured
Terminal-Bench Hard (Artificial Analysis run)	38.6%	42.4%	GPT-5.4 Nano
Terminal-Bench	64.3%	Not measured	Only Gemini 3 Flash Preview measured
GSO-Bench	9.8%	Not measured	Only Gemini 3 Flash Preview measured
WeirdML	61.6%	49.2%	Gemini 3 Flash Preview
ALE-Bench	1367.2	1004.5	Gemini 3 Flash Preview
LMArena Text: coding	Not measured	1404	Only GPT-5.4 Nano measured
LMArena Text: software and IT	Not measured	1402	Only GPT-5.4 Nano measured
SciCode	12.7%	Not measured	Only Gemini 3 Flash Preview measured
Neither model has a result on the other 21 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10

Intelligence benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
AA Intelligence Index	26.3	20.7	Gemini 3 Flash Preview
Epoch Capabilities Index	Not measured	146.0	Only GPT-5.4 Nano measured

Agentic workLike-for-likePublic boards, shown as published, kept out of the index41

Agentic work benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
AA Agentic Index	Not measured	16.0	Only GPT-5.4 Nano measured
Design Arena: agents building web apps	1110	Not measured	Only Gemini 3 Flash Preview measured
Design Arena: agents building full-stack apps	1063	Not measured	Only Gemini 3 Flash Preview measured
Design Arena: agents building mobile apps	1090	Not measured	Only Gemini 3 Flash Preview measured
Design Arena: agents building Android apps	1050	Not measured	Only Gemini 3 Flash Preview measured
Design Arena: agents building Godot games	1161	Not measured	Only Gemini 3 Flash Preview measured
Design Arena: PowerPoint slides	1036	Not measured	Only Gemini 3 Flash Preview measured
Finance Agent (Vals AI)	42.5%	38.2%	Gemini 3 Flash Preview
Tax Agent Bench (Vals AI)	11.8%	5.0%	Gemini 3 Flash Preview
Legal Research Bench (Vals AI)	18.3%	6.3%	Gemini 3 Flash Preview
Excel Modeling Benchmark (Vals AI)	26.0%	44.8%	GPT-5.4 Nano
τ²-Bench Telecom	80.4%	76.0%	Gemini 3 Flash Preview
BALROG	48.1%	Not measured	Only Gemini 3 Flash Preview measured
DeepResearch Bench	49.8%	Not measured	Only Gemini 3 Flash Preview measured
Vending-Bench 2	$3,635	Not measured	Only Gemini 3 Flash Preview measured
Neither model has a result on the other 26 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index81

Reasoning benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
GPQA Diamond	87.9%	77.5%	Gemini 3 Flash Preview
MMMU Pro (Vals AI)	87.6%	73.6%	Gemini 3 Flash Preview
GPQA Diamond (Artificial Analysis run)	89.8%	81.7%	Gemini 3 Flash Preview
Humanity's Last Exam (Artificial Analysis run)	36.6%	28.3%	Gemini 3 Flash Preview
GPQA Diamond (Epoch AI run)	89.4%	78.5%	Gemini 3 Flash Preview
ARC-AGI	84.7%	51.5%	Gemini 3 Flash Preview
ARC-AGI-2	33.6%	5.7%	Gemini 3 Flash Preview
SimpleBench	61.1%	Not measured	Only Gemini 3 Flash Preview measured
Chess puzzles	39.0%	45.0%	GPT-5.4 Nano
Mystery game puzzles	26.0%	9.0%	Gemini 3 Flash Preview
VPCT	72.6%	Not measured	Only Gemini 3 Flash Preview measured
LMArena Text: hard prompts	Not measured	1381	Only GPT-5.4 Nano measured
LMArena Text: expert	Not measured	1396	Only GPT-5.4 Nano measured
LMArena Text: hard prompts in English	Not measured	1387	Only GPT-5.4 Nano measured
LMArena Vision: diagrams	Not measured	1210	Only GPT-5.4 Nano measured
LMArena Vision: homework	Not measured	1225	Only GPT-5.4 Nano measured
Kagi LLM Benchmark	Not measured	39.7%	Only GPT-5.4 Nano measured
Neither model has a result on the other 5 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index50

Math benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
AIME	95.6%	88.8%	Gemini 3 Flash Preview
MGSM (Vals AI)	93.3%	Not measured	Only Gemini 3 Flash Preview measured
AA Math Index	97.0	Not measured	Only Gemini 3 Flash Preview measured
AIME 2025 (Artificial Analysis run)	97.0%	Not measured	Only Gemini 3 Flash Preview measured
OTIS Mock AIME	95.6%	87.8%	Gemini 3 Flash Preview
FrontierMath, tiers 1 to 3	51.2%	44.9%	Gemini 3 Flash Preview
FrontierMath, tier 4	17.1%	12.2%	Gemini 3 Flash Preview
ProofBench	15.0%	5.0%	Gemini 3 Flash Preview
LMArena Text: math	Not measured	1405	Only GPT-5.4 Nano measured
LMArena Text: mathematical work	Not measured	1409	Only GPT-5.4 Nano measured
Neither model has a result on the other 3 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index80

Knowledge benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
MMLU Pro	88.6%	77.2%	Gemini 3 Flash Preview
LegalBench (Vals AI)	86.9%	77.9%	Gemini 3 Flash Preview
CaseLaw (Vals AI)	55.8%	51.9%	Gemini 3 Flash Preview
CorpFin (Vals AI)	66.4%	61.2%	Gemini 3 Flash Preview
TaxEval (Vals AI)	73.9%	67.4%	Gemini 3 Flash Preview
MortgageTax (Vals AI)	68.7%	59.1%	Gemini 3 Flash Preview
MedQA (Vals AI)	95.8%	Not measured	Only Gemini 3 Flash Preview measured
MedCode (Vals AI)	55.9%	41.0%	Gemini 3 Flash Preview
MMLU Pro (Artificial Analysis run)	89.0%	Not measured	Only Gemini 3 Flash Preview measured
SimpleQA Verified	66.8%	11.7%	Gemini 3 Flash Preview
GeoBench	88.0%	Not measured	Only Gemini 3 Flash Preview measured
LMArena Text: science	Not measured	1374	Only GPT-5.4 Nano measured
LMArena Text: medicine and healthcare	Not measured	1369	Only GPT-5.4 Nano measured
LMArena Text: legal and government	Not measured	1368	Only GPT-5.4 Nano measured
LMArena Text: business and finance	Not measured	1366	Only GPT-5.4 Nano measured
FACTS Benchmark Suite	63.4%	Not measured	Only Gemini 3 Flash Preview measured
Neither model has a result on the other 2 boards here

Web designDirectional onlyPublic boards, shown as published, kept out of the index4 boards, none shared

Web design benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
Design Arena: websites	1196	Not measured	Only Gemini 3 Flash Preview measured
Design Arena: game dev	1166	Not measured	Only Gemini 3 Flash Preview measured
Design Arena: 3D	1184	Not measured	Only Gemini 3 Flash Preview measured
Design Arena: all code categories	1189	Not measured	Only Gemini 3 Flash Preview measured
Neither model has a result on the other 5 boards here

GeneralLike-for-likePublic boards, shown as published, kept out of the index61

General benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
SAGE (Vals AI)	51.8%	38.1%	Gemini 3 Flash Preview
MedScribe (Vals AI)	69.9%	77.1%	GPT-5.4 Nano
Vals Multimodal Index	52.2%	47.6%	Gemini 3 Flash Preview
IFBench	78.0%	75.9%	Gemini 3 Flash Preview
Long context reasoning (AA-LCR)	78.0%	76.7%	Gemini 3 Flash Preview
DTBench	89.1%	80.3%	Gemini 3 Flash Preview
LMCA	43.1%	36.9%	Gemini 3 Flash Preview
LMArena Text	Not measured	1372	Only GPT-5.4 Nano measured
LMArena Text: instruction following	Not measured	1362	Only GPT-5.4 Nano measured
LMArena Text: creative writing	Not measured	1315	Only GPT-5.4 Nano measured
LMArena Vision	Not measured	1196	Only GPT-5.4 Nano measured
LMArena Text: English	Not measured	1381	Only GPT-5.4 Nano measured
LMArena Text: non-English	Not measured	1359	Only GPT-5.4 Nano measured
LMArena Text: Chinese	Not measured	1391	Only GPT-5.4 Nano measured
LMArena Text: German	Not measured	1368	Only GPT-5.4 Nano measured
LMArena Text: Japanese	Not measured	1343	Only GPT-5.4 Nano measured
LMArena Text: Korean	Not measured	1321	Only GPT-5.4 Nano measured
LMArena Text: French	Not measured	1395	Only GPT-5.4 Nano measured
LMArena Text: Spanish	Not measured	1371	Only GPT-5.4 Nano measured
LMArena Text: Russian	Not measured	1363	Only GPT-5.4 Nano measured
LMArena Text: Polish	Not measured	1366	Only GPT-5.4 Nano measured
LMArena Text: multi-turn	Not measured	1382	Only GPT-5.4 Nano measured
LMArena Text: longer queries	Not measured	1365	Only GPT-5.4 Nano measured
LMArena Text: writing and language	Not measured	1338	Only GPT-5.4 Nano measured
LMArena Text: entertainment and media	Not measured	1325	Only GPT-5.4 Nano measured
LMArena Vision: English	Not measured	1202	Only GPT-5.4 Nano measured
LMArena Vision: Chinese	Not measured	1232	Only GPT-5.4 Nano measured
LMArena Vision: reading text	Not measured	1204	Only GPT-5.4 Nano measured
LMArena Vision: humor	Not measured	1161	Only GPT-5.4 Nano measured
LMArena Vision: recognizing things	Not measured	1141	Only GPT-5.4 Nano measured
LMArena Vision: creative writing	Not measured	1159	Only GPT-5.4 Nano measured
Neither model has a result on the other 15 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for Gemini 3 Flash Preview and GPT-5.4 Nano
Benchmark	Gemini 3 Flash Preview	GPT-5.4 Nano	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 3 Flash Preview$0.0020Fits in one request

GPT-5.4 Nano$0.0008Fits in one request

GPT-5.4 Nano costs less

Repository review

50K input + 3K output tokens

Gemini 3 Flash Preview$0.034Fits in one request

GPT-5.4 Nano$0.014Fits in one request

GPT-5.4 Nano costs less

Agent loop

200K input + 10K output tokens

Gemini 3 Flash Preview$0.130Fits in one request

GPT-5.4 Nano$0.052Fits in one request

GPT-5.4 Nano costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 3 Flash Preview and GPT-5.4 Nano
Specification	Google Gemini 3 Flash Preview	OpenAI GPT-5.4 Nano
Maker	Google	OpenAI
Weights	No public weights listed	No public weights listed
Released	December 17, 2025	March 17, 2026
Context window	1.05M	400K
Input $/Mtok	$0.50	$0.20
Output $/Mtok	$3.00	$1.25
Coding index	43.7	44.8
Independent measurements behind it	2	2
Cost per solved task	$0.37	$0.14
Source	OpenRouter listing	OpenRouter listing

Questions

Is Gemini 3 Flash Preview better than GPT-5.4 Nano for coding?

Gemini 3 Flash Preview and GPT-5.4 Nano are level for coding, 43.7 against 44.8 on the Vibe Coding Index, so price and context decide. Pick Gemini 3 Flash Preview for a larger context window (1.05M against 400K tokens) and work measured by LiveCodeBench (Vals AI) or SWE-bench Verified (Vals AI), where it leads. Pick GPT-5.4 Nano for output tokens 2.4x cheaper ($1.25 vs $3.00 per million) and a lower cost per solved task ($0.14 against $0.37).

Which is cheaper, Gemini 3 Flash Preview or GPT-5.4 Nano?

Gemini 3 Flash Preview costs $0.50 per million input tokens and $3.00 per million output tokens; GPT-5.4 Nano costs $0.20 and $1.25. Per solved SWE-bench Verified task, Gemini 3 Flash Preview costs $0.37 and GPT-5.4 Nano $0.14.

Which has the bigger context window, Gemini 3 Flash Preview or GPT-5.4 Nano?

Gemini 3 Flash Preview, with 1.05M tokens against 400K.

How many benchmarks is the Gemini 3 Flash Preview vs GPT-5.4 Nano comparison based on?

43 benchmarks have a result for both models as of October 21, 2026. Gemini 3 Flash Preview's coding index rests on 2 independent benchmarks and GPT-5.4 Nano's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/gemini-3-flash-preview-vs-gpt-5-4-nano" title="Gemini 3 Flash Preview vs GPT-5.4 Nano, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/gemini-3-flash-preview-vs-gpt-5-4-nano">LLMBenchmark.ai, Gemini 3 Flash Preview vs GPT-5.4 Nano</a></p>

Gemini 3 Flash Preview or GPT-5.4 Nano: which to pick

Which one for your work

Coding

Intelligence

Agentic work

Reasoning

Math

Knowledge

Web design

Long documents

Everyday cost

Cost per solved task

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next