Enter opens the highlighted result. Esc closes.

Gemini 2.5 Pro vs GPT-5.4 Mini

GPT-5.4 Mini leads Gemini 2.5 Pro on coding, 35.8 to 19.1 on the Vibe Coding Index, and GPT-5.4 Mini costs 2.2x less per output token ($4.50 vs $10.00 per million). Updated October 22, 2026; 67 benchmarks have a result for both.

Replace Gemini 2.5 Pro Replace GPT-5.4 Mini
Gemini 2.5 ProGoogle
Coding
19.1
Overall
41.8
Output $/M
$10.00
41
GPT-5.4 MiniOpenAI
Coding
35.8
Overall
44.0
Output $/M
$4.50
26
vs boards won of 67 shared

Gemini 2.5 Pro or GPT-5.4 Mini: which to pick

Pick GPT-5.4 Mini for coding: it scores 35.8 on the Vibe Coding Index against 19.1 for Gemini 2.5 Pro.

Pick Gemini 2.5 Pro for a lower cost per solved task ($0.64 against $0.70) and a larger context window (1.05M against 400K tokens).

Model AGemini 2.5 ProGoogle19.1/1003 independent benchmarks$0.64 per solved taskModel BGPT-5.4 MiniOpenAI35.8/1005 independent benchmarks$0.70 per solved task
Shared results
67
Gemini 2.5 Pro only
23
GPT-5.4 Mini only
22
Like-for-like categories
7 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Gemini 2.5 Pro 19.1 from 3 benchmarks, GPT-5.4 Mini 35.8 from 5 benchmarks.
Widest category
Coding, 18.8 points apart on average over 10 shared benchmarks.
Widest single gap
Vibe Code Bench (Vals AI): Gemini 2.5 Pro 0.4% against GPT-5.4 Mini 48.0%, 47.6 points apart on a 0 to 100 scale.
Output price
Gemini 2.5 Pro $10.00 against GPT-5.4 Mini $4.50 per million output tokens, 2.2x apart.
Context window
Gemini 2.5 Pro takes 1.05M tokens, GPT-5.4 Mini 400K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGemini 2.5 ProBarsGPT-5.4 MiniTies
Coding28
Intelligence02
Agentic work12
Reasoning56
Math23
Knowledge61
General254
All shared boards4126
CodingLike-for-likeSix of these boards feed the Vibe Coding Index28
Coding benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
SWE-bench Verified53.6%Not measuredOnly Gemini 2.5 Pro measured
LMArena WebDev12261397GPT-5.4 Mini
AA Coding Index33.356.1GPT-5.4 Mini
LiveCodeBench (Vals AI)Not measured81.5%Only GPT-5.4 Mini measured
SWE-bench Verified (Vals AI)54.4%73.0%GPT-5.4 Mini
Terminal-Bench 4 (Vals AI)Not measured2.5%Only GPT-5.4 Mini measured
Vibe Code Bench (Vals AI)0.4%48.0%GPT-5.4 Mini
Code migration (Vals AI)Not measured12.9%Only GPT-5.4 Mini measured
ProgramBench (Vals AI)Not measured0.0%Only GPT-5.4 Mini measured
Terminal-Bench 2.1 (Vals AI)Not measured54.7%Only GPT-5.4 Mini measured
LiveCodeBench (Artificial Analysis run)80.1%Not measuredOnly Gemini 2.5 Pro measured
SciCode46.3%52.1%GPT-5.4 Mini
Terminal-Bench Hard (Artificial Analysis run)26.5%52.3%GPT-5.4 Mini
Terminal-Bench32.6%Not measuredOnly Gemini 2.5 Pro measured
FrontierCodeNot measured27.0%Only GPT-5.4 Mini measured
GSO-Bench3.9%Not measuredOnly Gemini 2.5 Pro measured
WeirdML54.0%60.3%GPT-5.4 Mini
ALE-BenchNot measured1188.6Only GPT-5.4 Mini measured
LMArena Text: coding14521438Gemini 2.5 Pro
LMArena Text: software and IT14591436Gemini 2.5 Pro
LMArena WebDev: ReactNot measured1386Only GPT-5.4 Mini measured
LMArena WebDev: HTML12351419GPT-5.4 Mini
LMArena WebDev: from an image1285Not measuredOnly Gemini 2.5 Pro measured
Neither model has a result on the other 16 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02
Intelligence benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
AA Intelligence Index16.124.1GPT-5.4 Mini
Epoch Capabilities Index145.1148.7GPT-5.4 Mini
Agentic workLike-for-likePublic boards, shown as published, kept out of the index12
Agentic work benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
AA Agentic Index1.617.9GPT-5.4 Mini
Finance Agent (Vals AI)Not measured45.4%Only GPT-5.4 Mini measured
Tax Agent Bench (Vals AI)Not measured8.8%Only GPT-5.4 Mini measured
Legal Research Bench (Vals AI)Not measured12.5%Only GPT-5.4 Mini measured
Excel Modeling Benchmark (Vals AI)Not measured45.4%Only GPT-5.4 Mini measured
τ²-Bench Telecom54.1%83.3%GPT-5.4 Mini
GDPval23.3%Not measuredOnly Gemini 2.5 Pro measured
DeepResearch Bench41.5%36.3%Gemini 2.5 Pro
Vending-Bench 2$574Not measuredOnly Gemini 2.5 Pro measured
BrowseComp-Plus29.5%Not measuredOnly Gemini 2.5 Pro measured
Neither model has a result on the other 31 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index56
Reasoning benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
GPQA DiamondNot measured83.1%Only GPT-5.4 Mini measured
MMMU Pro (Vals AI)Not measured79.3%Only GPT-5.4 Mini measured
GPQA Diamond (Artificial Analysis run)84.4%87.5%GPT-5.4 Mini
Humanity's Last Exam (Artificial Analysis run)22.5%28.1%GPT-5.4 Mini
GPQA Diamond (Epoch AI run)85.3%86.9%GPT-5.4 Mini
ARC-AGI41.0%63.7%GPT-5.4 Mini
ARC-AGI-24.9%18.9%GPT-5.4 Mini
Chess puzzlesNot measured23.0%Only GPT-5.4 Mini measured
Mystery game puzzlesNot measured11.0%Only GPT-5.4 Mini measured
LMArena Text: hard prompts14551424Gemini 2.5 Pro
LMArena Text: expert14521435Gemini 2.5 Pro
LMArena Text: hard prompts in English14531420Gemini 2.5 Pro
LMArena Vision: diagrams12741266Gemini 2.5 Pro
LMArena Vision: homework12811285GPT-5.4 Mini
Kagi LLM Benchmark70.3%37.9%Gemini 2.5 Pro
Neither model has a result on the other 7 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index23
Math benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
AIMENot measured95.6%Only GPT-5.4 Mini measured
AA Math Index87.7Not measuredOnly Gemini 2.5 Pro measured
AIME 2025 (Artificial Analysis run)87.7%Not measuredOnly Gemini 2.5 Pro measured
OTIS Mock AIME84.7%88.9%GPT-5.4 Mini
FrontierMath, tiers 1 to 324.6%51.2%GPT-5.4 Mini
FrontierMath, tier 40.0%9.8%GPT-5.4 Mini
ProofBenchNot measured21.0%Only GPT-5.4 Mini measured
LMArena Text: math14501418Gemini 2.5 Pro
LMArena Text: mathematical work14541429Gemini 2.5 Pro
Neither model has a result on the other 4 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index61
Knowledge benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
MMLU ProNot measured84.5%Only GPT-5.4 Mini measured
CaseLaw (Vals AI)63.9%51.7%Gemini 2.5 Pro
CorpFin (Vals AI)60.8%60.9%GPT-5.4 Mini
TaxEval (Vals AI)Not measured71.2%Only GPT-5.4 Mini measured
MortgageTax (Vals AI)68.9%63.5%Gemini 2.5 Pro
MedCode (Vals AI)50.6%Not measuredOnly Gemini 2.5 Pro measured
MMLU Pro (Artificial Analysis run)86.2%Not measuredOnly Gemini 2.5 Pro measured
SimpleQA VerifiedNot measured29.4%Only GPT-5.4 Mini measured
LMArena Text: science14801417Gemini 2.5 Pro
LMArena Text: medicine and healthcare14761395Gemini 2.5 Pro
LMArena Text: legal and government14801414Gemini 2.5 Pro
LMArena Text: business and finance14391418Gemini 2.5 Pro
FACTS Benchmark Suite61.5%Not measuredOnly Gemini 2.5 Pro measured
Neither model has a result on the other 5 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index6 boards, none shared
Web design benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
Design Arena: websites1167Not measuredOnly Gemini 2.5 Pro measured
Design Arena: UI components1137Not measuredOnly Gemini 2.5 Pro measured
Design Arena: game dev1111Not measuredOnly Gemini 2.5 Pro measured
Design Arena: data viz1222Not measuredOnly Gemini 2.5 Pro measured
Design Arena: 3D1080Not measuredOnly Gemini 2.5 Pro measured
Design Arena: all code categories1152Not measuredOnly Gemini 2.5 Pro measured
Neither model has a result on the other 3 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index254
General benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
SAGE (Vals AI)41.9%50.8%GPT-5.4 Mini
MedScribe (Vals AI)73.5%Not measuredOnly Gemini 2.5 Pro measured
Vals Multimodal IndexNot measured54.2%Only GPT-5.4 Mini measured
IFBench48.7%73.3%GPT-5.4 Mini
Long context reasoning (AA-LCR)69.0%77.0%GPT-5.4 Mini
DTBench82.4%80.0%Gemini 2.5 Pro
LMCA34.8%40.8%GPT-5.4 Mini
Creative writing (Lech Mazur)83.8%Not measuredOnly Gemini 2.5 Pro measured
LMArena Text14581412Gemini 2.5 Pro
LMArena Text: instruction following14371405Gemini 2.5 Pro
LMArena Text: creative writing14541370Gemini 2.5 Pro
LMArena Vision12631245Gemini 2.5 Pro
LMArena Text: English14581412Gemini 2.5 Pro
LMArena Text: non-English14521405Gemini 2.5 Pro
LMArena Text: Chinese15071446Gemini 2.5 Pro
LMArena Text: German14871408Gemini 2.5 Pro
LMArena Text: Japanese14611375Gemini 2.5 Pro
LMArena Text: Korean14341370Gemini 2.5 Pro
LMArena Text: French14731441Gemini 2.5 Pro
LMArena Text: Spanish14741405Gemini 2.5 Pro
LMArena Text: Russian14611417Gemini 2.5 Pro
LMArena Text: Polish14791415Gemini 2.5 Pro
LMArena Text: multi-turn14531429Gemini 2.5 Pro
LMArena Text: longer queries14491408Gemini 2.5 Pro
LMArena Text: writing and language14541393Gemini 2.5 Pro
LMArena Text: entertainment and media14411373Gemini 2.5 Pro
LMArena Vision: English12611244Gemini 2.5 Pro
LMArena Vision: Chinese13001286Gemini 2.5 Pro
LMArena Vision: reading text12701253Gemini 2.5 Pro
LMArena Vision: humor12621235Gemini 2.5 Pro
LMArena Vision: captioning1304Not measuredOnly Gemini 2.5 Pro measured
LMArena Vision: recognizing things12831218Gemini 2.5 Pro
LMArena Vision: creative writing12651222Gemini 2.5 Pro
LMArena Document1421Not measuredOnly Gemini 2.5 Pro measured
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Gemini 2.5 Pro and GPT-5.4 Mini
BenchmarkGemini 2.5 ProGPT-5.4 MiniLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 2.5 Pro$0.0063Fits in one request
GPT-5.4 Mini$0.0030Fits in one request

GPT-5.4 Mini costs less

Repository review

50K input + 3K output tokens

Gemini 2.5 Pro$0.092Fits in one request
GPT-5.4 Mini$0.051Fits in one request

GPT-5.4 Mini costs less

Agent loop

200K input + 10K output tokens

Gemini 2.5 Pro$0.350Fits in one request
GPT-5.4 Mini$0.195Fits in one request

GPT-5.4 Mini costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 2.5 Pro and GPT-5.4 Mini
SpecificationGoogle Gemini 2.5 ProOpenAI GPT-5.4 Mini
MakerGoogleOpenAI
WeightsNo public weights listedNo public weights listed
ReleasedJune 17, 2025March 17, 2026
Context window1.05M400K
Input $/Mtok$1.25$0.75
Output $/Mtok$10.00$4.50
Coding index19.135.8
Independent measurements behind it35
Cost per solved task$0.64$0.70
SourceOpenRouter listingOpenRouter listing

Questions

Is Gemini 2.5 Pro better than GPT-5.4 Mini for coding?

Pick GPT-5.4 Mini for coding: it scores 35.8 on the Vibe Coding Index against 19.1 for Gemini 2.5 Pro. Pick Gemini 2.5 Pro for a lower cost per solved task ($0.64 against $0.70) and a larger context window (1.05M against 400K tokens).

Which is cheaper, Gemini 2.5 Pro or GPT-5.4 Mini?

Gemini 2.5 Pro costs $1.25 per million input tokens and $10.00 per million output tokens; GPT-5.4 Mini costs $0.75 and $4.50. Per solved SWE-bench Verified task, Gemini 2.5 Pro costs $0.64 and GPT-5.4 Mini $0.70.

Which has the bigger context window, Gemini 2.5 Pro or GPT-5.4 Mini?

Gemini 2.5 Pro, with 1.05M tokens against 400K.

How many benchmarks is the Gemini 2.5 Pro vs GPT-5.4 Mini comparison based on?

67 benchmarks have a result for both models as of October 22, 2026. Gemini 2.5 Pro's coding index rests on 3 independent benchmarks and GPT-5.4 Mini's on 5. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/gemini-2-5-pro-vs-gpt-5-4-mini" title="Gemini 2.5 Pro vs GPT-5.4 Mini, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/gemini-2-5-pro-vs-gpt-5-4-mini">LLMBenchmark.ai, Gemini 2.5 Pro vs GPT-5.4 Mini</a></p>