LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Gemini 3.5 Flash vs GPT-4.1 Nano

Updated October 21, 2026. 57 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Gemini 3.5 FlashGoogle
Coding
42.8
Overall
33.6
Output $/M
$9.00
57
GPT-4.1 NanoOpenAI
Coding
8.9
Overall
7.8
Output $/M
$0.40
0
vs boards won of 57 shared

Decision reading

Pick Gemini 3.5 Flash for coding: it scores 42.8 on the Vibe Coding Index against 8.9 for GPT-4.1 Nano.

Pick GPT-4.1 Nano when output tokens cost 22.5x less.

Shared results
57
Gemini 3.5 Flash only
53
GPT-4.1 Nano only
12
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Gemini 3.5 Flash 42.8 from 1 benchmark, GPT-4.1 Nano 8.9 from 1 benchmark.
Widest category
Agentic work, 78.4 points apart on average over 1 shared benchmark.
Widest single gap
ARC-AGI: Gemini 3.5 Flash 92.5% against GPT-4.1 Nano 0.0%, 92.5 points apart on a 0 to 100 scale.
Output price
Gemini 3.5 Flash $9.00 against GPT-4.1 Nano $0.40 per million output tokens, 22.5x apart.
Context window
Gemini 3.5 Flash takes 1.05M tokens, GPT-4.1 Nano 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGemini 3.5 FlashBarsGPT-4.1 NanoTies
Coding50
Intelligence20
Agentic work10
Reasoning110
Math30
Knowledge100
Web design60
General190
All shared boards570
CodingLike-for-likeFour of these boards feed the Vibe Coding Index50
Coding benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
Aider polyglotNot measured8.9%Only GPT-4.1 Nano measured
LMArena WebDev1499Not measuredOnly Gemini 3.5 Flash measured
AA Coding IndexNot measured11.1Only GPT-4.1 Nano measured
LiveCodeBench (Vals AI)87.6%42.7%Gemini 3.5 Flash
SWE-bench Verified (Vals AI)78.8%Not measuredOnly Gemini 3.5 Flash measured
Terminal-Bench 4 (Vals AI)6.1%Not measuredOnly Gemini 3.5 Flash measured
Vibe Code Bench (Vals AI)48.7%Not measuredOnly Gemini 3.5 Flash measured
Code migration (Vals AI)26.8%Not measuredOnly Gemini 3.5 Flash measured
ProgramBench (Vals AI)0.0%Not measuredOnly Gemini 3.5 Flash measured
Terminal-Bench 2.1 (Vals AI)74.2%Not measuredOnly Gemini 3.5 Flash measured
SkillsBench (Vals AI)52.7%Not measuredOnly Gemini 3.5 Flash measured
LiveCodeBench (Artificial Analysis run)Not measured32.6%Only GPT-4.1 Nano measured
SciCode53.9%Not measuredOnly Gemini 3.5 Flash measured
Terminal-Bench Hard (Artificial Analysis run)46.2%3.8%Gemini 3.5 Flash
WeirdML62.6%19.0%Gemini 3.5 Flash
ALE-Bench911.0Not measuredOnly Gemini 3.5 Flash measured
LMArena Text: coding14931306Gemini 3.5 Flash
LMArena Text: software and IT14941305Gemini 3.5 Flash
LMArena WebDev: React1495Not measuredOnly Gemini 3.5 Flash measured
LMArena WebDev: HTML1522Not measuredOnly Gemini 3.5 Flash measured
LMArena WebDev: from an image1504Not measuredOnly Gemini 3.5 Flash measured
Neither model has a result on the other 17 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
AA Intelligence Index33.67.8Gemini 3.5 Flash
Epoch Capabilities Index154.9129.5Gemini 3.5 Flash
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
Design Arena: agents building web apps1202Not measuredOnly Gemini 3.5 Flash measured
Design Arena: agents building full-stack apps1197Not measuredOnly Gemini 3.5 Flash measured
Design Arena: agents building mobile apps1175Not measuredOnly Gemini 3.5 Flash measured
Design Arena: agents building Android apps1190Not measuredOnly Gemini 3.5 Flash measured
Design Arena: agents building Godot games1098Not measuredOnly Gemini 3.5 Flash measured
Design Arena: agents building games1180Not measuredOnly Gemini 3.5 Flash measured
Design Arena: HTML slides1142Not measuredOnly Gemini 3.5 Flash measured
Design Arena: PowerPoint slides1178Not measuredOnly Gemini 3.5 Flash measured
Finance Agent (Vals AI)57.9%Not measuredOnly Gemini 3.5 Flash measured
Tax Agent Bench (Vals AI)21.6%Not measuredOnly Gemini 3.5 Flash measured
Legal Research Bench (Vals AI)30.8%Not measuredOnly Gemini 3.5 Flash measured
Excel Modeling Benchmark (Vals AI)63.5%Not measuredOnly Gemini 3.5 Flash measured
Terminal-Bench-Science (Vals AI)5.7%Not measuredOnly Gemini 3.5 Flash measured
τ²-Bench Telecom95.6%17.3%Gemini 3.5 Flash
APEX-Agents27.5%Not measuredOnly Gemini 3.5 Flash measured
Vending-Bench 2$5,396Not measuredOnly Gemini 3.5 Flash measured
Neither model has a result on the other 23 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index110
Reasoning benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
GPQA Diamond92.7%50.8%Gemini 3.5 Flash
MMMU Pro (Vals AI)88.3%55.0%Gemini 3.5 Flash
GPQA Diamond (Artificial Analysis run)92.2%51.2%Gemini 3.5 Flash
Humanity's Last Exam (Artificial Analysis run)42.7%3.8%Gemini 3.5 Flash
GPQA Diamond (Epoch AI run)92.8%48.9%Gemini 3.5 Flash
ARC-AGI92.5%0.0%Gemini 3.5 Flash
ARC-AGI-272.1%0.0%Gemini 3.5 Flash
SimpleBench76.7%Not measuredOnly Gemini 3.5 Flash measured
Chess puzzles45.0%0.0%Gemini 3.5 Flash
Mystery game puzzles32.0%Not measuredOnly Gemini 3.5 Flash measured
EBR-bench4.8%Not measuredOnly Gemini 3.5 Flash measured
LMArena Text: hard prompts14881286Gemini 3.5 Flash
LMArena Text: expert14951271Gemini 3.5 Flash
LMArena Text: hard prompts in English14831293Gemini 3.5 Flash
LMArena Vision: diagrams1323Not measuredOnly Gemini 3.5 Flash measured
LMArena Vision: homework1330Not measuredOnly Gemini 3.5 Flash measured
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
AIMENot measured26.5%Only GPT-4.1 Nano measured
MATH 500 (Vals AI)Not measured80.2%Only GPT-4.1 Nano measured
MGSM (Vals AI)Not measured69.3%Only GPT-4.1 Nano measured
AA Math IndexNot measured24.0Only GPT-4.1 Nano measured
AIME 2025 (Artificial Analysis run)Not measured24.0%Only GPT-4.1 Nano measured
OTIS Mock AIME95.6%28.9%Gemini 3.5 Flash
FrontierMath, tiers 1 to 362.8%Not measuredOnly Gemini 3.5 Flash measured
FrontierMath, tier 426.8%Not measuredOnly Gemini 3.5 Flash measured
ProofBench31.0%Not measuredOnly Gemini 3.5 Flash measured
MATH level 5Not measured70.0%Only GPT-4.1 Nano measured
LMArena Text: math15041274Gemini 3.5 Flash
LMArena Text: mathematical work14951274Gemini 3.5 Flash
Neither model has a result on the other 1 board here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index100
Knowledge benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
MMLU Pro89.5%63.5%Gemini 3.5 Flash
LegalBench (Vals AI)83.6%61.1%Gemini 3.5 Flash
CorpFin (Vals AI)64.7%42.1%Gemini 3.5 Flash
TaxEval (Vals AI)74.4%60.8%Gemini 3.5 Flash
MortgageTax (Vals AI)68.1%52.8%Gemini 3.5 Flash
MedQA (Vals AI)Not measured68.2%Only GPT-4.1 Nano measured
MedCode (Vals AI)55.8%Not measuredOnly Gemini 3.5 Flash measured
MMLU Pro (Artificial Analysis run)Not measured65.7%Only GPT-4.1 Nano measured
SimpleQA Verified66.2%6.0%Gemini 3.5 Flash
LMArena Text: science14951297Gemini 3.5 Flash
LMArena Text: medicine and healthcare14831276Gemini 3.5 Flash
LMArena Text: legal and government14881300Gemini 3.5 Flash
LMArena Text: business and finance14671267Gemini 3.5 Flash
Neither model has a result on the other 4 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index60
Web design benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
Design Arena: websites1268973Gemini 3.5 Flash
Design Arena: UI components1272916Gemini 3.5 Flash
Design Arena: game dev1263971Gemini 3.5 Flash
Design Arena: data viz1236891Gemini 3.5 Flash
Design Arena: 3D1244925Gemini 3.5 Flash
Design Arena: all code categories1266963Gemini 3.5 Flash
Design Arena: SVG1254Not measuredOnly Gemini 3.5 Flash measured
Design Arena: ASCII art1253Not measuredOnly Gemini 3.5 Flash measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index190
General benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
Public Benefits Bench (Vals AI)59.5%Not measuredOnly Gemini 3.5 Flash measured
SAGE (Vals AI)49.9%Not measuredOnly Gemini 3.5 Flash measured
MedScribe (Vals AI)76.6%Not measuredOnly Gemini 3.5 Flash measured
Vals Multimodal Index62.9%Not measuredOnly Gemini 3.5 Flash measured
IFBench76.3%32.0%Gemini 3.5 Flash
Long context reasoning (AA-LCR)74.3%20.3%Gemini 3.5 Flash
DTBench94.7%52.5%Gemini 3.5 Flash
LMCA47.1%5.5%Gemini 3.5 Flash
Fiction.LiveBenchNot measured25.0%Only GPT-4.1 Nano measured
Surface Evolver Bench58.1%Not measuredOnly Gemini 3.5 Flash measured
LMArena Text14821285Gemini 3.5 Flash
LMArena Text: instruction following14671266Gemini 3.5 Flash
LMArena Text: creative writing14701260Gemini 3.5 Flash
LMArena Vision13081063Gemini 3.5 Flash
LMArena Text: English14811303Gemini 3.5 Flash
LMArena Text: non-English14751260Gemini 3.5 Flash
LMArena Text: Chinese15271270Gemini 3.5 Flash
LMArena Text: German14941288Gemini 3.5 Flash
LMArena Text: Japanese14861198Gemini 3.5 Flash
LMArena Text: Korean1448Not measuredOnly Gemini 3.5 Flash measured
LMArena Text: French1490Not measuredOnly Gemini 3.5 Flash measured
LMArena Text: Spanish1480Not measuredOnly Gemini 3.5 Flash measured
LMArena Text: Russian14931261Gemini 3.5 Flash
LMArena Text: Polish1516Not measuredOnly Gemini 3.5 Flash measured
LMArena Text: multi-turn14811277Gemini 3.5 Flash
LMArena Text: longer queries14831283Gemini 3.5 Flash
LMArena Text: writing and language14781261Gemini 3.5 Flash
LMArena Text: entertainment and media14591243Gemini 3.5 Flash
LMArena Vision: English13051101Gemini 3.5 Flash
LMArena Vision: Chinese1377Not measuredOnly Gemini 3.5 Flash measured
LMArena Vision: reading text1317Not measuredOnly Gemini 3.5 Flash measured
LMArena Vision: humor1321Not measuredOnly Gemini 3.5 Flash measured
LMArena Vision: creative writing1301Not measuredOnly Gemini 3.5 Flash measured
LMArena Document1463Not measuredOnly Gemini 3.5 Flash measured
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Gemini 3.5 Flash and GPT-4.1 Nano
BenchmarkGemini 3.5 FlashGPT-4.1 NanoLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 3.5 Flash$0.0060Fits in one request
GPT-4.1 Nano$0.0003Fits in one request

GPT-4.1 Nano costs less

Repository review

50K input + 3K output tokens

Gemini 3.5 Flash$0.102Fits in one request
GPT-4.1 Nano$0.0062Fits in one request

GPT-4.1 Nano costs less

Agent loop

200K input + 10K output tokens

Gemini 3.5 Flash$0.390Fits in one request
GPT-4.1 Nano$0.024Fits in one request

GPT-4.1 Nano costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 3.5 Flash and GPT-4.1 Nano
SpecificationGoogle Gemini 3.5 FlashOpenAI GPT-4.1 Nano
MakerGoogleOpenAI
WeightsNo public weights listedNo public weights listed
ReleasedMay 19, 2026April 14, 2025
Context window1.05M1.05M
Input $/Mtok$1.50$0.10
Output $/Mtok$9.00$0.40
Coding index42.88.9
Independent measurements behind it11
Cost per solved task$1.21Not computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Gemini 3.5 Flash better than GPT-4.1 Nano for coding?

Pick Gemini 3.5 Flash for coding: it scores 42.8 on the Vibe Coding Index against 8.9 for GPT-4.1 Nano. Pick GPT-4.1 Nano when output tokens cost 22.5x less.

Which is cheaper, Gemini 3.5 Flash or GPT-4.1 Nano?

Gemini 3.5 Flash costs $1.50 per million input tokens and $9.00 per million output tokens; GPT-4.1 Nano costs $0.10 and $0.40. Cost per solved task is known for Gemini 3.5 Flash only.

Which has the bigger context window, Gemini 3.5 Flash or GPT-4.1 Nano?

Gemini 3.5 Flash, with 1.05M tokens against 1.05M.

How many benchmarks is the Gemini 3.5 Flash vs GPT-4.1 Nano comparison based on?

57 benchmarks have a result for both models as of October 21, 2026. Gemini 3.5 Flash's coding index rests on 1 independent benchmark and GPT-4.1 Nano's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next