LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Gemini 3 Flash Preview vs GPT-5.1

Updated October 21, 2026. 49 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Gemini 3 Flash PreviewGoogle
Coding
75.8
Overall
26.3
Output $/M
$3.00
35
GPT-5.1OpenAI
Coding
53.3
Overall
24.7
Output $/M
$10.00
14
vs boards won of 49 shared

Decision reading

Pick Gemini 3 Flash Preview for coding: it scores 75.8 on the Vibe Coding Index against 53.3 for GPT-5.1, though on 1 benchmark against 2.

Pick GPT-5.1 when what matters is LiveCodeBench (Vals AI) or Vibe Code Bench (Vals AI), where it leads.

Shared results
49
Gemini 3 Flash Preview only
20
GPT-5.1 only
51
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Gemini 3 Flash Preview 75.8 from 1 benchmark, GPT-5.1 53.3 from 2 benchmarks.
Widest category
Agentic work, 7.3 points apart on average over 3 shared benchmarks.
Widest single gap
SimpleQA Verified: Gemini 3 Flash Preview 66.8% against GPT-5.1 48.0%, 18.8 points apart on a 0 to 100 scale.
Output price
Gemini 3 Flash Preview $3.00 against GPT-5.1 $10.00 per million output tokens, 3.3x apart.
Context window
Gemini 3 Flash Preview takes 1.05M tokens, GPT-5.1 400K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGemini 3 Flash PreviewBarsGPT-5.1Ties
Coding54
Intelligence10
Agentic work21
Reasoning101
Math50
Knowledge73
Web design31
General24
All shared boards3514
CodingLike-for-likeFour of these boards feed the Vibe Coding Index54
Coding benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
SWE-bench Verified75.8%66.0%Gemini 3 Flash Preview
LMArena WebDevNot measured1396Only GPT-5.1 measured
AA Coding IndexNot measured49.4Only GPT-5.1 measured
LiveCodeBench (Vals AI)85.6%86.5%GPT-5.1
SWE-bench Verified (Vals AI)75.0%69.8%Gemini 3 Flash Preview
Vibe Code Bench (Vals AI)20.2%24.6%GPT-5.1
Code migration (Vals AI)6.4%Not measuredOnly Gemini 3 Flash Preview measured
ProgramBench (Vals AI)0.0%Not measuredOnly Gemini 3 Flash Preview measured
Terminal-Bench 2.1 (Vals AI)53.9%Not measuredOnly Gemini 3 Flash Preview measured
LiveCodeBench (Artificial Analysis run)90.8%86.8%Gemini 3 Flash Preview
Terminal-Bench Hard (Artificial Analysis run)38.6%45.5%GPT-5.1
Terminal-Bench64.3%47.6%Gemini 3 Flash Preview
GSO-Bench9.8%13.7%GPT-5.1
WeirdML61.6%60.8%Gemini 3 Flash Preview
ALE-Bench1367.2Not measuredOnly Gemini 3 Flash Preview measured
LMArena Text: codingNot measured1453Only GPT-5.1 measured
LMArena Text: software and ITNot measured1454Only GPT-5.1 measured
LMArena WebDev: ReactNot measured1307Only GPT-5.1 measured
LMArena WebDev: HTMLNot measured1405Only GPT-5.1 measured
LMArena WebDev: from an imageNot measured1421Only GPT-5.1 measured
Neither model has a result on the other 18 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
AA Intelligence Index26.324.7Gemini 3 Flash Preview
Epoch Capabilities IndexNot measured149.8Only GPT-5.1 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index21
Agentic work benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
Design Arena: agents building web apps1111Not measuredOnly Gemini 3 Flash Preview measured
Design Arena: agents building full-stack apps1063Not measuredOnly Gemini 3 Flash Preview measured
Design Arena: agents building mobile apps1090Not measuredOnly Gemini 3 Flash Preview measured
Design Arena: agents building Android apps1056Not measuredOnly Gemini 3 Flash Preview measured
Design Arena: agents building Godot games1161Not measuredOnly Gemini 3 Flash Preview measured
Design Arena: PowerPoint slides1036Not measuredOnly Gemini 3 Flash Preview measured
Finance Agent (Vals AI)42.5%Not measuredOnly Gemini 3 Flash Preview measured
Tax Agent Bench (Vals AI)11.8%Not measuredOnly Gemini 3 Flash Preview measured
Legal Research Bench (Vals AI)18.3%Not measuredOnly Gemini 3 Flash Preview measured
Excel Modeling Benchmark (Vals AI)26.0%Not measuredOnly Gemini 3 Flash Preview measured
τ²-Bench Telecom80.4%81.9%GPT-5.1
BALROG48.1%Not measuredOnly Gemini 3 Flash Preview measured
DeepResearch Bench49.8%42.8%Gemini 3 Flash Preview
Vending-Bench 2$3,635$1,473Gemini 3 Flash Preview
Neither model has a result on the other 25 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index101
Reasoning benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
GPQA Diamond87.9%86.6%Gemini 3 Flash Preview
MMMU Pro (Vals AI)87.6%83.2%Gemini 3 Flash Preview
GPQA Diamond (Artificial Analysis run)89.8%87.3%Gemini 3 Flash Preview
Humanity's Last Exam (Artificial Analysis run)36.6%28.5%Gemini 3 Flash Preview
GPQA Diamond (Epoch AI run)89.4%87.6%Gemini 3 Flash Preview
ARC-AGI84.7%72.8%Gemini 3 Flash Preview
ARC-AGI-233.6%17.6%Gemini 3 Flash Preview
SimpleBench61.1%53.2%Gemini 3 Flash Preview
Chess puzzles39.0%42.0%GPT-5.1
Mystery game puzzles26.0%19.0%Gemini 3 Flash Preview
VPCT72.6%58.7%Gemini 3 Flash Preview
LMArena Text: hard promptsNot measured1457Only GPT-5.1 measured
LMArena Text: expertNot measured1470Only GPT-5.1 measured
LMArena Text: hard prompts in EnglishNot measured1462Only GPT-5.1 measured
LMArena Vision: diagramsNot measured1264Only GPT-5.1 measured
LMArena Vision: homeworkNot measured1272Only GPT-5.1 measured
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index50
Math benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
AIME95.6%93.3%Gemini 3 Flash Preview
MGSM (Vals AI)93.3%93.0%Gemini 3 Flash Preview
AA Math Index97.094.0Gemini 3 Flash Preview
AIME 2025 (Artificial Analysis run)97.0%94.0%Gemini 3 Flash Preview
OTIS Mock AIME95.6%88.6%Gemini 3 Flash Preview
FrontierMath, tiers 1 to 351.2%Not measuredOnly Gemini 3 Flash Preview measured
FrontierMath, tier 417.1%Not measuredOnly Gemini 3 Flash Preview measured
ProofBench15.0%Not measuredOnly Gemini 3 Flash Preview measured
LMArena Text: mathNot measured1446Only GPT-5.1 measured
LMArena Text: mathematical workNot measured1449Only GPT-5.1 measured
Neither model has a result on the other 3 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index73
Knowledge benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
MMLU Pro88.6%86.4%Gemini 3 Flash Preview
LegalBench (Vals AI)86.9%85.7%Gemini 3 Flash Preview
CaseLaw (Vals AI)55.8%73.4%GPT-5.1
CorpFin (Vals AI)66.4%63.8%Gemini 3 Flash Preview
TaxEval (Vals AI)73.9%74.9%GPT-5.1
MortgageTax (Vals AI)68.7%61.4%Gemini 3 Flash Preview
MedQA (Vals AI)95.8%96.4%GPT-5.1
MedCode (Vals AI)55.9%52.7%Gemini 3 Flash Preview
MMLU Pro (Artificial Analysis run)89.0%87.0%Gemini 3 Flash Preview
SimpleQA Verified66.8%48.0%Gemini 3 Flash Preview
GeoBench88.0%Not measuredOnly Gemini 3 Flash Preview measured
LMArena Text: scienceNot measured1459Only GPT-5.1 measured
LMArena Text: medicine and healthcareNot measured1456Only GPT-5.1 measured
LMArena Text: legal and governmentNot measured1459Only GPT-5.1 measured
LMArena Text: business and financeNot measured1431Only GPT-5.1 measured
Neither model has a result on the other 2 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index31
Web design benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
Design Arena: websites11961187Gemini 3 Flash Preview
Design Arena: UI componentsNot measured1166Only GPT-5.1 measured
Design Arena: game dev11661179GPT-5.1
Design Arena: data vizNot measured1204Only GPT-5.1 measured
Design Arena: 3D11841061Gemini 3 Flash Preview
Design Arena: all code categories11891171Gemini 3 Flash Preview
Design Arena: SVGNot measured1149Only GPT-5.1 measured
Design Arena: ASCII artNot measured1118Only GPT-5.1 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index24
General benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
SAGE (Vals AI)51.8%43.2%Gemini 3 Flash Preview
MedScribe (Vals AI)69.9%88.1%GPT-5.1
Vals Multimodal Index52.2%Not measuredOnly Gemini 3 Flash Preview measured
IFBench78.0%72.9%Gemini 3 Flash Preview
Long context reasoning (AA-LCR)78.0%80.0%GPT-5.1
DTBench89.1%90.1%GPT-5.1
LMCA43.1%43.9%GPT-5.1
CL-benchNot measured23.7%Only GPT-5.1 measured
CL-bench LifeNot measured17.3%Only GPT-5.1 measured
LMArena TextNot measured1443Only GPT-5.1 measured
LMArena Text: instruction followingNot measured1443Only GPT-5.1 measured
LMArena Text: creative writingNot measured1427Only GPT-5.1 measured
LMArena VisionNot measured1250Only GPT-5.1 measured
LMArena Text: EnglishNot measured1451Only GPT-5.1 measured
LMArena Text: non-EnglishNot measured1431Only GPT-5.1 measured
LMArena Text: ChineseNot measured1495Only GPT-5.1 measured
LMArena Text: GermanNot measured1438Only GPT-5.1 measured
LMArena Text: JapaneseNot measured1453Only GPT-5.1 measured
LMArena Text: KoreanNot measured1401Only GPT-5.1 measured
LMArena Text: FrenchNot measured1450Only GPT-5.1 measured
LMArena Text: SpanishNot measured1433Only GPT-5.1 measured
LMArena Text: RussianNot measured1435Only GPT-5.1 measured
LMArena Text: PolishNot measured1440Only GPT-5.1 measured
LMArena Text: multi-turnNot measured1450Only GPT-5.1 measured
LMArena Text: longer queriesNot measured1448Only GPT-5.1 measured
LMArena Text: writing and languageNot measured1428Only GPT-5.1 measured
LMArena Text: entertainment and mediaNot measured1415Only GPT-5.1 measured
LMArena Vision: EnglishNot measured1252Only GPT-5.1 measured
LMArena Vision: ChineseNot measured1270Only GPT-5.1 measured
LMArena Vision: reading textNot measured1255Only GPT-5.1 measured
LMArena Vision: humorNot measured1263Only GPT-5.1 measured
LMArena Vision: captioningNot measured1252Only GPT-5.1 measured
LMArena Vision: recognizing thingsNot measured1232Only GPT-5.1 measured
LMArena Vision: creative writingNot measured1266Only GPT-5.1 measured
LMArena DocumentNot measured1403Only GPT-5.1 measured
Neither model has a result on the other 11 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Gemini 3 Flash Preview and GPT-5.1
BenchmarkGemini 3 Flash PreviewGPT-5.1Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 3 Flash Preview$0.0020Fits in one request
GPT-5.1$0.0063Fits in one request

Gemini 3 Flash Preview costs less

Repository review

50K input + 3K output tokens

Gemini 3 Flash Preview$0.034Fits in one request
GPT-5.1$0.092Fits in one request

Gemini 3 Flash Preview costs less

Agent loop

200K input + 10K output tokens

Gemini 3 Flash Preview$0.130Fits in one request
GPT-5.1$0.350Fits in one request

Gemini 3 Flash Preview costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 3 Flash Preview and GPT-5.1
SpecificationGoogle Gemini 3 Flash PreviewOpenAI GPT-5.1
MakerGoogleOpenAI
WeightsNo public weights listedNo public weights listed
ReleasedDecember 17, 2025November 13, 2025
Context window1.05M400K
Input $/Mtok$0.50$1.25
Output $/Mtok$3.00$10.00
Coding index75.853.3
Independent measurements behind it12
Cost per solved task$0.37$1.02
SourceOpenRouter listingOpenRouter listing

Questions

Is Gemini 3 Flash Preview better than GPT-5.1 for coding?

Pick Gemini 3 Flash Preview for coding: it scores 75.8 on the Vibe Coding Index against 53.3 for GPT-5.1, though on 1 benchmark against 2. Pick GPT-5.1 when what matters is LiveCodeBench (Vals AI) or Vibe Code Bench (Vals AI), where it leads.

Which is cheaper, Gemini 3 Flash Preview or GPT-5.1?

Gemini 3 Flash Preview costs $0.50 per million input tokens and $3.00 per million output tokens; GPT-5.1 costs $1.25 and $10.00. Per solved SWE-bench Verified task, Gemini 3 Flash Preview costs $0.37 and GPT-5.1 $1.02.

Which has the bigger context window, Gemini 3 Flash Preview or GPT-5.1?

Gemini 3 Flash Preview, with 1.05M tokens against 400K.

How many benchmarks is the Gemini 3 Flash Preview vs GPT-5.1 comparison based on?

49 benchmarks have a result for both models as of October 21, 2026. Gemini 3 Flash Preview's coding index rests on 1 independent benchmark and GPT-5.1's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next