LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Gemini 2.5 Flash vs Gemini 3.1 Pro Preview

Updated October 21, 2026. 63 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Gemini 2.5 FlashGoogle
Coding
28.7
Overall
15.5
Output $/M
$2.50
1
Gemini 3.1 Pro PreviewGoogle
Coding
35.3
Overall
29.7
Output $/M
$12.00
62
vs boards won of 63 shared

Decision reading

Pick Gemini 3.1 Pro Preview for coding: it scores 35.3 on the Vibe Coding Index against 28.7 for Gemini 2.5 Flash.

Pick Gemini 2.5 Flash when output tokens cost 4.8x less, or when a solved task costs $0.466 against $0.99.

Shared results
63
Gemini 2.5 Flash only
6
Gemini 3.1 Pro Preview only
68
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Gemini 2.5 Flash 28.7 from 1 benchmark, Gemini 3.1 Pro Preview 35.3 from 1 benchmark.
Widest category
Coding, 30.9 points apart on average over 4 shared benchmarks.
Widest single gap
ARC-AGI-2: Gemini 2.5 Flash 2.5% against Gemini 3.1 Pro Preview 77.1%, 74.6 points apart on a 0 to 100 scale.
Output price
Gemini 2.5 Flash $2.50 against Gemini 3.1 Pro Preview $12.00 per million output tokens, 4.8x apart.
Context window
Both take 1.05M tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGemini 2.5 FlashBarsGemini 3.1 Pro PreviewTies
Coding04
Intelligence01
Agentic work03
Reasoning010
Math02
Knowledge05
Web design07
General130
All shared boards162
CodingLike-for-likeFour of these boards feed the Vibe Coding Index04
Coding benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
SWE-bench Verified28.7%Not measuredOnly Gemini 2.5 Flash measured
LMArena WebDevNot measured1447Only Gemini 3.1 Pro Preview measured
AA Coding IndexNot measured68.8Only Gemini 3.1 Pro Preview measured
LiveCodeBench (Vals AI)Not measured88.5%Only Gemini 3.1 Pro Preview measured
SWE-bench Verified (Vals AI)Not measured78.8%Only Gemini 3.1 Pro Preview measured
Terminal-Bench 4 (Vals AI)Not measured2.5%Only Gemini 3.1 Pro Preview measured
Vibe Code Bench (Vals AI)Not measured32.0%Only Gemini 3.1 Pro Preview measured
Code migration (Vals AI)Not measured17.3%Only Gemini 3.1 Pro Preview measured
ProgramBench (Vals AI)Not measured0.0%Only Gemini 3.1 Pro Preview measured
IOI (Vals AI)Not measured51.8%Only Gemini 3.1 Pro Preview measured
Terminal-Bench 2.1 (Vals AI)Not measured70.8%Only Gemini 3.1 Pro Preview measured
Vibe Code Bench 1-100 (Vals AI)Not measured6.7%Only Gemini 3.1 Pro Preview measured
LiveCodeBench (Artificial Analysis run)69.5%Not measuredOnly Gemini 2.5 Flash measured
SciCodeNot measured58.7%Only Gemini 3.1 Pro Preview measured
Terminal-Bench Hard (Artificial Analysis run)13.6%53.8%Gemini 3.1 Pro Preview
Terminal-Bench17.1%80.2%Gemini 3.1 Pro Preview
GSO-BenchNot measured22.6%Only Gemini 3.1 Pro Preview measured
WeirdMLNot measured72.1%Only Gemini 3.1 Pro Preview measured
MirrorCodeNot measured8.9%Only Gemini 3.1 Pro Preview measured
ALE-BenchNot measured1160.6Only Gemini 3.1 Pro Preview measured
LMArena Text: coding14231484Gemini 3.1 Pro Preview
LMArena Text: software and IT14251487Gemini 3.1 Pro Preview
LMArena WebDev: ReactNot measured1438Only Gemini 3.1 Pro Preview measured
LMArena WebDev: HTMLNot measured1490Only Gemini 3.1 Pro Preview measured
LMArena WebDev: from an imageNot measured1481Only Gemini 3.1 Pro Preview measured
Neither model has a result on the other 13 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
AA Intelligence Index15.529.7Gemini 3.1 Pro Preview
Epoch Capabilities Index142.9Not measuredOnly Gemini 2.5 Flash measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index03
Agentic work benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
AA Agentic IndexNot measured8.2Only Gemini 3.1 Pro Preview measured
Design Arena: agents building web appsNot measured1125Only Gemini 3.1 Pro Preview measured
Design Arena: agents building full-stack appsNot measured1068Only Gemini 3.1 Pro Preview measured
Design Arena: agents building mobile appsNot measured1094Only Gemini 3.1 Pro Preview measured
Design Arena: agents building Android appsNot measured1055Only Gemini 3.1 Pro Preview measured
Design Arena: agents building Godot gamesNot measured1236Only Gemini 3.1 Pro Preview measured
Design Arena: agents building gamesNot measured1114Only Gemini 3.1 Pro Preview measured
Design Arena: HTML slidesNot measured1153Only Gemini 3.1 Pro Preview measured
Design Arena: PowerPoint slidesNot measured1064Only Gemini 3.1 Pro Preview measured
SREBench (Vals AI)Not measured0.0%Only Gemini 3.1 Pro Preview measured
Finance Agent (Vals AI)Not measured43.0%Only Gemini 3.1 Pro Preview measured
Tax Agent Bench (Vals AI)Not measured9.3%Only Gemini 3.1 Pro Preview measured
Legal Research Bench (Vals AI)Not measured20.7%Only Gemini 3.1 Pro Preview measured
Excel Modeling Benchmark (Vals AI)Not measured52.6%Only Gemini 3.1 Pro Preview measured
BioMysteryBench (Vals AI)Not measured60.0%Only Gemini 3.1 Pro Preview measured
Terminal-Bench-Science (Vals AI)Not measured1.4%Only Gemini 3.1 Pro Preview measured
Vals Science IndexNot measured27.4%Only Gemini 3.1 Pro Preview measured
τ²-Bench Telecom31.6%95.6%Gemini 3.1 Pro Preview
APEX-AgentsNot measured35.1%Only Gemini 3.1 Pro Preview measured
METR time horizonsNot measured77.0%Only Gemini 3.1 Pro Preview measured
BALROG33.5%57.0%Gemini 3.1 Pro Preview
DeepResearch BenchNot measured47.8%Only Gemini 3.1 Pro Preview measured
PostTrainBenchNot measured22.0%Only Gemini 3.1 Pro Preview measured
Vending-Bench 2$549$911Gemini 3.1 Pro Preview
Neither model has a result on the other 15 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index010
Reasoning benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
GPQA DiamondNot measured95.5%Only Gemini 3.1 Pro Preview measured
MysteryMechanism (Vals AI)Not measured20.7%Only Gemini 3.1 Pro Preview measured
MMMU Pro (Vals AI)Not measured88.2%Only Gemini 3.1 Pro Preview measured
GPQA Diamond (Artificial Analysis run)79.0%94.1%Gemini 3.1 Pro Preview
Humanity's Last Exam (Artificial Analysis run)12.1%47.0%Gemini 3.1 Pro Preview
GPQA Diamond (Epoch AI run)Not measured94.4%Only Gemini 3.1 Pro Preview measured
ARC-AGI33.3%98.0%Gemini 3.1 Pro Preview
ARC-AGI-22.5%77.1%Gemini 3.1 Pro Preview
SimpleBench41.2%79.6%Gemini 3.1 Pro Preview
Chess puzzlesNot measured51.0%Only Gemini 3.1 Pro Preview measured
Mystery game puzzlesNot measured34.0%Only Gemini 3.1 Pro Preview measured
EBR-benchNot measured14.3%Only Gemini 3.1 Pro Preview measured
LMArena Text: hard prompts14221485Gemini 3.1 Pro Preview
LMArena Text: expert14261483Gemini 3.1 Pro Preview
LMArena Text: hard prompts in English14201480Gemini 3.1 Pro Preview
LMArena Vision: diagrams12451311Gemini 3.1 Pro Preview
LMArena Vision: homework12441316Gemini 3.1 Pro Preview
Neither model has a result on the other 4 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
AIMENot measured98.1%Only Gemini 3.1 Pro Preview measured
AA Math Index73.3Not measuredOnly Gemini 2.5 Flash measured
AIME 2025 (Artificial Analysis run)73.3%Not measuredOnly Gemini 2.5 Flash measured
OTIS Mock AIMENot measured95.6%Only Gemini 3.1 Pro Preview measured
FrontierMath, tiers 1 to 3Not measured59.6%Only Gemini 3.1 Pro Preview measured
FrontierMath, tier 4Not measured26.8%Only Gemini 3.1 Pro Preview measured
ProofBenchNot measured26.0%Only Gemini 3.1 Pro Preview measured
LMArena Text: math14111486Gemini 3.1 Pro Preview
LMArena Text: mathematical work14221478Gemini 3.1 Pro Preview
Neither model has a result on the other 4 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index05
Knowledge benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
MMLU ProNot measured91.0%Only Gemini 3.1 Pro Preview measured
LegalBench (Vals AI)Not measured87.4%Only Gemini 3.1 Pro Preview measured
CaseLaw (Vals AI)Not measured64.8%Only Gemini 3.1 Pro Preview measured
CorpFin (Vals AI)Not measured64.5%Only Gemini 3.1 Pro Preview measured
TaxEval (Vals AI)Not measured72.9%Only Gemini 3.1 Pro Preview measured
MortgageTax (Vals AI)Not measured69.4%Only Gemini 3.1 Pro Preview measured
MedQA (Vals AI)Not measured96.4%Only Gemini 3.1 Pro Preview measured
MedCode (Vals AI)40.4%59.1%Gemini 3.1 Pro Preview
MMLU Pro (Artificial Analysis run)83.2%Not measuredOnly Gemini 2.5 Flash measured
SimpleQA VerifiedNot measured73.5%Only Gemini 3.1 Pro Preview measured
LMArena Text: science14331497Gemini 3.1 Pro Preview
LMArena Text: medicine and healthcare14281486Gemini 3.1 Pro Preview
LMArena Text: legal and government14301487Gemini 3.1 Pro Preview
LMArena Text: business and finance14041459Gemini 3.1 Pro Preview
Neither model has a result on the other 3 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index07
Web design benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
Design Arena: websites10741234Gemini 3.1 Pro Preview
Design Arena: UI components10051226Gemini 3.1 Pro Preview
Design Arena: game dev10051203Gemini 3.1 Pro Preview
Design Arena: data viz10601209Gemini 3.1 Pro Preview
Design Arena: 3D10211234Gemini 3.1 Pro Preview
Design Arena: all code categories10591231Gemini 3.1 Pro Preview
Design Arena: SVG10181285Gemini 3.1 Pro Preview
Design Arena: ASCII artNot measured1270Only Gemini 3.1 Pro Preview measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index130
General benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
Public Benefits Bench (Vals AI)Not measured53.8%Only Gemini 3.1 Pro Preview measured
SAGE (Vals AI)44.8%48.7%Gemini 3.1 Pro Preview
MedScribe (Vals AI)83.0%76.1%Gemini 2.5 Flash
Vals Multimodal IndexNot measured56.1%Only Gemini 3.1 Pro Preview measured
IFBench50.3%77.1%Gemini 3.1 Pro Preview
Long context reasoning (AA-LCR)65.3%82.0%Gemini 3.1 Pro Preview
DTBench76.5%97.1%Gemini 3.1 Pro Preview
LMCA27.5%53.8%Gemini 3.1 Pro Preview
CL-benchNot measured20.8%Only Gemini 3.1 Pro Preview measured
Furniture assemblyNot measured26.7%Only Gemini 3.1 Pro Preview measured
ExploitBenchNot measured26.1%Only Gemini 3.1 Pro Preview measured
CL-bench LifeNot measured16.9%Only Gemini 3.1 Pro Preview measured
LMArena Text14171480Gemini 3.1 Pro Preview
LMArena Text: instruction following14051466Gemini 3.1 Pro Preview
LMArena Text: creative writing14001482Gemini 3.1 Pro Preview
LMArena Vision12351296Gemini 3.1 Pro Preview
LMArena Text: English14181478Gemini 3.1 Pro Preview
LMArena Text: non-English14091476Gemini 3.1 Pro Preview
LMArena Text: Chinese14491527Gemini 3.1 Pro Preview
LMArena Text: German14171490Gemini 3.1 Pro Preview
LMArena Text: Japanese13961491Gemini 3.1 Pro Preview
LMArena Text: Korean13851455Gemini 3.1 Pro Preview
LMArena Text: French14321487Gemini 3.1 Pro Preview
LMArena Text: Spanish14221481Gemini 3.1 Pro Preview
LMArena Text: Russian14151497Gemini 3.1 Pro Preview
LMArena Text: Polish14131498Gemini 3.1 Pro Preview
LMArena Text: multi-turn14081487Gemini 3.1 Pro Preview
LMArena Text: longer queries14191482Gemini 3.1 Pro Preview
LMArena Text: writing and language14051481Gemini 3.1 Pro Preview
LMArena Text: entertainment and media13931465Gemini 3.1 Pro Preview
LMArena Vision: English12391287Gemini 3.1 Pro Preview
LMArena Vision: Chinese12841364Gemini 3.1 Pro Preview
LMArena Vision: reading text12371304Gemini 3.1 Pro Preview
LMArena Vision: humor12251322Gemini 3.1 Pro Preview
LMArena Vision: captioning12771345Gemini 3.1 Pro Preview
LMArena Vision: recognizing things12521330Gemini 3.1 Pro Preview
LMArena Vision: creative writing12411324Gemini 3.1 Pro Preview
LMArena DocumentNot measured1444Only Gemini 3.1 Pro Preview measured
Neither model has a result on the other 8 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Gemini 2.5 Flash and Gemini 3.1 Pro Preview
BenchmarkGemini 2.5 FlashGemini 3.1 Pro PreviewLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 2.5 Flash$0.0015Fits in one request
Gemini 3.1 Pro Preview$0.0080Fits in one request

Gemini 2.5 Flash costs less

Repository review

50K input + 3K output tokens

Gemini 2.5 Flash$0.022Fits in one request
Gemini 3.1 Pro Preview$0.136Fits in one request

Gemini 2.5 Flash costs less

Agent loop

200K input + 10K output tokens

Gemini 2.5 Flash$0.085Fits in one request
Gemini 3.1 Pro Preview$0.520Fits in one request

Gemini 2.5 Flash costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 2.5 Flash and Gemini 3.1 Pro Preview
SpecificationGoogle Gemini 2.5 FlashGoogle Gemini 3.1 Pro Preview
MakerGoogleGoogle
WeightsNo public weights listedNo public weights listed
ReleasedJune 17, 2025February 19, 2026
Context window1.05M1.05M
Input $/Mtok$0.30$2.00
Output $/Mtok$2.50$12.00
Coding index28.735.3
Independent measurements behind it11
Cost per solved task$0.466$0.99
SourceOpenRouter listingOpenRouter listing

Questions

Is Gemini 2.5 Flash better than Gemini 3.1 Pro Preview for coding?

Pick Gemini 3.1 Pro Preview for coding: it scores 35.3 on the Vibe Coding Index against 28.7 for Gemini 2.5 Flash. Pick Gemini 2.5 Flash when output tokens cost 4.8x less, or when a solved task costs $0.466 against $0.99.

Which is cheaper, Gemini 2.5 Flash or Gemini 3.1 Pro Preview?

Gemini 2.5 Flash costs $0.30 per million input tokens and $2.50 per million output tokens; Gemini 3.1 Pro Preview costs $2.00 and $12.00. Per solved SWE-bench Verified task, Gemini 2.5 Flash costs $0.466 and Gemini 3.1 Pro Preview $0.99.

Which has the bigger context window, Gemini 2.5 Flash or Gemini 3.1 Pro Preview?

Neither: both take 1.05M tokens.

How many benchmarks is the Gemini 2.5 Flash vs Gemini 3.1 Pro Preview comparison based on?

63 benchmarks have a result for both models as of October 21, 2026. Gemini 2.5 Flash's coding index rests on 1 independent benchmark and Gemini 3.1 Pro Preview's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next