Gemini 3.1 Pro Preview vs Gemma 4 31B

Gemma 4 31B leads Gemini 3.1 Pro Preview on coding, 39.0 to 32.3 on the Vibe Coding Index, and Gemma 4 31B costs 30.0x less per output token ($0.40 vs $12.00 per million). Updated October 21, 2026; 61 benchmarks have a result for both.

Replace Gemini 3.1 Pro Preview Replace Gemma 4 31B

Gemini 3.1 Pro PreviewGoogle

Coding: 32.3
Overall: 54.0
Output $/M: $12.00

Gemma 4 31BGoogle

Coding: 39.0
Overall: 42.1
Output $/M: $0.40

vs boards won of 61 shared

Gemini 3.1 Pro Preview or Gemma 4 31B: which to pick

Pick Gemma 4 31B for coding: it scores 39.0 on the Vibe Coding Index against 32.3 for Gemini 3.1 Pro Preview, though on 2 benchmarks against 4.

Pick Gemini 3.1 Pro Preview for a larger context window (1.05M against 262K tokens) and work measured by LMArena WebDev or AA Coding Index, where it leads.

Model AGemini 3.1 Pro PreviewGoogle32.3/1004 independent benchmarks$0.99 per solved task Model BGemma 4 31BGoogle39.0/1002 independent benchmarksNo cost per solved task

617210

Shared results: 61
Gemini 3.1 Pro Preview only: 72
Gemma 4 31B only: 10
Like-for-like categories: 7 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, six public coding benchmarks
Gemma 4 31B
Gemma 4 31B scores 39.0 against 32.3.
4 and 2 benchmarks behind the scores
Intelligence
AA Intelligence Index
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview leads, 29.7 against 14.7.
Same board, both measured
Agentic work
AA Agentic Index
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview leads, 8.2 against 4.2.
Same board, both measured
Reasoning
GPQA Diamond
No call
Only Gemini 3.1 Pro Preview has a GPQA Diamond result, 95.5%.
Directional only
Math
AIME
No call
Only Gemini 3.1 Pro Preview has a AIME result, 98.1%.
Directional only
Knowledge
MMLU Pro
No call
Only Gemini 3.1 Pro Preview has a MMLU Pro result, 91.0%.
Directional only
Web design
Design Arena: websites
No call
Only Gemini 3.1 Pro Preview has a Design Arena: websites result, 1234.
Directional only
Long documents
Listed context window
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview takes 1.05M tokens against 262K.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
Gemma 4 31B
Gemini 3.1 Pro Preview $0.0080, Gemma 4 31B $0.0003 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
No call
Only Gemini 3.1 Pro Preview has the number, $0.99.
Directional only

At a glance

Coding index: Gemini 3.1 Pro Preview 32.3 from 4 benchmarks, Gemma 4 31B 39.0 from 2 benchmarks.
Widest category: Agentic work, 17.1 points apart on average over 2 shared benchmarks.
Widest single gap: SimpleQA Verified: Gemini 3.1 Pro Preview 73.5% against Gemma 4 31B 10.4%, 63.1 points apart on a 0 to 100 scale.
Output price: Gemini 3.1 Pro Preview $12.00 against Gemma 4 31B $0.40 per million output tokens, 30.0x apart.
Context window: Gemini 3.1 Pro Preview takes 1.05M tokens, Gemma 4 31B 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	Gemini 3.1 Pro Preview	Gemma 4 31B
Coding	11	0
Intelligence	1	0
Agentic work	2	0
Reasoning	8	0
Math	3	0
Knowledge	8	0
General	27	1
All shared boards	60	1

CodingLike-for-likeSix of these boards feed the Vibe Coding Index110

Coding benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
LiveBench coding	Not measured	49.0%	Only Gemma 4 31B measured
LMArena WebDev	1447	1367	Gemini 3.1 Pro Preview
AA Coding Index	68.8	43.4	Gemini 3.1 Pro Preview
LiveCodeBench (Vals AI)	88.5%	Not measured	Only Gemini 3.1 Pro Preview measured
SWE-bench Verified (Vals AI)	78.8%	Not measured	Only Gemini 3.1 Pro Preview measured
Terminal-Bench 4 (Vals AI)	2.5%	Not measured	Only Gemini 3.1 Pro Preview measured
Vibe Code Bench (Vals AI)	32.0%	Not measured	Only Gemini 3.1 Pro Preview measured
Code migration (Vals AI)	17.3%	Not measured	Only Gemini 3.1 Pro Preview measured
ProgramBench (Vals AI)	0.0%	Not measured	Only Gemini 3.1 Pro Preview measured
IOI (Vals AI)	51.8%	Not measured	Only Gemini 3.1 Pro Preview measured
Terminal-Bench 2.1 (Vals AI)	70.8%	Not measured	Only Gemini 3.1 Pro Preview measured
Vibe Code Bench 1-100 (Vals AI)	6.7%	Not measured	Only Gemini 3.1 Pro Preview measured
SciCode	58.7%	45.5%	Gemini 3.1 Pro Preview
Terminal-Bench Hard (Artificial Analysis run)	53.8%	36.4%	Gemini 3.1 Pro Preview
Terminal-Bench	80.2%	Not measured	Only Gemini 3.1 Pro Preview measured
GSO-Bench	22.6%	Not measured	Only Gemini 3.1 Pro Preview measured
WeirdML	72.1%	52.3%	Gemini 3.1 Pro Preview
MirrorCode	8.9%	Not measured	Only Gemini 3.1 Pro Preview measured
ALE-Bench	1160.6	925.5	Gemini 3.1 Pro Preview
LMArena Text: coding	1484	1459	Gemini 3.1 Pro Preview
LMArena Text: software and IT	1487	1463	Gemini 3.1 Pro Preview
LMArena WebDev: React	1438	1359	Gemini 3.1 Pro Preview
LMArena WebDev: HTML	1490	1380	Gemini 3.1 Pro Preview
LMArena WebDev: from an image	1481	Not measured	Only Gemini 3.1 Pro Preview measured
SciCode	14.3%	8.9%	Gemini 3.1 Pro Preview
Neither model has a result on the other 14 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10

Intelligence benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
AA Intelligence Index	29.7	14.7	Gemini 3.1 Pro Preview
Epoch Capabilities Index	Not measured	143.0	Only Gemma 4 31B measured

Agentic workLike-for-likePublic boards, shown as published, kept out of the index20

Agentic work benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
AA Agentic Index	8.2	4.2	Gemini 3.1 Pro Preview
Design Arena: agents building web apps	1125	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: agents building full-stack apps	1068	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: agents building mobile apps	1093	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: agents building Android apps	1048	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: agents building Godot games	1236	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: agents building games	1114	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: HTML slides	1153	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: PowerPoint slides	1066	Not measured	Only Gemini 3.1 Pro Preview measured
LiveBench research	Not measured	44.4%	Only Gemma 4 31B measured
LiveBench browser	Not measured	4.0%	Only Gemma 4 31B measured
LiveBench long agentic	Not measured	13.3%	Only Gemma 4 31B measured
SREBench (Vals AI)	0.0%	Not measured	Only Gemini 3.1 Pro Preview measured
Finance Agent (Vals AI)	43.0%	Not measured	Only Gemini 3.1 Pro Preview measured
Tax Agent Bench (Vals AI)	9.3%	Not measured	Only Gemini 3.1 Pro Preview measured
Legal Research Bench (Vals AI)	20.7%	Not measured	Only Gemini 3.1 Pro Preview measured
Excel Modeling Benchmark (Vals AI)	52.6%	Not measured	Only Gemini 3.1 Pro Preview measured
BioMysteryBench (Vals AI)	60.0%	Not measured	Only Gemini 3.1 Pro Preview measured
Terminal-Bench-Science (Vals AI)	1.4%	Not measured	Only Gemini 3.1 Pro Preview measured
Vals Science Index	27.4%	Not measured	Only Gemini 3.1 Pro Preview measured
τ²-Bench Telecom	95.6%	65.5%	Gemini 3.1 Pro Preview
APEX-Agents	35.1%	Not measured	Only Gemini 3.1 Pro Preview measured
METR time horizons	77.0%	Not measured	Only Gemini 3.1 Pro Preview measured
BALROG	57.0%	Not measured	Only Gemini 3.1 Pro Preview measured
DeepResearch Bench	47.8%	Not measured	Only Gemini 3.1 Pro Preview measured
PostTrainBench	22.0%	Not measured	Only Gemini 3.1 Pro Preview measured
Vending-Bench 2	$911	Not measured	Only Gemini 3.1 Pro Preview measured
Neither model has a result on the other 14 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index80

Reasoning benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
GPQA Diamond	95.5%	Not measured	Only Gemini 3.1 Pro Preview measured
LiveBench reasoning	Not measured	68.3%	Only Gemma 4 31B measured
MysteryMechanism (Vals AI)	20.7%	Not measured	Only Gemini 3.1 Pro Preview measured
MMMU Pro (Vals AI)	88.2%	Not measured	Only Gemini 3.1 Pro Preview measured
GPQA Diamond (Artificial Analysis run)	94.1%	85.7%	Gemini 3.1 Pro Preview
Humanity's Last Exam (Artificial Analysis run)	47.0%	23.6%	Gemini 3.1 Pro Preview
GPQA Diamond (Epoch AI run)	94.4%	75.8%	Gemini 3.1 Pro Preview
ARC-AGI	98.0%	Not measured	Only Gemini 3.1 Pro Preview measured
ARC-AGI-2	77.1%	Not measured	Only Gemini 3.1 Pro Preview measured
SimpleBench	79.6%	Not measured	Only Gemini 3.1 Pro Preview measured
Chess puzzles	51.0%	Not measured	Only Gemini 3.1 Pro Preview measured
Mystery game puzzles	34.0%	Not measured	Only Gemini 3.1 Pro Preview measured
EBR-bench	14.3%	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Text: hard prompts	1485	1448	Gemini 3.1 Pro Preview
LMArena Text: expert	1483	1464	Gemini 3.1 Pro Preview
LMArena Text: hard prompts in English	1480	1456	Gemini 3.1 Pro Preview
LMArena Vision: diagrams	1311	1283	Gemini 3.1 Pro Preview
LMArena Vision: homework	1316	1310	Gemini 3.1 Pro Preview
Kagi LLM Benchmark	Not measured	63.5%	Only Gemma 4 31B measured
Neither model has a result on the other 3 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index30

Math benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
AIME	98.1%	Not measured	Only Gemini 3.1 Pro Preview measured
OTIS Mock AIME	95.6%	73.3%	Gemini 3.1 Pro Preview
FrontierMath, tiers 1 to 3	59.6%	Not measured	Only Gemini 3.1 Pro Preview measured
FrontierMath, tier 4	26.8%	Not measured	Only Gemini 3.1 Pro Preview measured
ProofBench	26.0%	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Text: math	1486	1463	Gemini 3.1 Pro Preview
LMArena Text: mathematical work	1478	1465	Gemini 3.1 Pro Preview
Neither model has a result on the other 6 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index80

Knowledge benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
MMLU Pro	91.0%	Not measured	Only Gemini 3.1 Pro Preview measured
LegalBench (Vals AI)	87.4%	Not measured	Only Gemini 3.1 Pro Preview measured
CaseLaw (Vals AI)	64.8%	52.6%	Gemini 3.1 Pro Preview
CorpFin (Vals AI)	64.5%	Not measured	Only Gemini 3.1 Pro Preview measured
TaxEval (Vals AI)	72.9%	Not measured	Only Gemini 3.1 Pro Preview measured
MortgageTax (Vals AI)	69.4%	61.4%	Gemini 3.1 Pro Preview
MedQA (Vals AI)	96.4%	Not measured	Only Gemini 3.1 Pro Preview measured
MedCode (Vals AI)	59.1%	Not measured	Only Gemini 3.1 Pro Preview measured
SimpleQA Verified	73.5%	10.4%	Gemini 3.1 Pro Preview
LMArena Text: science	1497	1457	Gemini 3.1 Pro Preview
LMArena Text: medicine and healthcare	1486	1451	Gemini 3.1 Pro Preview
LMArena Text: legal and government	1487	1438	Gemini 3.1 Pro Preview
LMArena Text: business and finance	1459	1430	Gemini 3.1 Pro Preview
FACTS Benchmark Suite	67.4%	45.3%	Gemini 3.1 Pro Preview
Neither model has a result on the other 4 boards here

Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared

Web design benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
Design Arena: websites	1234	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: UI components	1227	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: game dev	1203	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: data viz	1209	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: 3D	1234	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: all code categories	1231	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: SVG	1285	Not measured	Only Gemini 3.1 Pro Preview measured
Design Arena: ASCII art	1270	Not measured	Only Gemini 3.1 Pro Preview measured
LiveBench design	Not measured	58.4%	Only Gemma 4 31B measured

GeneralLike-for-likePublic boards, shown as published, kept out of the index271

General benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
LiveBench data analysis	Not measured	53.3%	Only Gemma 4 31B measured
Public Benefits Bench (Vals AI)	53.8%	Not measured	Only Gemini 3.1 Pro Preview measured
SAGE (Vals AI)	48.7%	55.0%	Gemma 4 31B
MedScribe (Vals AI)	76.1%	Not measured	Only Gemini 3.1 Pro Preview measured
Vals Multimodal Index	56.1%	Not measured	Only Gemini 3.1 Pro Preview measured
IFBench	77.1%	75.6%	Gemini 3.1 Pro Preview
Long context reasoning (AA-LCR)	82.0%	69.7%	Gemini 3.1 Pro Preview
DTBench	97.1%	82.7%	Gemini 3.1 Pro Preview
LMCA	53.8%	39.3%	Gemini 3.1 Pro Preview
CL-bench	20.8%	Not measured	Only Gemini 3.1 Pro Preview measured
Surface Evolver Bench	Not measured	30.6%	Only Gemma 4 31B measured
Furniture assembly	26.7%	Not measured	Only Gemini 3.1 Pro Preview measured
ExploitBench	26.1%	Not measured	Only Gemini 3.1 Pro Preview measured
CL-bench Life	16.9%	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Text	1480	1443	Gemini 3.1 Pro Preview
LMArena Text: instruction following	1466	1433	Gemini 3.1 Pro Preview
LMArena Text: creative writing	1482	1417	Gemini 3.1 Pro Preview
LMArena Vision	1296	1276	Gemini 3.1 Pro Preview
LMArena Text: English	1478	1451	Gemini 3.1 Pro Preview
LMArena Text: non-English	1476	1430	Gemini 3.1 Pro Preview
LMArena Text: Chinese	1527	1475	Gemini 3.1 Pro Preview
LMArena Text: German	1490	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Text: Japanese	1491	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Text: Korean	1455	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Text: French	1487	1436	Gemini 3.1 Pro Preview
LMArena Text: Spanish	1481	1442	Gemini 3.1 Pro Preview
LMArena Text: Russian	1497	1460	Gemini 3.1 Pro Preview
LMArena Text: Polish	1498	1433	Gemini 3.1 Pro Preview
LMArena Text: multi-turn	1487	1452	Gemini 3.1 Pro Preview
LMArena Text: longer queries	1482	1446	Gemini 3.1 Pro Preview
LMArena Text: writing and language	1481	1432	Gemini 3.1 Pro Preview
LMArena Text: entertainment and media	1465	1405	Gemini 3.1 Pro Preview
LMArena Vision: English	1287	1271	Gemini 3.1 Pro Preview
LMArena Vision: Chinese	1364	1326	Gemini 3.1 Pro Preview
LMArena Vision: reading text	1304	1282	Gemini 3.1 Pro Preview
LMArena Vision: humor	1322	1280	Gemini 3.1 Pro Preview
LMArena Vision: captioning	1345	1218	Gemini 3.1 Pro Preview
LMArena Vision: recognizing things	1330	1226	Gemini 3.1 Pro Preview
LMArena Vision: creative writing	1324	1285	Gemini 3.1 Pro Preview
LMArena Document	1444	1425	Gemini 3.1 Pro Preview
Neither model has a result on the other 6 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for Gemini 3.1 Pro Preview and Gemma 4 31B
Benchmark	Gemini 3.1 Pro Preview	Gemma 4 31B	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 3.1 Pro Preview$0.0080Fits in one request

Gemma 4 31B$0.0003Fits in one request

Gemma 4 31B costs less

Repository review

50K input + 3K output tokens

Gemini 3.1 Pro Preview$0.136Fits in one request

Gemma 4 31B$0.0082Fits in one request

Gemma 4 31B costs less

Agent loop

200K input + 10K output tokens

Gemini 3.1 Pro Preview$0.520Fits in one request

Gemma 4 31B$0.032Fits in one request

Gemma 4 31B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 3.1 Pro Preview and Gemma 4 31B
Specification	Google Gemini 3.1 Pro Preview	Google Gemma 4 31B
Maker	Google	Google
Weights	No public weights listed	Open weights
Released	February 19, 2026	April 2, 2026
Context window	1.05M	262K
Input $/Mtok	$2.00	$0.14
Output $/Mtok	$12.00	$0.40
Coding index	32.3	39.0
Independent measurements behind it	4	2
Cost per solved task	$0.99	Not computable
Source	OpenRouter listing	OpenRouter listing

Questions

Is Gemini 3.1 Pro Preview better than Gemma 4 31B for coding?

Pick Gemma 4 31B for coding: it scores 39.0 on the Vibe Coding Index against 32.3 for Gemini 3.1 Pro Preview, though on 2 benchmarks against 4. Pick Gemini 3.1 Pro Preview for a larger context window (1.05M against 262K tokens) and work measured by LMArena WebDev or AA Coding Index, where it leads.

Which is cheaper, Gemini 3.1 Pro Preview or Gemma 4 31B?

Gemini 3.1 Pro Preview costs $2.00 per million input tokens and $12.00 per million output tokens; Gemma 4 31B costs $0.14 and $0.40. Cost per solved task is known for Gemini 3.1 Pro Preview only.

Which has the bigger context window, Gemini 3.1 Pro Preview or Gemma 4 31B?

Gemini 3.1 Pro Preview, with 1.05M tokens against 262K.

How many benchmarks is the Gemini 3.1 Pro Preview vs Gemma 4 31B comparison based on?

61 benchmarks have a result for both models as of October 21, 2026. Gemini 3.1 Pro Preview's coding index rests on 4 independent benchmarks and Gemma 4 31B's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/gemini-3-1-pro-preview-vs-gemma-4-31b-it" title="Gemini 3.1 Pro Preview vs Gemma 4 31B, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/gemini-3-1-pro-preview-vs-gemma-4-31b-it">LLMBenchmark.ai, Gemini 3.1 Pro Preview vs Gemma 4 31B</a></p>

Gemini 3.1 Pro Preview or Gemma 4 31B: which to pick

Which one for your work

Coding

Intelligence

Agentic work

Reasoning

Math

Knowledge

Web design

Long documents

Everyday cost

Cost per solved task

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next