Claude Sonnet 5.5 vs Gemma 4 31B

Claude Sonnet 5.5 leads Gemma 4 31B on coding, 87.3 to 39.0 on the Vibe Coding Index, and Gemma 4 31B costs 25.0x less per output token ($0.40 vs $10.00 per million). Updated October 22, 2026; 53 benchmarks have a result for both.

Replace Claude Sonnet 5.5 Replace Gemma 4 31B

Claude Sonnet 5.5Anthropic

Coding: 87.3
Overall: 82.8
Output $/M: $10.00

Gemma 4 31BGoogle

Coding: 39.0
Overall: 42.1
Output $/M: $0.40

vs boards won of 53 shared

Claude Sonnet 5.5 or Gemma 4 31B: which to pick

Pick Claude Sonnet 5.5 for coding: it scores 87.3 on the Vibe Coding Index against 39.0 for Gemma 4 31B.

Pick Gemma 4 31B for output tokens 25.0x cheaper ($0.40 vs $10.00 per million) and work measured by SAGE (Vals AI) or LMArena Text: Russian, where it leads.

Model AClaude Sonnet 5.5Anthropic87.3/1005 independent benchmarksNo cost per solved task Model BGemma 4 31BGoogle39.0/1002 independent benchmarksNo cost per solved task

534318

Shared results: 53
Claude Sonnet 5.5 only: 43
Gemma 4 31B only: 18
Like-for-like categories: 8 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, six public coding benchmarks
Claude Sonnet 5.5
Claude Sonnet 5.5 scores 87.3 against 39.0.
5 and 2 benchmarks behind the scores
Intelligence
AA Intelligence Index
Claude Sonnet 5.5
Claude Sonnet 5.5 leads, 56.0 against 14.7.
Same board, both measured
Agentic work
AA Agentic Index
No call
Only Gemma 4 31B has a AA Agentic Index result, 4.2.
Directional only
Web design
Design Arena: websites
No call
Only Claude Sonnet 5.5 has a Design Arena: websites result, 1326.
Directional only
General
Vals Index
No call
Only Claude Sonnet 5.5 has a Vals Index result, 70.8%.
Directional only
Long documents
Listed context window
Claude Sonnet 5.5
Claude Sonnet 5.5 takes 1M tokens against 262K.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
Gemma 4 31B
Claude Sonnet 5.5 $0.0070, Gemma 4 31B $0.0003 per turn.
List prices

At a glance

Coding index: Claude Sonnet 5.5 87.3 from 5 benchmarks, Gemma 4 31B 39.0 from 2 benchmarks.
Widest category: Agentic work, 61.6 points apart on average over 3 shared benchmarks.
Widest single gap: LiveBench browser: Claude Sonnet 5.5 84.0% against Gemma 4 31B 4.0%, 80.0 points apart on a 0 to 100 scale.
Output price: Claude Sonnet 5.5 $10.00 against Gemma 4 31B $0.40 per million output tokens, 25.0x apart.
Context window: Claude Sonnet 5.5 takes 1M tokens, Gemma 4 31B 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	Claude Sonnet 5.5	Gemma 4 31B
Coding	9	0
Intelligence	2	0
Agentic work	3	0
Reasoning	8	0
Math	3	0
Knowledge	5	0
Web design	1	0
General	19	3
All shared boards	50	3

CodingLike-for-likeSix of these boards feed the Vibe Coding Index90

Coding benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
LiveBench coding	94.7%	49.0%	Claude Sonnet 5.5
LMArena WebDev	1768	1367	Claude Sonnet 5.5
AA Coding Index	Not measured	43.4	Only Gemma 4 31B measured
Terminal-Bench 4 (Vals AI)	64.1%	Not measured	Only Claude Sonnet 5.5 measured
Vibe Code Bench (Vals AI)	92.4%	Not measured	Only Claude Sonnet 5.5 measured
Code migration (Vals AI)	69.8%	Not measured	Only Claude Sonnet 5.5 measured
ProgramBench (Vals AI)	6.5%	Not measured	Only Claude Sonnet 5.5 measured
IOI (Vals AI)	83.1%	Not measured	Only Claude Sonnet 5.5 measured
Terminal-Bench 2.1 (Vals AI)	83.2%	Not measured	Only Claude Sonnet 5.5 measured
SWE-bench Multimodal (Vals AI)	58.3%	Not measured	Only Claude Sonnet 5.5 measured
CyberBench (Vals AI)	59.6%	Not measured	Only Claude Sonnet 5.5 measured
SciCode	61.0%	45.5%	Claude Sonnet 5.5
Terminal-Bench Hard (Artificial Analysis run)	Not measured	36.4%	Only Gemma 4 31B measured
FrontierCode	52.1%	Not measured	Only Claude Sonnet 5.5 measured
FrontierSWE	61.9%	Not measured	Only Claude Sonnet 5.5 measured
WeirdML	Not measured	52.3%	Only Gemma 4 31B measured
ALE-Bench	1819.1	925.5	Claude Sonnet 5.5
LMArena Text: coding	1513	1459	Claude Sonnet 5.5
LMArena Text: software and IT	1504	1463	Claude Sonnet 5.5
LMArena WebDev: React	1817	1359	Claude Sonnet 5.5
LMArena WebDev: HTML	1741	1380	Claude Sonnet 5.5
LMArena WebDev: from an image	1737	Not measured	Only Claude Sonnet 5.5 measured
SciCode	13.8%	8.9%	Claude Sonnet 5.5
Neither model has a result on the other 16 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20

Intelligence benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
AA Intelligence Index	56.0	14.7	Claude Sonnet 5.5
Epoch Capabilities Index	166.2	143.0	Claude Sonnet 5.5

Agentic workLike-for-likePublic boards, shown as published, kept out of the index30

Agentic work benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
AA Agentic Index	Not measured	4.2	Only Gemma 4 31B measured
Design Arena: agents building web apps	1305	Not measured	Only Claude Sonnet 5.5 measured
Design Arena: agents building mobile apps	1260	Not measured	Only Claude Sonnet 5.5 measured
Design Arena: spreadsheets	1260	Not measured	Only Claude Sonnet 5.5 measured
LiveBench research	83.6%	44.4%	Claude Sonnet 5.5
LiveBench browser	84.0%	4.0%	Claude Sonnet 5.5
LiveBench long agentic	78.8%	13.3%	Claude Sonnet 5.5
SREBench (Vals AI)	30.1%	Not measured	Only Claude Sonnet 5.5 measured
Finance Agent (Vals AI)	58.1%	Not measured	Only Claude Sonnet 5.5 measured
Tax Agent Bench (Vals AI)	42.0%	Not measured	Only Claude Sonnet 5.5 measured
Legal Research Bench (Vals AI)	48.1%	Not measured	Only Claude Sonnet 5.5 measured
Harvey's Legal Agent Benchmark (Vals AI)	10.4%	Not measured	Only Claude Sonnet 5.5 measured
Excel Modeling Benchmark (Vals AI)	75.7%	Not measured	Only Claude Sonnet 5.5 measured
BioMysteryBench (Vals AI)	81.1%	Not measured	Only Claude Sonnet 5.5 measured
Terminal-Bench-Science (Vals AI)	47.1%	Not measured	Only Claude Sonnet 5.5 measured
Vals Science Index	59.1%	Not measured	Only Claude Sonnet 5.5 measured
τ²-Bench Telecom	Not measured	65.5%	Only Gemma 4 31B measured
APEX-Agents	75.5%	Not measured	Only Claude Sonnet 5.5 measured
SpireClimb	1.3%	Not measured	Only Claude Sonnet 5.5 measured
Vending-Bench 2	$11,165	Not measured	Only Claude Sonnet 5.5 measured
Neither model has a result on the other 21 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index80

Reasoning benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
LiveBench reasoning	91.6%	68.3%	Claude Sonnet 5.5
MysteryMechanism (Vals AI)	49.1%	Not measured	Only Claude Sonnet 5.5 measured
GPQA Diamond (Artificial Analysis run)	Not measured	85.7%	Only Gemma 4 31B measured
Humanity's Last Exam (Artificial Analysis run)	55.0%	23.6%	Claude Sonnet 5.5
GPQA Diamond (Epoch AI run)	95.6%	75.8%	Claude Sonnet 5.5
Chess puzzles	59.0%	Not measured	Only Claude Sonnet 5.5 measured
Mystery game puzzles	65.0%	Not measured	Only Claude Sonnet 5.5 measured
LMArena Text: hard prompts	1494	1448	Claude Sonnet 5.5
LMArena Text: expert	1531	1464	Claude Sonnet 5.5
LMArena Text: hard prompts in English	1502	1456	Claude Sonnet 5.5
LMArena Vision: diagrams	1329	1283	Claude Sonnet 5.5
LMArena Vision: homework	1331	1310	Claude Sonnet 5.5
Kagi LLM Benchmark	Not measured	63.5%	Only Gemma 4 31B measured
Neither model has a result on the other 9 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index30

Math benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
OTIS Mock AIME	100.0%	73.3%	Claude Sonnet 5.5
FrontierMath, tiers 1 to 3	88.8%	Not measured	Only Claude Sonnet 5.5 measured
FrontierMath, tier 4	80.5%	Not measured	Only Claude Sonnet 5.5 measured
ProofBench	100.0%	Not measured	Only Claude Sonnet 5.5 measured
LMArena Text: math	1497	1463	Claude Sonnet 5.5
LMArena Text: mathematical work	1510	1465	Claude Sonnet 5.5
Neither model has a result on the other 7 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index50

Knowledge benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
CaseLaw (Vals AI)	Not measured	52.6%	Only Gemma 4 31B measured
MortgageTax (Vals AI)	Not measured	61.4%	Only Gemma 4 31B measured
MedCode (Vals AI)	52.9%	Not measured	Only Claude Sonnet 5.5 measured
SimpleQA Verified	46.5%	10.4%	Claude Sonnet 5.5
LMArena Text: science	1483	1457	Claude Sonnet 5.5
LMArena Text: medicine and healthcare	1464	1451	Claude Sonnet 5.5
LMArena Text: legal and government	1483	1438	Claude Sonnet 5.5
LMArena Text: business and finance	1468	1430	Claude Sonnet 5.5
FACTS Benchmark Suite	Not measured	45.3%	Only Gemma 4 31B measured
Neither model has a result on the other 9 boards here

Web designLike-for-likePublic boards, shown as published, kept out of the index10

Web design benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
Design Arena: websites	1326	Not measured	Only Claude Sonnet 5.5 measured
Design Arena: UI components	1368	Not measured	Only Claude Sonnet 5.5 measured
Design Arena: game dev	1471	Not measured	Only Claude Sonnet 5.5 measured
Design Arena: data viz	1392	Not measured	Only Claude Sonnet 5.5 measured
Design Arena: 3D	1445	Not measured	Only Claude Sonnet 5.5 measured
Design Arena: all code categories	1364	Not measured	Only Claude Sonnet 5.5 measured
LiveBench design	85.0%	58.4%	Claude Sonnet 5.5
Neither model has a result on the other 2 boards here

GeneralLike-for-likePublic boards, shown as published, kept out of the index193

General benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
Vals Index	70.8%	Not measured	Only Claude Sonnet 5.5 measured
LiveBench data analysis	59.5%	53.3%	Claude Sonnet 5.5
Public Benefits Bench (Vals AI)	67.2%	Not measured	Only Claude Sonnet 5.5 measured
SAGE (Vals AI)	51.8%	55.0%	Gemma 4 31B
MedScribe (Vals AI)	91.1%	Not measured	Only Claude Sonnet 5.5 measured
IFBench	Not measured	75.6%	Only Gemma 4 31B measured
Long context reasoning (AA-LCR)	82.7%	69.7%	Claude Sonnet 5.5
DTBench	97.3%	82.7%	Claude Sonnet 5.5
LMCA	68.3%	39.3%	Claude Sonnet 5.5
Surface Evolver Bench	Not measured	30.6%	Only Gemma 4 31B measured
Furniture assembly	75.0%	Not measured	Only Claude Sonnet 5.5 measured
LMArena Text	1473	1443	Claude Sonnet 5.5
LMArena Text: instruction following	1492	1433	Claude Sonnet 5.5
LMArena Text: creative writing	1467	1417	Claude Sonnet 5.5
LMArena Vision	1287	1276	Claude Sonnet 5.5
LMArena Text: English	1484	1451	Claude Sonnet 5.5
LMArena Text: non-English	1456	1430	Claude Sonnet 5.5
LMArena Text: Chinese	1535	1475	Claude Sonnet 5.5
LMArena Text: French	1499	1436	Claude Sonnet 5.5
LMArena Text: Spanish	1451	1442	Claude Sonnet 5.5
LMArena Text: Russian	1454	1460	Gemma 4 31B
LMArena Text: Polish	Not measured	1433	Only Gemma 4 31B measured
LMArena Text: multi-turn	1465	1452	Claude Sonnet 5.5
LMArena Text: longer queries	1495	1446	Claude Sonnet 5.5
LMArena Text: writing and language	1474	1432	Claude Sonnet 5.5
LMArena Text: entertainment and media	1461	1405	Claude Sonnet 5.5
LMArena Vision: English	1289	1271	Claude Sonnet 5.5
LMArena Vision: Chinese	Not measured	1326	Only Gemma 4 31B measured
LMArena Vision: reading text	1297	1282	Claude Sonnet 5.5
LMArena Vision: humor	Not measured	1280	Only Gemma 4 31B measured
LMArena Vision: captioning	Not measured	1218	Only Gemma 4 31B measured
LMArena Vision: recognizing things	Not measured	1226	Only Gemma 4 31B measured
LMArena Vision: creative writing	1242	1285	Gemma 4 31B
LMArena Document	Not measured	1425	Only Gemma 4 31B measured
Neither model has a result on the other 12 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for Claude Sonnet 5.5 and Gemma 4 31B
Benchmark	Claude Sonnet 5.5	Gemma 4 31B	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Sonnet 5.5$0.0070Fits in one request

Gemma 4 31B$0.0003Fits in one request

Gemma 4 31B costs less

Repository review

50K input + 3K output tokens

Claude Sonnet 5.5$0.130Fits in one request

Gemma 4 31B$0.0082Fits in one request

Gemma 4 31B costs less

Agent loop

200K input + 10K output tokens

Claude Sonnet 5.5$0.500Fits in one request

Gemma 4 31B$0.032Fits in one request

Gemma 4 31B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Sonnet 5.5 and Gemma 4 31B
Specification	Anthropic Claude Sonnet 5.5	Google Gemma 4 31B
Maker	Anthropic	Google
Weights	No public weights listed	Open weights
Released	September 28, 2026	April 2, 2026
Context window	1M	262K
Input $/Mtok	$2.00	$0.14
Output $/Mtok	$10.00	$0.40
Coding index	87.3	39.0
Independent measurements behind it	5	2
Cost per solved task	Not computable	Not computable
Source	OpenRouter listing	OpenRouter listing

Questions

Is Claude Sonnet 5.5 better than Gemma 4 31B for coding?

Pick Claude Sonnet 5.5 for coding: it scores 87.3 on the Vibe Coding Index against 39.0 for Gemma 4 31B. Pick Gemma 4 31B for output tokens 25.0x cheaper ($0.40 vs $10.00 per million) and work measured by SAGE (Vals AI) or LMArena Text: Russian, where it leads.

Which is cheaper, Claude Sonnet 5.5 or Gemma 4 31B?

Claude Sonnet 5.5 costs $2.00 per million input tokens and $10.00 per million output tokens; Gemma 4 31B costs $0.14 and $0.40. Cost per solved task is known for neither of them.

Which has the bigger context window, Claude Sonnet 5.5 or Gemma 4 31B?

Claude Sonnet 5.5, with 1M tokens against 262K.

How many benchmarks is the Claude Sonnet 5.5 vs Gemma 4 31B comparison based on?

53 benchmarks have a result for both models as of October 22, 2026. Claude Sonnet 5.5's coding index rests on 5 independent benchmarks and Gemma 4 31B's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/claude-sonnet-5-5-vs-gemma-4-31b-it" title="Claude Sonnet 5.5 vs Gemma 4 31B, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/claude-sonnet-5-5-vs-gemma-4-31b-it">LLMBenchmark.ai, Claude Sonnet 5.5 vs Gemma 4 31B</a></p>

Claude Sonnet 5.5 or Gemma 4 31B: which to pick

Which one for your work

Coding

Intelligence

Agentic work

Web design

General

Long documents

Everyday cost

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next