LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Opus 5.5 vs Gemma 3 27B

Updated October 21, 2026. 40 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Opus 5.5Anthropic
Coding
92.2
Overall
57.6
Output $/M
$20.00
40
Gemma 3 27BGoogle
Coding
4.9
Overall
4.9
Output $/M
$0.35
0
vs boards won of 40 shared

Decision reading

Pick Claude Opus 5.5 for coding: it scores 92.2 on the Vibe Coding Index against 4.9 for Gemma 3 27B.

Pick Gemma 3 27B when output tokens cost 57.1x less.

Shared results
40
Claude Opus 5.5 only
67
Gemma 3 27B only
22
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Opus 5.5 92.2 from 2 benchmarks, Gemma 3 27B 4.9 from 1 benchmark.
Widest category
Intelligence, 50.6 points apart on average over 2 shared benchmarks.
Widest single gap
OTIS Mock AIME: Claude Opus 5.5 100.0% against Gemma 3 27B 22.5%, 77.5 points apart on a 0 to 100 scale.
Output price
Claude Opus 5.5 $20.00 against Gemma 3 27B $0.35 per million output tokens, 57.1x apart.
Context window
Claude Opus 5.5 takes 1M tokens, Gemma 3 27B 131K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Opus 5.5BarsGemma 3 27BTies
Coding30
Intelligence20
Reasoning70
Math30
Knowledge40
General210
All shared boards400
CodingLike-for-likeFour of these boards feed the Vibe Coding Index30
Coding benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
Aider polyglotNot measured4.9%Only Gemma 3 27B measured
LiveBench coding96.3%Not measuredOnly Claude Opus 5.5 measured
LMArena WebDev1807Not measuredOnly Claude Opus 5.5 measured
AA Coding IndexNot measured10.1Only Gemma 3 27B measured
Terminal-Bench 4 (Vals AI)65.2%Not measuredOnly Claude Opus 5.5 measured
Vibe Code Bench (Vals AI)90.3%Not measuredOnly Claude Opus 5.5 measured
Code migration (Vals AI)66.7%Not measuredOnly Claude Opus 5.5 measured
ProgramBench (Vals AI)18.5%Not measuredOnly Claude Opus 5.5 measured
IOI (Vals AI)95.1%Not measuredOnly Claude Opus 5.5 measured
Terminal-Bench 2.1 (Vals AI)87.6%Not measuredOnly Claude Opus 5.5 measured
SWE-bench Multimodal (Vals AI)70.2%Not measuredOnly Claude Opus 5.5 measured
Vibe Code Bench 1-100 (Vals AI)30.4%Not measuredOnly Claude Opus 5.5 measured
CyberBench (Vals AI)74.6%Not measuredOnly Claude Opus 5.5 measured
LiveCodeBench (Artificial Analysis run)Not measured13.7%Only Gemma 3 27B measured
SciCode66.9%23.3%Claude Opus 5.5
Terminal-Bench Hard (Artificial Analysis run)Not measured3.8%Only Gemma 3 27B measured
FrontierCode54.6%Not measuredOnly Claude Opus 5.5 measured
FrontierSWE62.3%Not measuredOnly Claude Opus 5.5 measured
MirrorCode77.4%Not measuredOnly Claude Opus 5.5 measured
ALE-Bench2147.4Not measuredOnly Claude Opus 5.5 measured
LMArena Text: coding15451322Claude Opus 5.5
LMArena Text: software and IT15381354Claude Opus 5.5
LMArena WebDev: React1855Not measuredOnly Claude Opus 5.5 measured
LMArena WebDev: HTML1753Not measuredOnly Claude Opus 5.5 measured
LMArena WebDev: from an image1753Not measuredOnly Claude Opus 5.5 measured
Neither model has a result on the other 13 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
AA Intelligence Index57.64.9Claude Opus 5.5
Epoch Capabilities Index168.8130.0Claude Opus 5.5
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index25 boards, none shared
Agentic work benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
AA Agentic IndexNot measured0.1Only Gemma 3 27B measured
Design Arena: agents building web apps1316Not measuredOnly Claude Opus 5.5 measured
Design Arena: agents building mobile apps1311Not measuredOnly Claude Opus 5.5 measured
Design Arena: spreadsheets1359Not measuredOnly Claude Opus 5.5 measured
LiveBench research85.0%Not measuredOnly Claude Opus 5.5 measured
LiveBench browser80.0%Not measuredOnly Claude Opus 5.5 measured
LiveBench long agentic85.0%Not measuredOnly Claude Opus 5.5 measured
SREBench (Vals AI)33.6%Not measuredOnly Claude Opus 5.5 measured
Finance Agent (Vals AI)58.6%Not measuredOnly Claude Opus 5.5 measured
Tax Agent Bench (Vals AI)45.6%Not measuredOnly Claude Opus 5.5 measured
Legal Research Bench (Vals AI)50.5%Not measuredOnly Claude Opus 5.5 measured
Harvey's Legal Agent Benchmark (Vals AI)9.2%Not measuredOnly Claude Opus 5.5 measured
Excel Modeling Benchmark (Vals AI)75.9%Not measuredOnly Claude Opus 5.5 measured
BioMysteryBench (Vals AI)79.3%Not measuredOnly Claude Opus 5.5 measured
Terminal-Bench-Science (Vals AI)47.1%Not measuredOnly Claude Opus 5.5 measured
Vals Science Index58.7%Not measuredOnly Claude Opus 5.5 measured
Time Horizon Index (Vals AI)91.3%Not measuredOnly Claude Opus 5.5 measured
CUA-bench (Vals AI)14.0%Not measuredOnly Claude Opus 5.5 measured
Robo-bench (Vals AI)14.6%Not measuredOnly Claude Opus 5.5 measured
τ²-Bench TelecomNot measured10.5%Only Gemma 3 27B measured
APEX-Agents73.5%Not measuredOnly Claude Opus 5.5 measured
Remote Labor Index21.3%Not measuredOnly Claude Opus 5.5 measured
SpireClimb3.3%Not measuredOnly Claude Opus 5.5 measured
Vending-Bench 2$9,235Not measuredOnly Claude Opus 5.5 measured
LMArena Search1213Not measuredOnly Claude Opus 5.5 measured
Neither model has a result on the other 14 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index70
Reasoning benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
LiveBench reasoning92.2%Not measuredOnly Claude Opus 5.5 measured
MysteryMechanism (Vals AI)49.5%Not measuredOnly Claude Opus 5.5 measured
GPQA Diamond (Artificial Analysis run)Not measured42.8%Only Gemma 3 27B measured
Humanity's Last Exam (Artificial Analysis run)61.4%4.4%Claude Opus 5.5
GPQA Diamond (Epoch AI run)90.6%47.7%Claude Opus 5.5
ARC-AGI98.5%Not measuredOnly Claude Opus 5.5 measured
ARC-AGI-293.3%Not measuredOnly Claude Opus 5.5 measured
Chess puzzles67.0%Not measuredOnly Claude Opus 5.5 measured
Mystery game puzzles71.0%Not measuredOnly Claude Opus 5.5 measured
EBR-bench71.4%Not measuredOnly Claude Opus 5.5 measured
LMArena Text: hard prompts15361340Claude Opus 5.5
LMArena Text: expert15491304Claude Opus 5.5
LMArena Text: hard prompts in English15351353Claude Opus 5.5
LMArena Vision: diagrams13451156Claude Opus 5.5
LMArena Vision: homework13621160Claude Opus 5.5
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
AA Math IndexNot measured20.7Only Gemma 3 27B measured
AIME 2025 (Artificial Analysis run)Not measured20.7%Only Gemma 3 27B measured
OTIS Mock AIME100.0%22.5%Claude Opus 5.5
FrontierMath, tiers 1 to 391.2%Not measuredOnly Claude Opus 5.5 measured
FrontierMath, tier 495.0%Not measuredOnly Claude Opus 5.5 measured
ProofBench100.0%Not measuredOnly Claude Opus 5.5 measured
MATH level 5Not measured74.0%Only Gemma 3 27B measured
LMArena Text: math15181312Claude Opus 5.5
LMArena Text: mathematical work15161327Claude Opus 5.5
Neither model has a result on the other 4 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index40
Knowledge benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
MedCode (Vals AI)49.8%Not measuredOnly Claude Opus 5.5 measured
MMLU Pro (Artificial Analysis run)Not measured66.9%Only Gemma 3 27B measured
SimpleQA Verified72.2%Not measuredOnly Claude Opus 5.5 measured
GeoBenchNot measured52.0%Only Gemma 3 27B measured
LMArena Text: science15241383Claude Opus 5.5
LMArena Text: medicine and healthcare15091391Claude Opus 5.5
LMArena Text: legal and government15181375Claude Opus 5.5
LMArena Text: business and finance14941360Claude Opus 5.5
Neither model has a result on the other 9 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
Design Arena: websites1335Not measuredOnly Claude Opus 5.5 measured
Design Arena: UI components1390Not measuredOnly Claude Opus 5.5 measured
Design Arena: game dev1457Not measuredOnly Claude Opus 5.5 measured
Design Arena: data viz1397Not measuredOnly Claude Opus 5.5 measured
Design Arena: 3D1477Not measuredOnly Claude Opus 5.5 measured
Design Arena: all code categories1390Not measuredOnly Claude Opus 5.5 measured
Design Arena: SVG1332Not measuredOnly Claude Opus 5.5 measured
LiveBench design86.9%Not measuredOnly Claude Opus 5.5 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index210
General benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
Vals Index70.2%Not measuredOnly Claude Opus 5.5 measured
LiveBench data analysis80.3%Not measuredOnly Claude Opus 5.5 measured
Public Benefits Bench (Vals AI)70.6%Not measuredOnly Claude Opus 5.5 measured
SAGE (Vals AI)45.8%Not measuredOnly Claude Opus 5.5 measured
MedScribe (Vals AI)91.4%Not measuredOnly Claude Opus 5.5 measured
IFBenchNot measured31.8%Only Gemma 3 27B measured
Long context reasoning (AA-LCR)84.7%7.3%Claude Opus 5.5
DTBench98.9%52.5%Claude Opus 5.5
LMCA68.2%12.3%Claude Opus 5.5
Fiction.LiveBenchNot measured33.3%Only Gemma 3 27B measured
Creative writing (Lech Mazur)Not measured79.9%Only Gemma 3 27B measured
Furniture assembly83.3%Not measuredOnly Claude Opus 5.5 measured
LMArena Text15161358Claude Opus 5.5
LMArena Text: instruction following15371321Claude Opus 5.5
LMArena Text: creative writing15351345Claude Opus 5.5
LMArena Vision13211165Claude Opus 5.5
LMArena Text: English15191377Claude Opus 5.5
LMArena Text: non-English15071334Claude Opus 5.5
LMArena Text: Chinese15821346Claude Opus 5.5
LMArena Text: GermanNot measured1362Only Gemma 3 27B measured
LMArena Text: Japanese15341287Claude Opus 5.5
LMArena Text: KoreanNot measured1308Only Gemma 3 27B measured
LMArena Text: French14931368Claude Opus 5.5
LMArena Text: Spanish15081349Claude Opus 5.5
LMArena Text: Russian15171349Claude Opus 5.5
LMArena Text: PolishNot measured1345Only Gemma 3 27B measured
LMArena Text: multi-turn15011345Claude Opus 5.5
LMArena Text: longer queries15321333Claude Opus 5.5
LMArena Text: writing and language15321347Claude Opus 5.5
LMArena Text: entertainment and media15151320Claude Opus 5.5
LMArena Vision: English13171188Claude Opus 5.5
LMArena Vision: ChineseNot measured1164Only Gemma 3 27B measured
LMArena Vision: reading text13261156Claude Opus 5.5
LMArena Vision: humorNot measured1166Only Gemma 3 27B measured
LMArena Vision: captioningNot measured1151Only Gemma 3 27B measured
LMArena Vision: recognizing thingsNot measured1196Only Gemma 3 27B measured
LMArena Vision: creative writing13201177Claude Opus 5.5
Neither model has a result on the other 9 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Opus 5.5 and Gemma 3 27B
BenchmarkClaude Opus 5.5Gemma 3 27BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Opus 5.5$0.014Fits in one request
Gemma 3 27B$0.0003Fits in one request

Gemma 3 27B costs less

Repository review

50K input + 3K output tokens

Claude Opus 5.5$0.260Fits in one request
Gemma 3 27B$0.0050Fits in one request

Gemma 3 27B costs less

Agent loop

200K input + 10K output tokens

Claude Opus 5.5$1.00Fits in one request
Gemma 3 27B$0.019Exceeds the context window

Gemma 3 27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Opus 5.5 and Gemma 3 27B
SpecificationAnthropic Claude Opus 5.5Google Gemma 3 27B
MakerAnthropicGoogle
WeightsNo public weights listedOpen weights
ReleasedSeptember 22, 2026March 12, 2025
Context window1M131K
Input $/Mtok$4.00$0.08
Output $/Mtok$20.00$0.35
Coding index92.24.9
Independent measurements behind it21
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Opus 5.5 better than Gemma 3 27B for coding?

Pick Claude Opus 5.5 for coding: it scores 92.2 on the Vibe Coding Index against 4.9 for Gemma 3 27B. Pick Gemma 3 27B when output tokens cost 57.1x less.

Which is cheaper, Claude Opus 5.5 or Gemma 3 27B?

Claude Opus 5.5 costs $4.00 per million input tokens and $20.00 per million output tokens; Gemma 3 27B costs $0.08 and $0.35. Cost per solved task is known for neither of them.

Which has the bigger context window, Claude Opus 5.5 or Gemma 3 27B?

Claude Opus 5.5, with 1M tokens against 131K.

How many benchmarks is the Claude Opus 5.5 vs Gemma 3 27B comparison based on?

40 benchmarks have a result for both models as of October 21, 2026. Claude Opus 5.5's coding index rests on 2 independent benchmarks and Gemma 3 27B's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next