Gemma 3 27B vs Grok 4.20

Grok 4.20 leads Gemma 3 27B on the Artificial Analysis Intelligence Index, 25.7 to 4.9, and Gemma 3 27B costs 8.3x less per output token ($0.30 vs $2.50 per million). Updated October 22, 2026; 11 benchmarks have a result for both.

Replace Gemma 3 27B Replace Grok 4.20

Gemma 3 27BGoogle

Coding: No data
Overall: 31.4
Output $/M: $0.30

Grok 4.20xAI

Coding: 33.3
Overall: 41.0
Output $/M: $2.50

vs boards won of 11 shared

Gemma 3 27B or Grok 4.20: which to pick

Only Grok 4.20 has a coding score, 33.3 on the Vibe Coding Index; Gemma 3 27B has none, so the two cannot be ranked on coding.

Pick Gemma 3 27B for output tokens 8.3x cheaper ($0.30 vs $2.50 per million).

Model AGemma 3 27BGoogleNot benchmarkedNo coding benchmarkNo cost per solved task Model BGrok 4.20xAI33.3/1002 independent benchmarks$0.72 per solved task

115544

Shared results: 11
Gemma 3 27B only: 55
Grok 4.20 only: 44
Like-for-like categories: 5 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, six public coding benchmarks
No call
Only Grok 4.20 has a coding score, so no call is made.
One side not measured
Intelligence
AA Intelligence Index
Grok 4.20
Grok 4.20 leads, 25.7 against 4.9.
Same board, both measured
Agentic work
AA Agentic Index
No call
Only Gemma 3 27B has a AA Agentic Index result, 0.1.
Directional only
Reasoning
GPQA Diamond
No call
Only Grok 4.20 has a GPQA Diamond result, 88.6%.
Directional only
Math
AIME
No call
Only Grok 4.20 has a AIME result, 96.5%.
Directional only
Knowledge
MMLU Pro
No call
Only Grok 4.20 has a MMLU Pro result, 86.3%.
Directional only
Web design
Design Arena: websites
No call
Only Grok 4.20 has a Design Arena: websites result, 1229.
Directional only
Long documents
Listed context window
Grok 4.20
Grok 4.20 takes 2M tokens against 131K.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
Gemma 3 27B
Gemma 3 27B $0.0002, Grok 4.20 $0.0025 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
No call
Only Grok 4.20 has the number, $0.72.
Directional only

At a glance

Coding index: Gemma 3 27B not benchmarked, Grok 4.20 33.3 from 2 benchmarks.
Widest category: Agentic work, 82.5 points apart on average over 1 shared benchmark.
Widest single gap: τ²-Bench Telecom: Gemma 3 27B 10.5% against Grok 4.20 93.0%, 82.5 points apart on a 0 to 100 scale.
Output price: Gemma 3 27B $0.30 against Grok 4.20 $2.50 per million output tokens, 8.3x apart.
Context window: Gemma 3 27B takes 131K tokens, Grok 4.20 2M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	Gemma 3 27B	Bars	Grok 4.20	Ties
Coding	0		1
Intelligence	0		2
Agentic work	0		1
Reasoning	0		3
General	0		4
All shared boards	0		11

CodingLike-for-likeSix of these boards feed the Vibe Coding Index01

Coding benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
Aider polyglot	4.9%	Not measured	Only Gemma 3 27B measured
AA Coding Index	10.1	Not measured	Only Gemma 3 27B measured
LiveCodeBench (Vals AI)	Not measured	84.3%	Only Grok 4.20 measured
SWE-bench Verified (Vals AI)	Not measured	72.2%	Only Grok 4.20 measured
Vibe Code Bench (Vals AI)	Not measured	4.1%	Only Grok 4.20 measured
Code migration (Vals AI)	Not measured	0.3%	Only Grok 4.20 measured
Terminal-Bench 2.1 (Vals AI)	Not measured	44.2%	Only Grok 4.20 measured
LiveCodeBench (Artificial Analysis run)	13.7%	Not measured	Only Gemma 3 27B measured
SciCode	23.3%	Not measured	Only Gemma 3 27B measured
Terminal-Bench Hard (Artificial Analysis run)	3.8%	37.9%	Grok 4.20
Terminal-Bench	Not measured	57.3%	Only Grok 4.20 measured
WeirdML	Not measured	52.3%	Only Grok 4.20 measured
LMArena Text: coding	1322	Not measured	Only Gemma 3 27B measured
LMArena Text: software and IT	1354	Not measured	Only Gemma 3 27B measured
SciCode	0.0%	Not measured	Only Gemma 3 27B measured
Neither model has a result on the other 24 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02

Intelligence benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
AA Intelligence Index	4.9	25.7	Grok 4.20
Epoch Capabilities Index	130.0	152.1	Grok 4.20

Agentic workLike-for-likePublic boards, shown as published, kept out of the index01

Agentic work benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
AA Agentic Index	0.1	Not measured	Only Gemma 3 27B measured
Design Arena: agents building web apps	Not measured	1144	Only Grok 4.20 measured
Design Arena: agents building full-stack apps	Not measured	1054	Only Grok 4.20 measured
Design Arena: agents building mobile apps	Not measured	1090	Only Grok 4.20 measured
Design Arena: agents building Android apps	Not measured	1045	Only Grok 4.20 measured
Design Arena: agents building Godot games	Not measured	1089	Only Grok 4.20 measured
Design Arena: HTML slides	Not measured	1180	Only Grok 4.20 measured
Finance Agent (Vals AI)	Not measured	28.5%	Only Grok 4.20 measured
Tax Agent Bench (Vals AI)	Not measured	7.0%	Only Grok 4.20 measured
Legal Research Bench (Vals AI)	Not measured	13.9%	Only Grok 4.20 measured
Excel Modeling Benchmark (Vals AI)	Not measured	11.7%	Only Grok 4.20 measured
τ²-Bench Telecom	10.5%	93.0%	Grok 4.20
Vending-Bench 2	Not measured	$4,663	Only Grok 4.20 measured
Berkeley Function Calling Leaderboard (BFCL)	29.5%	Not measured	Only Gemma 3 27B measured
Neither model has a result on the other 27 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index03

Reasoning benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
GPQA Diamond	Not measured	88.6%	Only Grok 4.20 measured
MMMU Pro (Vals AI)	Not measured	83.5%	Only Grok 4.20 measured
GPQA Diamond (Artificial Analysis run)	42.8%	91.1%	Grok 4.20
Humanity's Last Exam (Artificial Analysis run)	4.4%	34.5%	Grok 4.20
GPQA Diamond (Epoch AI run)	47.7%	Not measured	Only Gemma 3 27B measured
ARC-AGI	Not measured	89.5%	Only Grok 4.20 measured
ARC-AGI-2	Not measured	65.1%	Only Grok 4.20 measured
LMArena Text: hard prompts	1340	Not measured	Only Gemma 3 27B measured
LMArena Text: expert	1304	Not measured	Only Gemma 3 27B measured
LMArena Text: hard prompts in English	1353	Not measured	Only Gemma 3 27B measured
LMArena Vision: diagrams	1156	Not measured	Only Gemma 3 27B measured
LMArena Vision: homework	1160	Not measured	Only Gemma 3 27B measured
Kagi LLM Benchmark	35.1%	75.0%	Grok 4.20
Neither model has a result on the other 9 boards here

MathDirectional onlyPublic boards, shown as published, kept out of the index7 boards, none shared

Math benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
AIME	Not measured	96.5%	Only Grok 4.20 measured
AA Math Index	20.7	Not measured	Only Gemma 3 27B measured
AIME 2025 (Artificial Analysis run)	20.7%	Not measured	Only Gemma 3 27B measured
OTIS Mock AIME	22.5%	Not measured	Only Gemma 3 27B measured
MATH level 5	74.0%	Not measured	Only Gemma 3 27B measured
LMArena Text: math	1312	Not measured	Only Gemma 3 27B measured
LMArena Text: mathematical work	1327	Not measured	Only Gemma 3 27B measured
Neither model has a result on the other 6 boards here

KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index15 boards, none shared

Knowledge benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
MMLU Pro	Not measured	86.3%	Only Grok 4.20 measured
LegalBench (Vals AI)	Not measured	77.7%	Only Grok 4.20 measured
CaseLaw (Vals AI)	Not measured	54.4%	Only Grok 4.20 measured
CorpFin (Vals AI)	Not measured	63.7%	Only Grok 4.20 measured
TaxEval (Vals AI)	Not measured	74.1%	Only Grok 4.20 measured
MortgageTax (Vals AI)	Not measured	45.4%	Only Grok 4.20 measured
MedQA (Vals AI)	Not measured	94.5%	Only Grok 4.20 measured
MedCode (Vals AI)	Not measured	32.2%	Only Grok 4.20 measured
MMLU Pro (Artificial Analysis run)	66.9%	Not measured	Only Gemma 3 27B measured
GeoBench	52.0%	Not measured	Only Gemma 3 27B measured
LMArena Text: science	1383	Not measured	Only Gemma 3 27B measured
LMArena Text: medicine and healthcare	1391	Not measured	Only Gemma 3 27B measured
LMArena Text: legal and government	1375	Not measured	Only Gemma 3 27B measured
LMArena Text: business and finance	1360	Not measured	Only Gemma 3 27B measured
FACTS Benchmark Suite	29.1%	Not measured	Only Gemma 3 27B measured
Neither model has a result on the other 3 boards here

Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared

Web design benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
Design Arena: websites	Not measured	1229	Only Grok 4.20 measured
Design Arena: UI components	Not measured	1200	Only Grok 4.20 measured
Design Arena: game dev	Not measured	1193	Only Grok 4.20 measured
Design Arena: data viz	Not measured	1217	Only Grok 4.20 measured
Design Arena: 3D	Not measured	1193	Only Grok 4.20 measured
Design Arena: all code categories	Not measured	1221	Only Grok 4.20 measured
Design Arena: SVG	Not measured	1165	Only Grok 4.20 measured
Design Arena: ASCII art	Not measured	1175	Only Grok 4.20 measured
Neither model has a result on the other 1 board here

GeneralLike-for-likePublic boards, shown as published, kept out of the index04

General benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
SAGE (Vals AI)	Not measured	38.2%	Only Grok 4.20 measured
MedScribe (Vals AI)	Not measured	63.4%	Only Grok 4.20 measured
Vals Multimodal Index	Not measured	39.1%	Only Grok 4.20 measured
IFBench	31.8%	81.2%	Grok 4.20
Long context reasoning (AA-LCR)	7.3%	69.0%	Grok 4.20
DTBench	52.5%	90.1%	Grok 4.20
LMCA	12.3%	38.7%	Grok 4.20
Fiction.LiveBench	33.3%	Not measured	Only Gemma 3 27B measured
Creative writing (Lech Mazur)	79.9%	Not measured	Only Gemma 3 27B measured
CL-bench	Not measured	22.2%	Only Grok 4.20 measured
CL-bench Life	Not measured	11.9%	Only Grok 4.20 measured
LMArena Text	1358	Not measured	Only Gemma 3 27B measured
LMArena Text: instruction following	1321	Not measured	Only Gemma 3 27B measured
LMArena Text: creative writing	1345	Not measured	Only Gemma 3 27B measured
LMArena Vision	1165	Not measured	Only Gemma 3 27B measured
LMArena Text: English	1377	Not measured	Only Gemma 3 27B measured
LMArena Text: non-English	1334	Not measured	Only Gemma 3 27B measured
LMArena Text: Chinese	1346	Not measured	Only Gemma 3 27B measured
LMArena Text: German	1362	Not measured	Only Gemma 3 27B measured
LMArena Text: Japanese	1287	Not measured	Only Gemma 3 27B measured
LMArena Text: Korean	1308	Not measured	Only Gemma 3 27B measured
LMArena Text: French	1368	Not measured	Only Gemma 3 27B measured
LMArena Text: Spanish	1349	Not measured	Only Gemma 3 27B measured
LMArena Text: Russian	1349	Not measured	Only Gemma 3 27B measured
LMArena Text: Polish	1345	Not measured	Only Gemma 3 27B measured
LMArena Text: multi-turn	1345	Not measured	Only Gemma 3 27B measured
LMArena Text: longer queries	1333	Not measured	Only Gemma 3 27B measured
LMArena Text: writing and language	1347	Not measured	Only Gemma 3 27B measured
LMArena Text: entertainment and media	1320	Not measured	Only Gemma 3 27B measured
LMArena Vision: English	1188	Not measured	Only Gemma 3 27B measured
LMArena Vision: Chinese	1164	Not measured	Only Gemma 3 27B measured
LMArena Vision: reading text	1156	Not measured	Only Gemma 3 27B measured
LMArena Vision: humor	1166	Not measured	Only Gemma 3 27B measured
LMArena Vision: captioning	1151	Not measured	Only Gemma 3 27B measured
LMArena Vision: recognizing things	1196	Not measured	Only Gemma 3 27B measured
LMArena Vision: creative writing	1177	Not measured	Only Gemma 3 27B measured
Neither model has a result on the other 10 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for Gemma 3 27B and Grok 4.20
Benchmark	Gemma 3 27B	Grok 4.20	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemma 3 27B$0.0002Fits in one request

Grok 4.20$0.0025Fits in one request

Gemma 3 27B costs less

Repository review

50K input + 3K output tokens

Gemma 3 27B$0.0049Fits in one request

Grok 4.20$0.070Fits in one request

Gemma 3 27B costs less

Agent loop

200K input + 10K output tokens

Gemma 3 27B$0.019Exceeds the context window

Grok 4.20$0.275Fits in one request

Gemma 3 27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemma 3 27B and Grok 4.20
Specification	Google Gemma 3 27B	SpaceXAI Grok 4.20
Maker	Google	xAI
Weights	Open weights	No public weights listed
Released	March 12, 2025	March 31, 2026
Context window	131K	2M
Input $/Mtok	$0.08	$1.25
Output $/Mtok	$0.30	$2.50
Coding index	Not benchmarked	33.3
Independent measurements behind it	0	2
Cost per solved task	Not computable	$0.72
Source	OpenRouter listing	OpenRouter listing

Questions

Is Gemma 3 27B better than Grok 4.20 for coding?

Only Grok 4.20 has a coding score, 33.3 on the Vibe Coding Index; Gemma 3 27B has none, so the two cannot be ranked on coding. Pick Gemma 3 27B for output tokens 8.3x cheaper ($0.30 vs $2.50 per million).

Which is cheaper, Gemma 3 27B or Grok 4.20?

Gemma 3 27B costs $0.08 per million input tokens and $0.30 per million output tokens; Grok 4.20 costs $1.25 and $2.50. Cost per solved task is known for Grok 4.20 only.

Which has the bigger context window, Gemma 3 27B or Grok 4.20?

Grok 4.20, with 2M tokens against 131K.

How many benchmarks is the Gemma 3 27B vs Grok 4.20 comparison based on?

11 benchmarks have a result for both models as of October 22, 2026. Gemma 3 27B's coding index rests on 0 independent benchmarks and Grok 4.20's on 2. Where only one model has a result, the page says so instead of naming a winner.

Gemma 3 27B or Grok 4.20: which to pick

Which one for your work

Coding

Intelligence

Agentic work

Reasoning

Math

Knowledge

Web design

Long documents

Everyday cost

Cost per solved task

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next