LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Gemma 4 26B A4B vs Step 5 Preview

Updated October 21, 2026. 36 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Gemma 4 26B A4BGoogle
Coding
22.8
Overall
16.7
Output $/M
$0.255
7
Step 5 PreviewStepFun
Coding
71.4
Overall
43.7
Output $/M
$2.70
29
vs boards won of 36 shared

Decision reading

Pick Step 5 Preview for coding: it scores 71.4 on the Vibe Coding Index against 22.8 for Gemma 4 26B A4B.

Pick Gemma 4 26B A4B when output tokens cost 10.6x less, or when what matters is LMArena Vision: homework or LMArena Text: math, where it leads.

Shared results
36
Gemma 4 26B A4B only
18
Step 5 Preview only
25
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Gemma 4 26B A4B 22.8 from 1 benchmark, Step 5 Preview 71.4 from 2 benchmarks.
Widest category
Intelligence, 27.0 points apart on average over 1 shared benchmark.
Widest single gap
LMArena WebDev: React: Gemma 4 26B A4B 1351 against Step 5 Preview 1583, 38.7 points apart on a 0 to 100 scale.
Output price
Gemma 4 26B A4B $0.255 against Step 5 Preview $2.70 per million output tokens, 10.6x apart.
Context window
Gemma 4 26B A4B takes 262K tokens, Step 5 Preview 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGemma 4 26B A4BBarsStep 5 PreviewTies
Coding06
Intelligence01
Reasoning15
Math20
Knowledge13
General314
All shared boards729
CodingLike-for-likeFour of these boards feed the Vibe Coding Index06
Coding benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
LiveBench codingNot measured85.6%Only Step 5 Preview measured
LMArena WebDev13601567Step 5 Preview
AA Coding Index39.3Not measuredOnly Gemma 4 26B A4B measured
Terminal-Bench 4 (Vals AI)Not measured31.8%Only Step 5 Preview measured
Vibe Code Bench (Vals AI)Not measured70.4%Only Step 5 Preview measured
Code migration (Vals AI)Not measured39.0%Only Step 5 Preview measured
IOI (Vals AI)Not measured38.1%Only Step 5 Preview measured
SWE-bench Multimodal (Vals AI)Not measured40.8%Only Step 5 Preview measured
SciCode40.0%58.9%Step 5 Preview
Terminal-Bench Hard (Artificial Analysis run)25.0%Not measuredOnly Gemma 4 26B A4B measured
WeirdML35.2%Not measuredOnly Gemma 4 26B A4B measured
ALE-Bench927.2Not measuredOnly Gemma 4 26B A4B measured
LMArena Text: coding14461485Step 5 Preview
LMArena Text: software and IT14541473Step 5 Preview
LMArena WebDev: React13511583Step 5 Preview
LMArena WebDev: HTML13621556Step 5 Preview
LMArena WebDev: from an imageNot measured1550Only Step 5 Preview measured
Neither model has a result on the other 21 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
AA Intelligence Index16.743.7Step 5 Preview
Epoch Capabilities Index141.9Not measuredOnly Gemma 4 26B A4B measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index13 boards, none shared
Agentic work benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
AA Agentic Index2.9Not measuredOnly Gemma 4 26B A4B measured
LiveBench researchNot measured72.8%Only Step 5 Preview measured
LiveBench browserNot measured24.0%Only Step 5 Preview measured
LiveBench long agenticNot measured27.5%Only Step 5 Preview measured
SREBench (Vals AI)Not measured0.4%Only Step 5 Preview measured
Finance Agent (Vals AI)Not measured50.7%Only Step 5 Preview measured
Tax Agent Bench (Vals AI)Not measured27.3%Only Step 5 Preview measured
Legal Research Bench (Vals AI)Not measured40.4%Only Step 5 Preview measured
Excel Modeling Benchmark (Vals AI)Not measured57.1%Only Step 5 Preview measured
BioMysteryBench (Vals AI)Not measured67.4%Only Step 5 Preview measured
Terminal-Bench-Science (Vals AI)Not measured2.9%Only Step 5 Preview measured
Vals Science IndexNot measured29.6%Only Step 5 Preview measured
τ²-Bench Telecom43.6%Not measuredOnly Gemma 4 26B A4B measured
Neither model has a result on the other 26 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index15
Reasoning benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
LiveBench reasoningNot measured83.8%Only Step 5 Preview measured
MysteryMechanism (Vals AI)Not measured18.5%Only Step 5 Preview measured
GPQA Diamond (Artificial Analysis run)79.2%Not measuredOnly Gemma 4 26B A4B measured
Humanity's Last Exam (Artificial Analysis run)19.3%46.5%Step 5 Preview
GPQA Diamond (Epoch AI run)73.2%Not measuredOnly Gemma 4 26B A4B measured
LMArena Text: hard prompts14381461Step 5 Preview
LMArena Text: expert14471485Step 5 Preview
LMArena Text: hard prompts in English14481454Step 5 Preview
LMArena Vision: diagrams12641308Step 5 Preview
LMArena Vision: homework12931265Gemma 4 26B A4B
Neither model has a result on the other 11 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index20
Math benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
OTIS Mock AIME82.2%Not measuredOnly Gemma 4 26B A4B measured
ProofBenchNot measured42.0%Only Step 5 Preview measured
LMArena Text: math14701458Gemma 4 26B A4B
LMArena Text: mathematical work14751460Gemma 4 26B A4B
Neither model has a result on the other 9 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index13
Knowledge benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
LMArena Text: science14461454Step 5 Preview
LMArena Text: medicine and healthcare14281439Step 5 Preview
LMArena Text: legal and government14571437Gemma 4 26B A4B
LMArena Text: business and finance14291435Step 5 Preview
Neither model has a result on the other 13 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index1 board, none shared
Web design benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
LiveBench designNot measured76.9%Only Step 5 Preview measured
Neither model has a result on the other 8 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index314
General benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
LiveBench data analysisNot measured63.5%Only Step 5 Preview measured
Public Benefits Bench (Vals AI)Not measured58.1%Only Step 5 Preview measured
IFBench72.4%Not measuredOnly Gemma 4 26B A4B measured
Long context reasoning (AA-LCR)65.7%88.3%Step 5 Preview
DTBench74.9%Not measuredOnly Gemma 4 26B A4B measured
LMCA29.7%Not measuredOnly Gemma 4 26B A4B measured
LMArena Text14341440Step 5 Preview
LMArena Text: instruction following14201438Step 5 Preview
LMArena Text: creative writing14001409Step 5 Preview
LMArena Vision12601265Step 5 Preview
LMArena Text: English14441447Step 5 Preview
LMArena Text: non-English14211428Step 5 Preview
LMArena Text: Chinese14951500Step 5 Preview
LMArena Text: JapaneseNot measured1383Only Step 5 Preview measured
LMArena Text: French14601438Gemma 4 26B A4B
LMArena Text: Spanish14151441Step 5 Preview
LMArena Text: Russian14341433Gemma 4 26B A4B
LMArena Text: multi-turn14411437Gemma 4 26B A4B
LMArena Text: longer queries14271449Step 5 Preview
LMArena Text: writing and language14051425Step 5 Preview
LMArena Text: entertainment and media14031412Step 5 Preview
LMArena Vision: English12561290Step 5 Preview
LMArena Vision: Chinese1312Not measuredOnly Gemma 4 26B A4B measured
LMArena Vision: reading text12681282Step 5 Preview
LMArena Vision: humor1272Not measuredOnly Gemma 4 26B A4B measured
LMArena Vision: captioning1297Not measuredOnly Gemma 4 26B A4B measured
LMArena Vision: recognizing things1191Not measuredOnly Gemma 4 26B A4B measured
LMArena Vision: creative writing1256Not measuredOnly Gemma 4 26B A4B measured
Neither model has a result on the other 18 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Gemma 4 26B A4B and Step 5 Preview
BenchmarkGemma 4 26B A4BStep 5 PreviewLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemma 4 26B A4B$0.0002Fits in one request
Step 5 Preview$0.0024Fits in one request

Gemma 4 26B A4B costs less

Repository review

50K input + 3K output tokens

Gemma 4 26B A4B$0.0046Fits in one request
Step 5 Preview$0.058Fits in one request

Gemma 4 26B A4B costs less

Agent loop

200K input + 10K output tokens

Gemma 4 26B A4B$0.018Fits in one request
Step 5 Preview$0.227Fits in one request

Gemma 4 26B A4B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemma 4 26B A4B and Step 5 Preview
SpecificationGoogle Gemma 4 26B A4BStepFun Step 5 Preview
MakerGoogleStepFun
WeightsOpen weightsOpen weights
ReleasedApril 3, 2026October 8, 2026
Context window262K1.05M
Input $/Mtok$0.0765$1.00
Output $/Mtok$0.255$2.70
Coding index22.871.4
Independent measurements behind it12
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Gemma 4 26B A4B better than Step 5 Preview for coding?

Pick Step 5 Preview for coding: it scores 71.4 on the Vibe Coding Index against 22.8 for Gemma 4 26B A4B. Pick Gemma 4 26B A4B when output tokens cost 10.6x less, or when what matters is LMArena Vision: homework or LMArena Text: math, where it leads.

Which is cheaper, Gemma 4 26B A4B or Step 5 Preview?

Gemma 4 26B A4B costs $0.0765 per million input tokens and $0.255 per million output tokens; Step 5 Preview costs $1.00 and $2.70. Cost per solved task is known for neither of them.

Which has the bigger context window, Gemma 4 26B A4B or Step 5 Preview?

Step 5 Preview, with 1.05M tokens against 262K.

How many benchmarks is the Gemma 4 26B A4B vs Step 5 Preview comparison based on?

36 benchmarks have a result for both models as of October 21, 2026. Gemma 4 26B A4B's coding index rests on 1 independent benchmark and Step 5 Preview's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next