LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

DeepSeek V4.1 Flash 1017 vs Gemma 4 26B A4B

Updated October 21, 2026. 8 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

DeepSeek V4.1 Flash 1017DeepSeek
Coding
83.3
Overall
39.5
Output $/M
$0.60
8
Gemma 4 26B A4BGoogle
Coding
22.8
Overall
16.7
Output $/M
$0.255
0
vs boards won of 8 shared

Decision reading

Pick DeepSeek V4.1 Flash 1017 for coding: it scores 83.3 on the Vibe Coding Index against 22.8 for Gemma 4 26B A4B.

Pick Gemma 4 26B A4B when output tokens cost 2.4x less.

Shared results
8
DeepSeek V4.1 Flash 1017 only
24
Gemma 4 26B A4B only
46
Like-for-like categories
4 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
DeepSeek V4.1 Flash 1017 83.3 from 2 benchmarks, Gemma 4 26B A4B 22.8 from 1 benchmark.
Widest category
Coding, 32.8 points apart on average over 5 shared benchmarks.
Widest single gap
LMArena WebDev: DeepSeek V4.1 Flash 1017 1664 against Gemma 4 26B A4B 1360, 43.5 points apart on a 0 to 100 scale.
Output price
DeepSeek V4.1 Flash 1017 $0.60 against Gemma 4 26B A4B $0.255 per million output tokens, 2.4x apart.
Context window
DeepSeek V4.1 Flash 1017 takes 1.05M tokens, Gemma 4 26B A4B 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDeepSeek V4.1 Flash 1017BarsGemma 4 26B A4BTies
Coding50
Intelligence10
Reasoning10
General10
All shared boards80
CodingLike-for-likeFour of these boards feed the Vibe Coding Index50
Coding benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
LiveBench coding96.0%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LMArena WebDev16641360DeepSeek V4.1 Flash 1017
AA Coding IndexNot measured39.3Only Gemma 4 26B A4B measured
Terminal-Bench 4 (Vals AI)31.8%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Vibe Code Bench (Vals AI)87.7%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Code migration (Vals AI)44.2%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
SciCode55.9%40.0%DeepSeek V4.1 Flash 1017
Terminal-Bench Hard (Artificial Analysis run)Not measured25.0%Only Gemma 4 26B A4B measured
WeirdMLNot measured35.2%Only Gemma 4 26B A4B measured
ALE-Bench1622.0927.2DeepSeek V4.1 Flash 1017
LMArena Text: codingNot measured1446Only Gemma 4 26B A4B measured
LMArena Text: software and ITNot measured1454Only Gemma 4 26B A4B measured
LMArena WebDev: React16671351DeepSeek V4.1 Flash 1017
LMArena WebDev: HTML16871362DeepSeek V4.1 Flash 1017
Neither model has a result on the other 24 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
AA Intelligence Index39.516.7DeepSeek V4.1 Flash 1017
Epoch Capabilities IndexNot measured141.9Only Gemma 4 26B A4B measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index11 boards, none shared
Agentic work benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
AA Agentic IndexNot measured2.9Only Gemma 4 26B A4B measured
Design Arena: spreadsheets1238Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench research79.5%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench browser76.0%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench long agentic50.9%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Finance Agent (Vals AI)57.0%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Tax Agent Bench (Vals AI)44.4%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Legal Research Bench (Vals AI)45.2%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Harvey's Legal Agent Benchmark (Vals AI)14.2%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Excel Modeling Benchmark (Vals AI)61.8%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
τ²-Bench TelecomNot measured43.6%Only Gemma 4 26B A4B measured
Neither model has a result on the other 28 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index10
Reasoning benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
LiveBench reasoning89.1%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
GPQA Diamond (Artificial Analysis run)Not measured79.2%Only Gemma 4 26B A4B measured
Humanity's Last Exam (Artificial Analysis run)43.3%19.3%DeepSeek V4.1 Flash 1017
GPQA Diamond (Epoch AI run)Not measured73.2%Only Gemma 4 26B A4B measured
LMArena Text: hard promptsNot measured1438Only Gemma 4 26B A4B measured
LMArena Text: expertNot measured1447Only Gemma 4 26B A4B measured
LMArena Text: hard prompts in EnglishNot measured1448Only Gemma 4 26B A4B measured
LMArena Vision: diagramsNot measured1264Only Gemma 4 26B A4B measured
LMArena Vision: homeworkNot measured1293Only Gemma 4 26B A4B measured
Neither model has a result on the other 12 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index3 boards, none shared
Math benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
OTIS Mock AIMENot measured82.2%Only Gemma 4 26B A4B measured
LMArena Text: mathNot measured1470Only Gemma 4 26B A4B measured
LMArena Text: mathematical workNot measured1475Only Gemma 4 26B A4B measured
Neither model has a result on the other 10 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index4 boards, none shared
Knowledge benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
LMArena Text: scienceNot measured1446Only Gemma 4 26B A4B measured
LMArena Text: medicine and healthcareNot measured1428Only Gemma 4 26B A4B measured
LMArena Text: legal and governmentNot measured1457Only Gemma 4 26B A4B measured
LMArena Text: business and financeNot measured1429Only Gemma 4 26B A4B measured
Neither model has a result on the other 13 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
Design Arena: websites1312Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: UI components1305Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: game dev1365Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: data viz1330Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: 3D1368Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: all code categories1335Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: ASCII art1244Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench design83.4%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index10
General benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
Vals Index61.3%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench data analysis79.5%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
IFBenchNot measured72.4%Only Gemma 4 26B A4B measured
Long context reasoning (AA-LCR)82.7%65.7%DeepSeek V4.1 Flash 1017
DTBenchNot measured74.9%Only Gemma 4 26B A4B measured
LMCANot measured29.7%Only Gemma 4 26B A4B measured
LMArena TextNot measured1434Only Gemma 4 26B A4B measured
LMArena Text: instruction followingNot measured1420Only Gemma 4 26B A4B measured
LMArena Text: creative writingNot measured1400Only Gemma 4 26B A4B measured
LMArena VisionNot measured1260Only Gemma 4 26B A4B measured
LMArena Text: EnglishNot measured1444Only Gemma 4 26B A4B measured
LMArena Text: non-EnglishNot measured1421Only Gemma 4 26B A4B measured
LMArena Text: ChineseNot measured1495Only Gemma 4 26B A4B measured
LMArena Text: FrenchNot measured1460Only Gemma 4 26B A4B measured
LMArena Text: SpanishNot measured1415Only Gemma 4 26B A4B measured
LMArena Text: RussianNot measured1434Only Gemma 4 26B A4B measured
LMArena Text: multi-turnNot measured1441Only Gemma 4 26B A4B measured
LMArena Text: longer queriesNot measured1427Only Gemma 4 26B A4B measured
LMArena Text: writing and languageNot measured1405Only Gemma 4 26B A4B measured
LMArena Text: entertainment and mediaNot measured1403Only Gemma 4 26B A4B measured
LMArena Vision: EnglishNot measured1256Only Gemma 4 26B A4B measured
LMArena Vision: ChineseNot measured1312Only Gemma 4 26B A4B measured
LMArena Vision: reading textNot measured1268Only Gemma 4 26B A4B measured
LMArena Vision: humorNot measured1272Only Gemma 4 26B A4B measured
LMArena Vision: captioningNot measured1297Only Gemma 4 26B A4B measured
LMArena Vision: recognizing thingsNot measured1191Only Gemma 4 26B A4B measured
LMArena Vision: creative writingNot measured1256Only Gemma 4 26B A4B measured
Neither model has a result on the other 19 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
BenchmarkDeepSeek V4.1 Flash 1017Gemma 4 26B A4BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

DeepSeek V4.1 Flash 1017$0.0004Fits in one request
Gemma 4 26B A4B$0.0002Fits in one request

Gemma 4 26B A4B costs less

Repository review

50K input + 3K output tokens

DeepSeek V4.1 Flash 1017$0.0093Fits in one request
Gemma 4 26B A4B$0.0046Fits in one request

Gemma 4 26B A4B costs less

Agent loop

200K input + 10K output tokens

DeepSeek V4.1 Flash 1017$0.036Fits in one request
Gemma 4 26B A4B$0.018Fits in one request

Gemma 4 26B A4B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of DeepSeek V4.1 Flash 1017 and Gemma 4 26B A4B
SpecificationDeepSeek V4.1 Flash 1017Google Gemma 4 26B A4B
MakerDeepSeekGoogle
WeightsOpen weightsOpen weights
ReleasedOctober 17, 2026April 3, 2026
Context window1.05M262K
Input $/Mtok$0.15$0.0765
Output $/Mtok$0.60$0.255
Coding index83.322.8
Independent measurements behind it21
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is DeepSeek V4.1 Flash 1017 better than Gemma 4 26B A4B for coding?

Pick DeepSeek V4.1 Flash 1017 for coding: it scores 83.3 on the Vibe Coding Index against 22.8 for Gemma 4 26B A4B. Pick Gemma 4 26B A4B when output tokens cost 2.4x less.

Which is cheaper, DeepSeek V4.1 Flash 1017 or Gemma 4 26B A4B?

DeepSeek V4.1 Flash 1017 costs $0.15 per million input tokens and $0.60 per million output tokens; Gemma 4 26B A4B costs $0.0765 and $0.255. Cost per solved task is known for neither of them.

Which has the bigger context window, DeepSeek V4.1 Flash 1017 or Gemma 4 26B A4B?

DeepSeek V4.1 Flash 1017, with 1.05M tokens against 262K.

How many benchmarks is the DeepSeek V4.1 Flash 1017 vs Gemma 4 26B A4B comparison based on?

8 benchmarks have a result for both models as of October 21, 2026. DeepSeek V4.1 Flash 1017's coding index rests on 2 independent benchmarks and Gemma 4 26B A4B's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next