LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

DeepSeek V4.1 Flash 1017 vs GPT-5.4 Mini

Updated October 21, 2026. 15 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

DeepSeek V4.1 Flash 1017DeepSeek
Coding
83.3
Overall
39.5
Output $/M
$0.60
15
GPT-5.4 MiniOpenAI
Coding
28.2
Overall
24.1
Output $/M
$4.50
0
vs boards won of 15 shared

Decision reading

Pick DeepSeek V4.1 Flash 1017 for coding: it scores 83.3 on the Vibe Coding Index against 28.2 for GPT-5.4 Mini.

GPT-5.4 Mini is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Shared results
15
DeepSeek V4.1 Flash 1017 only
17
GPT-5.4 Mini only
73
Like-for-like categories
5 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
DeepSeek V4.1 Flash 1017 83.3 from 2 benchmarks, GPT-5.4 Mini 28.2 from 1 benchmark.
Widest category
Coding, 27.8 points apart on average over 8 shared benchmarks.
Widest single gap
Vibe Code Bench (Vals AI): DeepSeek V4.1 Flash 1017 87.7% against GPT-5.4 Mini 48.0%, 39.8 points apart on a 0 to 100 scale.
Output price
DeepSeek V4.1 Flash 1017 $0.60 against GPT-5.4 Mini $4.50 per million output tokens, 7.5x apart.
Context window
DeepSeek V4.1 Flash 1017 takes 1.05M tokens, GPT-5.4 Mini 400K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDeepSeek V4.1 Flash 1017BarsGPT-5.4 MiniTies
Coding80
Intelligence10
Agentic work40
Reasoning10
General10
All shared boards150
CodingLike-for-likeFour of these boards feed the Vibe Coding Index80
Coding benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
LiveBench coding96.0%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LMArena WebDev16641397DeepSeek V4.1 Flash 1017
AA Coding IndexNot measured56.1Only GPT-5.4 Mini measured
LiveCodeBench (Vals AI)Not measured81.5%Only GPT-5.4 Mini measured
SWE-bench Verified (Vals AI)Not measured73.0%Only GPT-5.4 Mini measured
Terminal-Bench 4 (Vals AI)31.8%2.5%DeepSeek V4.1 Flash 1017
Vibe Code Bench (Vals AI)87.7%48.0%DeepSeek V4.1 Flash 1017
Code migration (Vals AI)44.2%12.9%DeepSeek V4.1 Flash 1017
ProgramBench (Vals AI)Not measured0.0%Only GPT-5.4 Mini measured
Terminal-Bench 2.1 (Vals AI)Not measured54.7%Only GPT-5.4 Mini measured
SciCode55.9%52.1%DeepSeek V4.1 Flash 1017
Terminal-Bench Hard (Artificial Analysis run)Not measured52.3%Only GPT-5.4 Mini measured
FrontierCodeNot measured27.0%Only GPT-5.4 Mini measured
WeirdMLNot measured60.3%Only GPT-5.4 Mini measured
ALE-Bench1622.01188.6DeepSeek V4.1 Flash 1017
LMArena Text: codingNot measured1438Only GPT-5.4 Mini measured
LMArena Text: software and ITNot measured1436Only GPT-5.4 Mini measured
LMArena WebDev: React16671386DeepSeek V4.1 Flash 1017
LMArena WebDev: HTML16871419DeepSeek V4.1 Flash 1017
Neither model has a result on the other 19 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
AA Intelligence Index39.524.1DeepSeek V4.1 Flash 1017
Epoch Capabilities IndexNot measured148.7Only GPT-5.4 Mini measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index40
Agentic work benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
AA Agentic IndexNot measured17.9Only GPT-5.4 Mini measured
Design Arena: spreadsheets1238Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench research79.5%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench browser76.0%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench long agentic50.9%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Finance Agent (Vals AI)57.0%45.4%DeepSeek V4.1 Flash 1017
Tax Agent Bench (Vals AI)44.4%8.8%DeepSeek V4.1 Flash 1017
Legal Research Bench (Vals AI)45.2%12.5%DeepSeek V4.1 Flash 1017
Harvey's Legal Agent Benchmark (Vals AI)14.2%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Excel Modeling Benchmark (Vals AI)61.8%45.4%DeepSeek V4.1 Flash 1017
τ²-Bench TelecomNot measured83.3%Only GPT-5.4 Mini measured
DeepResearch BenchNot measured36.3%Only GPT-5.4 Mini measured
Neither model has a result on the other 27 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index10
Reasoning benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
GPQA DiamondNot measured83.1%Only GPT-5.4 Mini measured
LiveBench reasoning89.1%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
MMMU Pro (Vals AI)Not measured79.3%Only GPT-5.4 Mini measured
GPQA Diamond (Artificial Analysis run)Not measured87.5%Only GPT-5.4 Mini measured
Humanity's Last Exam (Artificial Analysis run)43.3%28.1%DeepSeek V4.1 Flash 1017
GPQA Diamond (Epoch AI run)Not measured86.9%Only GPT-5.4 Mini measured
ARC-AGINot measured63.7%Only GPT-5.4 Mini measured
ARC-AGI-2Not measured18.9%Only GPT-5.4 Mini measured
Chess puzzlesNot measured23.0%Only GPT-5.4 Mini measured
Mystery game puzzlesNot measured11.0%Only GPT-5.4 Mini measured
LMArena Text: hard promptsNot measured1424Only GPT-5.4 Mini measured
LMArena Text: expertNot measured1435Only GPT-5.4 Mini measured
LMArena Text: hard prompts in EnglishNot measured1420Only GPT-5.4 Mini measured
LMArena Vision: diagramsNot measured1266Only GPT-5.4 Mini measured
LMArena Vision: homeworkNot measured1285Only GPT-5.4 Mini measured
Neither model has a result on the other 6 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index7 boards, none shared
Math benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
AIMENot measured95.6%Only GPT-5.4 Mini measured
OTIS Mock AIMENot measured88.9%Only GPT-5.4 Mini measured
FrontierMath, tiers 1 to 3Not measured51.2%Only GPT-5.4 Mini measured
FrontierMath, tier 4Not measured9.8%Only GPT-5.4 Mini measured
ProofBenchNot measured21.0%Only GPT-5.4 Mini measured
LMArena Text: mathNot measured1418Only GPT-5.4 Mini measured
LMArena Text: mathematical workNot measured1429Only GPT-5.4 Mini measured
Neither model has a result on the other 6 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index10 boards, none shared
Knowledge benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
MMLU ProNot measured84.5%Only GPT-5.4 Mini measured
CaseLaw (Vals AI)Not measured51.7%Only GPT-5.4 Mini measured
CorpFin (Vals AI)Not measured60.9%Only GPT-5.4 Mini measured
TaxEval (Vals AI)Not measured71.2%Only GPT-5.4 Mini measured
MortgageTax (Vals AI)Not measured63.5%Only GPT-5.4 Mini measured
SimpleQA VerifiedNot measured29.4%Only GPT-5.4 Mini measured
LMArena Text: scienceNot measured1417Only GPT-5.4 Mini measured
LMArena Text: medicine and healthcareNot measured1395Only GPT-5.4 Mini measured
LMArena Text: legal and governmentNot measured1414Only GPT-5.4 Mini measured
LMArena Text: business and financeNot measured1418Only GPT-5.4 Mini measured
Neither model has a result on the other 7 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
Design Arena: websites1312Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: UI components1305Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: game dev1365Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: data viz1330Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: 3D1368Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: all code categories1335Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Design Arena: ASCII art1244Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench design83.4%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index10
General benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
Vals Index61.3%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
LiveBench data analysis79.5%Not measuredOnly DeepSeek V4.1 Flash 1017 measured
SAGE (Vals AI)Not measured50.8%Only GPT-5.4 Mini measured
Vals Multimodal IndexNot measured54.2%Only GPT-5.4 Mini measured
IFBenchNot measured73.3%Only GPT-5.4 Mini measured
Long context reasoning (AA-LCR)82.7%77.0%DeepSeek V4.1 Flash 1017
DTBenchNot measured80.0%Only GPT-5.4 Mini measured
LMCANot measured40.8%Only GPT-5.4 Mini measured
LMArena TextNot measured1412Only GPT-5.4 Mini measured
LMArena Text: instruction followingNot measured1405Only GPT-5.4 Mini measured
LMArena Text: creative writingNot measured1370Only GPT-5.4 Mini measured
LMArena VisionNot measured1245Only GPT-5.4 Mini measured
LMArena Text: EnglishNot measured1412Only GPT-5.4 Mini measured
LMArena Text: non-EnglishNot measured1405Only GPT-5.4 Mini measured
LMArena Text: ChineseNot measured1446Only GPT-5.4 Mini measured
LMArena Text: GermanNot measured1408Only GPT-5.4 Mini measured
LMArena Text: JapaneseNot measured1375Only GPT-5.4 Mini measured
LMArena Text: KoreanNot measured1370Only GPT-5.4 Mini measured
LMArena Text: FrenchNot measured1441Only GPT-5.4 Mini measured
LMArena Text: SpanishNot measured1405Only GPT-5.4 Mini measured
LMArena Text: RussianNot measured1417Only GPT-5.4 Mini measured
LMArena Text: PolishNot measured1415Only GPT-5.4 Mini measured
LMArena Text: multi-turnNot measured1429Only GPT-5.4 Mini measured
LMArena Text: longer queriesNot measured1408Only GPT-5.4 Mini measured
LMArena Text: writing and languageNot measured1393Only GPT-5.4 Mini measured
LMArena Text: entertainment and mediaNot measured1373Only GPT-5.4 Mini measured
LMArena Vision: EnglishNot measured1244Only GPT-5.4 Mini measured
LMArena Vision: ChineseNot measured1286Only GPT-5.4 Mini measured
LMArena Vision: reading textNot measured1253Only GPT-5.4 Mini measured
LMArena Vision: humorNot measured1235Only GPT-5.4 Mini measured
LMArena Vision: recognizing thingsNot measured1218Only GPT-5.4 Mini measured
LMArena Vision: creative writingNot measured1222Only GPT-5.4 Mini measured
Neither model has a result on the other 14 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
BenchmarkDeepSeek V4.1 Flash 1017GPT-5.4 MiniLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

DeepSeek V4.1 Flash 1017$0.0004Fits in one request
GPT-5.4 Mini$0.0030Fits in one request

DeepSeek V4.1 Flash 1017 costs less

Repository review

50K input + 3K output tokens

DeepSeek V4.1 Flash 1017$0.0093Fits in one request
GPT-5.4 Mini$0.051Fits in one request

DeepSeek V4.1 Flash 1017 costs less

Agent loop

200K input + 10K output tokens

DeepSeek V4.1 Flash 1017$0.036Fits in one request
GPT-5.4 Mini$0.195Fits in one request

DeepSeek V4.1 Flash 1017 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of DeepSeek V4.1 Flash 1017 and GPT-5.4 Mini
SpecificationDeepSeek V4.1 Flash 1017OpenAI GPT-5.4 Mini
MakerDeepSeekOpenAI
WeightsOpen weightsNo public weights listed
ReleasedOctober 17, 2026March 17, 2026
Context window1.05M400K
Input $/Mtok$0.15$0.75
Output $/Mtok$0.60$4.50
Coding index83.328.2
Independent measurements behind it21
Cost per solved taskNot computable$0.70
SourceOpenRouter listingOpenRouter listing

Questions

Is DeepSeek V4.1 Flash 1017 better than GPT-5.4 Mini for coding?

Pick DeepSeek V4.1 Flash 1017 for coding: it scores 83.3 on the Vibe Coding Index against 28.2 for GPT-5.4 Mini. GPT-5.4 Mini is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Which is cheaper, DeepSeek V4.1 Flash 1017 or GPT-5.4 Mini?

DeepSeek V4.1 Flash 1017 costs $0.15 per million input tokens and $0.60 per million output tokens; GPT-5.4 Mini costs $0.75 and $4.50. Cost per solved task is known for GPT-5.4 Mini only.

Which has the bigger context window, DeepSeek V4.1 Flash 1017 or GPT-5.4 Mini?

DeepSeek V4.1 Flash 1017, with 1.05M tokens against 400K.

How many benchmarks is the DeepSeek V4.1 Flash 1017 vs GPT-5.4 Mini comparison based on?

15 benchmarks have a result for both models as of October 21, 2026. DeepSeek V4.1 Flash 1017's coding index rests on 2 independent benchmarks and GPT-5.4 Mini's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next