LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

DeepSeek V4 Flash 0423 vs Devstral 2 2512

Updated October 21, 2026. 3 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

DeepSeek V4 Flash 0423DeepSeek
Coding
54.6
Overall
24.4
Output $/M
$0.182
3
Devstral 2 2512Mistral AI
Coding
53.8
Overall
8.6
Output $/M
$2.00
0
vs boards won of 3 shared

Decision reading

DeepSeek V4 Flash 0423 and Devstral 2 2512 are level for coding, 54.6 against 53.8 on the Vibe Coding Index, so price and context decide.

Devstral 2 2512 is neither cheaper nor larger in context, and leads no benchmark both models were measured on. Pick DeepSeek V4 Flash 0423 when output tokens cost 11.0x less, or when the context window is larger, 1.05M against 262K tokens.

Shared results
3
DeepSeek V4 Flash 0423 only
45
Devstral 2 2512 only
3
Like-for-like categories
3 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
DeepSeek V4 Flash 0423 54.6 from 1 benchmark, Devstral 2 2512 53.8 from 1 benchmark.
Widest category
Agentic work, 24.0 points apart on average over 1 shared benchmark.
Widest single gap
AA Agentic Index: DeepSeek V4 Flash 0423 26.3 against Devstral 2 2512 2.3, 24.0 points apart on a 0 to 100 scale.
Output price
DeepSeek V4 Flash 0423 $0.182 against Devstral 2 2512 $2.00 per million output tokens, 11.0x apart.
Context window
DeepSeek V4 Flash 0423 takes 1.05M tokens, Devstral 2 2512 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDeepSeek V4 Flash 0423BarsDevstral 2 2512Ties
Coding10
Intelligence10
Agentic work10
All shared boards30
CodingLike-for-likeFour of these boards feed the Vibe Coding Index10
Coding benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
SWE-bench VerifiedNot measured53.8%Only Devstral 2 2512 measured
LMArena WebDev1582Not measuredOnly DeepSeek V4 Flash 0423 measured
AA Coding Index52.031.3DeepSeek V4 Flash 0423
LiveCodeBench (Vals AI)Not measured51.8%Only Devstral 2 2512 measured
SWE-bench Verified (Vals AI)Not measured62.8%Only Devstral 2 2512 measured
WeirdML45.6%Not measuredOnly DeepSeek V4 Flash 0423 measured
ALE-Bench678.2Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: coding1457Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: software and IT1453Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena WebDev: React1585Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena WebDev: HTML1558Not measuredOnly DeepSeek V4 Flash 0423 measured
Neither model has a result on the other 27 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
AA Intelligence Index24.48.6DeepSeek V4 Flash 0423
Epoch Capabilities Index146.1Not measuredOnly DeepSeek V4 Flash 0423 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
AA Agentic Index26.32.3DeepSeek V4 Flash 0423
Neither model has a result on the other 38 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index4 boards, none shared
Reasoning benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
SimpleBench46.3%Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: hard prompts1444Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: expert1441Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: hard prompts in English1449Not measuredOnly DeepSeek V4 Flash 0423 measured
Neither model has a result on the other 17 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index2 boards, none shared
Math benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
LMArena Text: math1426Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: mathematical work1432Not measuredOnly DeepSeek V4 Flash 0423 measured
Neither model has a result on the other 11 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index4 boards, none shared
Knowledge benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
LMArena Text: science1446Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: medicine and healthcare1448Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: legal and government1439Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: business and finance1425Not measuredOnly DeepSeek V4 Flash 0423 measured
Neither model has a result on the other 13 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
Design Arena: websites1208Not measuredOnly DeepSeek V4 Flash 0423 measured
Design Arena: UI components1164Not measuredOnly DeepSeek V4 Flash 0423 measured
Design Arena: game dev1197Not measuredOnly DeepSeek V4 Flash 0423 measured
Design Arena: data viz1127Not measuredOnly DeepSeek V4 Flash 0423 measured
Design Arena: 3D1189Not measuredOnly DeepSeek V4 Flash 0423 measured
Design Arena: all code categories1205Not measuredOnly DeepSeek V4 Flash 0423 measured
Design Arena: SVG1155Not measuredOnly DeepSeek V4 Flash 0423 measured
Design Arena: ASCII art1109Not measuredOnly DeepSeek V4 Flash 0423 measured
Neither model has a result on the other 1 board here
GeneralDirectional onlyPublic boards, shown as published, kept out of the index19 boards, none shared
General benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
DTBench86.4%Not measuredOnly DeepSeek V4 Flash 0423 measured
LMCA35.9%Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text1432Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: instruction following1421Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: creative writing1403Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: English1441Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: non-English1419Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: Chinese1463Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: German1419Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: Japanese1389Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: Korean1383Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: French1439Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: Spanish1436Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: Russian1427Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: Polish1436Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: multi-turn1449Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: longer queries1434Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: writing and language1410Not measuredOnly DeepSeek V4 Flash 0423 measured
LMArena Text: entertainment and media1400Not measuredOnly DeepSeek V4 Flash 0423 measured
Neither model has a result on the other 27 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for DeepSeek V4 Flash 0423 and Devstral 2 2512
BenchmarkDeepSeek V4 Flash 0423Devstral 2 2512Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

DeepSeek V4 Flash 0423$0.0002Fits in one request
Devstral 2 2512$0.0014Fits in one request

DeepSeek V4 Flash 0423 costs less

Repository review

50K input + 3K output tokens

DeepSeek V4 Flash 0423$0.0051Fits in one request
Devstral 2 2512$0.026Fits in one request

DeepSeek V4 Flash 0423 costs less

Agent loop

200K input + 10K output tokens

DeepSeek V4 Flash 0423$0.020Fits in one request
Devstral 2 2512$0.100Fits in one request

DeepSeek V4 Flash 0423 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of DeepSeek V4 Flash 0423 and Devstral 2 2512
SpecificationDeepSeek V4 Flash 0423Mistral Devstral 2 2512
MakerDeepSeekMistral AI
WeightsOpen weightsOpen weights
ReleasedApril 24, 2026December 9, 2025
Context window1.05M262K
Input $/Mtok$0.091$0.40
Output $/Mtok$0.182$2.00
Coding index54.653.8
Independent measurements behind it11
Cost per solved taskNot computable$1.19
SourceOpenRouter listingOpenRouter listing

Questions

Is DeepSeek V4 Flash 0423 better than Devstral 2 2512 for coding?

DeepSeek V4 Flash 0423 and Devstral 2 2512 are level for coding, 54.6 against 53.8 on the Vibe Coding Index, so price and context decide. Devstral 2 2512 is neither cheaper nor larger in context, and leads no benchmark both models were measured on. Pick DeepSeek V4 Flash 0423 when output tokens cost 11.0x less, or when the context window is larger, 1.05M against 262K tokens.

Which is cheaper, DeepSeek V4 Flash 0423 or Devstral 2 2512?

DeepSeek V4 Flash 0423 costs $0.091 per million input tokens and $0.182 per million output tokens; Devstral 2 2512 costs $0.40 and $2.00. Cost per solved task is known for Devstral 2 2512 only.

Which has the bigger context window, DeepSeek V4 Flash 0423 or Devstral 2 2512?

DeepSeek V4 Flash 0423, with 1.05M tokens against 262K.

How many benchmarks is the DeepSeek V4 Flash 0423 vs Devstral 2 2512 comparison based on?

3 benchmarks have a result for both models as of October 21, 2026. DeepSeek V4 Flash 0423's coding index rests on 1 independent benchmark and Devstral 2 2512's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next