LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

DeepSeek V4 Pro 0423 vs GPT-5.1

Updated October 21, 2026. 63 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

DeepSeek V4 Pro 0423DeepSeek
Coding
35.3
Overall
30.4
Output $/M
$1.9105
44
GPT-5.1OpenAI
Coding
53.3
Overall
24.7
Output $/M
$10.00
19
vs boards won of 63 shared

Decision reading

Pick GPT-5.1 for coding: it scores 53.3 on the Vibe Coding Index against 35.3 for DeepSeek V4 Pro 0423.

Pick DeepSeek V4 Pro 0423 when output tokens cost 5.2x less, or when a solved task costs $0.57 against $1.02.

Shared results
63
DeepSeek V4 Pro 0423 only
20
GPT-5.1 only
37
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
DeepSeek V4 Pro 0423 35.3 from 1 benchmark, GPT-5.1 53.3 from 2 benchmarks.
Widest category
Agentic work, 11.3 points apart on average over 1 shared benchmark.
Widest single gap
Vibe Code Bench (Vals AI): DeepSeek V4 Pro 0423 49.9% against GPT-5.1 24.6%, 25.3 points apart on a 0 to 100 scale.
Output price
DeepSeek V4 Pro 0423 $1.9105 against GPT-5.1 $10.00 per million output tokens, 5.2x apart.
Context window
DeepSeek V4 Pro 0423 takes 1.05M tokens, GPT-5.1 400K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDeepSeek V4 Pro 0423BarsGPT-5.1Ties
Coding91
Intelligence11
Agentic work10
Reasoning43
Math21
Knowledge56
Web design62
General165
All shared boards4419
CodingLike-for-likeFour of these boards feed the Vibe Coding Index91
Coding benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
SWE-bench VerifiedNot measured66.0%Only GPT-5.1 measured
LMArena WebDev14471396DeepSeek V4 Pro 0423
AA Coding Index59.449.4DeepSeek V4 Pro 0423
LiveCodeBench (Vals AI)87.5%86.5%DeepSeek V4 Pro 0423
SWE-bench Verified (Vals AI)77.4%69.8%DeepSeek V4 Pro 0423
Terminal-Bench 4 (Vals AI)11.1%Not measuredOnly DeepSeek V4 Pro 0423 measured
Vibe Code Bench (Vals AI)49.9%24.6%DeepSeek V4 Pro 0423
Code migration (Vals AI)26.2%Not measuredOnly DeepSeek V4 Pro 0423 measured
ProgramBench (Vals AI)0.0%Not measuredOnly DeepSeek V4 Pro 0423 measured
Terminal-Bench 2.1 (Vals AI)50.2%Not measuredOnly DeepSeek V4 Pro 0423 measured
SkillsBench (Vals AI)51.3%Not measuredOnly DeepSeek V4 Pro 0423 measured
LiveCodeBench (Artificial Analysis run)Not measured86.8%Only GPT-5.1 measured
Terminal-Bench Hard (Artificial Analysis run)Not measured45.5%Only GPT-5.1 measured
Terminal-BenchNot measured47.6%Only GPT-5.1 measured
FrontierCode17.6%Not measuredOnly DeepSeek V4 Pro 0423 measured
GSO-BenchNot measured13.7%Only GPT-5.1 measured
WeirdML48.9%60.8%GPT-5.1
ALE-Bench1006.1Not measuredOnly DeepSeek V4 Pro 0423 measured
LMArena Text: coding14701453DeepSeek V4 Pro 0423
LMArena Text: software and IT14691454DeepSeek V4 Pro 0423
LMArena WebDev: React14411307DeepSeek V4 Pro 0423
LMArena WebDev: HTML14351405DeepSeek V4 Pro 0423
LMArena WebDev: from an imageNot measured1421Only GPT-5.1 measured
Neither model has a result on the other 15 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index11
Intelligence benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
AA Intelligence Index30.424.7DeepSeek V4 Pro 0423
Epoch Capabilities Index149.1149.8GPT-5.1
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
AA Agentic Index26.3Not measuredOnly DeepSeek V4 Pro 0423 measured
Design Arena: agents building web apps1000Not measuredOnly DeepSeek V4 Pro 0423 measured
Design Arena: agents building full-stack apps948Not measuredOnly DeepSeek V4 Pro 0423 measured
Design Arena: agents building Godot games1059Not measuredOnly DeepSeek V4 Pro 0423 measured
Finance Agent (Vals AI)44.1%Not measuredOnly DeepSeek V4 Pro 0423 measured
Tax Agent Bench (Vals AI)25.2%Not measuredOnly DeepSeek V4 Pro 0423 measured
Legal Research Bench (Vals AI)23.1%Not measuredOnly DeepSeek V4 Pro 0423 measured
Excel Modeling Benchmark (Vals AI)51.6%Not measuredOnly DeepSeek V4 Pro 0423 measured
τ²-Bench TelecomNot measured81.9%Only GPT-5.1 measured
DeepResearch BenchNot measured42.8%Only GPT-5.1 measured
Vending-Bench 2$3,285$1,473DeepSeek V4 Pro 0423
Neither model has a result on the other 28 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index43
Reasoning benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
GPQA Diamond89.4%86.6%DeepSeek V4 Pro 0423
MMMU Pro (Vals AI)Not measured83.2%Only GPT-5.1 measured
GPQA Diamond (Artificial Analysis run)Not measured87.3%Only GPT-5.1 measured
Humanity's Last Exam (Artificial Analysis run)Not measured28.5%Only GPT-5.1 measured
GPQA Diamond (Epoch AI run)90.9%87.6%DeepSeek V4 Pro 0423
ARC-AGINot measured72.8%Only GPT-5.1 measured
ARC-AGI-2Not measured17.6%Only GPT-5.1 measured
SimpleBenchNot measured53.2%Only GPT-5.1 measured
Chess puzzles19.0%42.0%GPT-5.1
Mystery game puzzles17.0%19.0%GPT-5.1
VPCTNot measured58.7%Only GPT-5.1 measured
LMArena Text: hard prompts14611457DeepSeek V4 Pro 0423
LMArena Text: expert14631470GPT-5.1
LMArena Text: hard prompts in English14661462DeepSeek V4 Pro 0423
LMArena Vision: diagramsNot measured1264Only GPT-5.1 measured
LMArena Vision: homeworkNot measured1272Only GPT-5.1 measured
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index21
Math benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
AIMENot measured93.3%Only GPT-5.1 measured
MGSM (Vals AI)Not measured93.0%Only GPT-5.1 measured
AA Math IndexNot measured94.0Only GPT-5.1 measured
AIME 2025 (Artificial Analysis run)Not measured94.0%Only GPT-5.1 measured
OTIS Mock AIME96.7%88.6%DeepSeek V4 Pro 0423
FrontierMath, tiers 1 to 345.3%Not measuredOnly DeepSeek V4 Pro 0423 measured
FrontierMath, tier 42.4%Not measuredOnly DeepSeek V4 Pro 0423 measured
ProofBench16.0%Not measuredOnly DeepSeek V4 Pro 0423 measured
LMArena Text: math14431446GPT-5.1
LMArena Text: mathematical work14551449DeepSeek V4 Pro 0423
Neither model has a result on the other 3 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index56
Knowledge benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
MMLU Pro87.3%86.4%DeepSeek V4 Pro 0423
LegalBench (Vals AI)80.3%85.7%GPT-5.1
CaseLaw (Vals AI)59.4%73.4%GPT-5.1
CorpFin (Vals AI)61.4%63.8%GPT-5.1
TaxEval (Vals AI)72.1%74.9%GPT-5.1
MortgageTax (Vals AI)Not measured61.4%Only GPT-5.1 measured
MedQA (Vals AI)Not measured96.4%Only GPT-5.1 measured
MedCode (Vals AI)40.5%52.7%GPT-5.1
MMLU Pro (Artificial Analysis run)Not measured87.0%Only GPT-5.1 measured
SimpleQA Verified47.0%48.0%GPT-5.1
LMArena Text: science14701459DeepSeek V4 Pro 0423
LMArena Text: medicine and healthcare14661456DeepSeek V4 Pro 0423
LMArena Text: legal and government14641459DeepSeek V4 Pro 0423
LMArena Text: business and finance14431431DeepSeek V4 Pro 0423
Neither model has a result on the other 3 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index62
Web design benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
Design Arena: websites12351187DeepSeek V4 Pro 0423
Design Arena: UI components12211166DeepSeek V4 Pro 0423
Design Arena: game dev12291179DeepSeek V4 Pro 0423
Design Arena: data viz12031204GPT-5.1
Design Arena: 3D12541061DeepSeek V4 Pro 0423
Design Arena: all code categories12401171DeepSeek V4 Pro 0423
Design Arena: SVG11391149GPT-5.1
Design Arena: ASCII art11481118DeepSeek V4 Pro 0423
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index165
General benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
Public Benefits Bench (Vals AI)62.9%Not measuredOnly DeepSeek V4 Pro 0423 measured
SAGE (Vals AI)Not measured43.2%Only GPT-5.1 measured
MedScribe (Vals AI)75.1%88.1%GPT-5.1
IFBenchNot measured72.9%Only GPT-5.1 measured
Long context reasoning (AA-LCR)Not measured80.0%Only GPT-5.1 measured
DTBench90.7%90.1%DeepSeek V4 Pro 0423
LMCA41.2%43.9%GPT-5.1
CL-benchNot measured23.7%Only GPT-5.1 measured
Surface Evolver Bench40.0%Not measuredOnly DeepSeek V4 Pro 0423 measured
CL-bench Life13.5%17.3%GPT-5.1
LMArena Text14511443DeepSeek V4 Pro 0423
LMArena Text: instruction following14451443DeepSeek V4 Pro 0423
LMArena Text: creative writing14461427DeepSeek V4 Pro 0423
LMArena VisionNot measured1250Only GPT-5.1 measured
LMArena Text: English14591451DeepSeek V4 Pro 0423
LMArena Text: non-English14391431DeepSeek V4 Pro 0423
LMArena Text: Chinese14811495GPT-5.1
LMArena Text: German14581438DeepSeek V4 Pro 0423
LMArena Text: Japanese14461453GPT-5.1
LMArena Text: Korean14091401DeepSeek V4 Pro 0423
LMArena Text: French14731450DeepSeek V4 Pro 0423
LMArena Text: Spanish14571433DeepSeek V4 Pro 0423
LMArena Text: Russian14531435DeepSeek V4 Pro 0423
LMArena Text: Polish14611440DeepSeek V4 Pro 0423
LMArena Text: multi-turn14681450DeepSeek V4 Pro 0423
LMArena Text: longer queries14581448DeepSeek V4 Pro 0423
LMArena Text: writing and language14471428DeepSeek V4 Pro 0423
LMArena Text: entertainment and media14311415DeepSeek V4 Pro 0423
LMArena Vision: EnglishNot measured1252Only GPT-5.1 measured
LMArena Vision: ChineseNot measured1270Only GPT-5.1 measured
LMArena Vision: reading textNot measured1255Only GPT-5.1 measured
LMArena Vision: humorNot measured1263Only GPT-5.1 measured
LMArena Vision: captioningNot measured1252Only GPT-5.1 measured
LMArena Vision: recognizing thingsNot measured1232Only GPT-5.1 measured
LMArena Vision: creative writingNot measured1266Only GPT-5.1 measured
LMArena DocumentNot measured1403Only GPT-5.1 measured
Neither model has a result on the other 10 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for DeepSeek V4 Pro 0423 and GPT-5.1
BenchmarkDeepSeek V4 Pro 0423GPT-5.1Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

DeepSeek V4 Pro 0423$0.0019Fits in one request
GPT-5.1$0.0063Fits in one request

DeepSeek V4 Pro 0423 costs less

Repository review

50K input + 3K output tokens

DeepSeek V4 Pro 0423$0.053Fits in one request
GPT-5.1$0.092Fits in one request

DeepSeek V4 Pro 0423 costs less

Agent loop

200K input + 10K output tokens

DeepSeek V4 Pro 0423$0.210Fits in one request
GPT-5.1$0.350Fits in one request

DeepSeek V4 Pro 0423 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of DeepSeek V4 Pro 0423 and GPT-5.1
SpecificationDeepSeek V4 Pro 0423OpenAI GPT-5.1
MakerDeepSeekOpenAI
WeightsOpen weightsNo public weights listed
ReleasedApril 24, 2026November 13, 2025
Context window1.05M400K
Input $/Mtok$0.9553$1.25
Output $/Mtok$1.9105$10.00
Coding index35.353.3
Independent measurements behind it12
Cost per solved task$0.57$1.02
SourceOpenRouter listingOpenRouter listing

Questions

Is DeepSeek V4 Pro 0423 better than GPT-5.1 for coding?

Pick GPT-5.1 for coding: it scores 53.3 on the Vibe Coding Index against 35.3 for DeepSeek V4 Pro 0423. Pick DeepSeek V4 Pro 0423 when output tokens cost 5.2x less, or when a solved task costs $0.57 against $1.02.

Which is cheaper, DeepSeek V4 Pro 0423 or GPT-5.1?

DeepSeek V4 Pro 0423 costs $0.9553 per million input tokens and $1.9105 per million output tokens; GPT-5.1 costs $1.25 and $10.00. Per solved SWE-bench Verified task, DeepSeek V4 Pro 0423 costs $0.57 and GPT-5.1 $1.02.

Which has the bigger context window, DeepSeek V4 Pro 0423 or GPT-5.1?

DeepSeek V4 Pro 0423, with 1.05M tokens against 400K.

How many benchmarks is the DeepSeek V4 Pro 0423 vs GPT-5.1 comparison based on?

63 benchmarks have a result for both models as of October 21, 2026. DeepSeek V4 Pro 0423's coding index rests on 1 independent benchmark and GPT-5.1's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next