LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

DeepSeek V3 vs GPT-5.1-Codex

Updated October 21, 2026. 5 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

DeepSeek V3DeepSeek
Coding
70.2
Overall
No data
Output $/M
$1.0287
0
GPT-5.1-CodexOpenAI
Coding
50.5
Overall
23.7
Output $/M
$10.00
5
vs boards won of 5 shared

Decision reading

DeepSeek V3 scores 70.2 and GPT-5.1-Codex 50.5 on the Vibe Coding Index, but no coding benchmark measured both, so the gap is directional, not a ranking.

Pick DeepSeek V3 when output tokens cost 9.7x less; pick GPT-5.1-Codex when the context window is larger, 400K against 164K tokens, or when what matters is Design Arena: websites or Design Arena: UI components, where it leads.

Shared results
5
DeepSeek V3 only
8
GPT-5.1-Codex only
21
Like-for-like categories
1 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
DeepSeek V3 70.2 from 1 benchmark, GPT-5.1-Codex 50.5 from 2 benchmarks.
Widest category
Web design, 11.0 points apart on average over 5 shared benchmarks.
Widest single gap
Design Arena: UI components: DeepSeek V3 1093 against GPT-5.1-Codex 1237, 18.0 points apart on a 0 to 100 scale.
Output price
DeepSeek V3 $1.0287 against GPT-5.1-Codex $10.00 per million output tokens, 9.7x apart.
Context window
DeepSeek V3 takes 164K tokens, GPT-5.1-Codex 400K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDeepSeek V3BarsGPT-5.1-CodexTies
Web design05
All shared boards05
CodingDirectional onlyFour of these boards feed the Vibe Coding Index11 boards, none shared
Coding benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
Aider polyglot70.2%Not measuredOnly DeepSeek V3 measured
SWE-bench VerifiedNot measured66.0%Only GPT-5.1-Codex measured
SWE-bench Lite30.7%Not measuredOnly DeepSeek V3 measured
LMArena WebDevNot measured1337Only GPT-5.1-Codex measured
LiveCodeBench (Vals AI)Not measured85.5%Only GPT-5.1-Codex measured
Vibe Code Bench (Vals AI)Not measured13.1%Only GPT-5.1-Codex measured
LiveCodeBench (Artificial Analysis run)Not measured84.9%Only GPT-5.1-Codex measured
Terminal-Bench Hard (Artificial Analysis run)Not measured34.8%Only GPT-5.1-Codex measured
Terminal-BenchNot measured57.8%Only GPT-5.1-Codex measured
ALE-BenchNot measured1244.9Only GPT-5.1-Codex measured
LMArena WebDev: HTMLNot measured1346Only GPT-5.1-Codex measured
Neither model has a result on the other 27 boards here
IntelligenceDirectional onlyPublic boards, shown as published, kept out of the index1 board, none shared
Intelligence benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
AA Intelligence IndexNot measured23.7Only GPT-5.1-Codex measured
Neither model has a result on the other 1 board here
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index4 boards, none shared
Agentic work benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
Design Arena: agents building web appsNot measured1018Only GPT-5.1-Codex measured
Design Arena: agents building full-stack appsNot measured1086Only GPT-5.1-Codex measured
Design Arena: agents building mobile appsNot measured1191Only GPT-5.1-Codex measured
τ²-Bench TelecomNot measured83.0%Only GPT-5.1-Codex measured
Neither model has a result on the other 35 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index3 boards, none shared
Reasoning benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
GPQA Diamond (Artificial Analysis run)Not measured86.0%Only GPT-5.1-Codex measured
Humanity's Last Exam (Artificial Analysis run)Not measured25.7%Only GPT-5.1-Codex measured
GPQA Diamond (Epoch AI run)71.2%Not measuredOnly DeepSeek V3 measured
Neither model has a result on the other 18 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index3 boards, none shared
Math benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
AA Math IndexNot measured95.7Only GPT-5.1-Codex measured
AIME 2025 (Artificial Analysis run)Not measured95.7%Only GPT-5.1-Codex measured
OTIS Mock AIME48.9%Not measuredOnly DeepSeek V3 measured
Neither model has a result on the other 10 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index1 board, none shared
Knowledge benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
MMLU Pro (Artificial Analysis run)Not measured86.0%Only GPT-5.1-Codex measured
Neither model has a result on the other 16 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index05
Web design benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
Design Arena: websites11201162GPT-5.1-Codex
Design Arena: UI components10931237GPT-5.1-Codex
Design Arena: game dev10541138GPT-5.1-Codex
Design Arena: data viz10891213GPT-5.1-Codex
Design Arena: 3D1087Not measuredOnly DeepSeek V3 measured
Design Arena: all code categories11081153GPT-5.1-Codex
Design Arena: SVG976Not measuredOnly DeepSeek V3 measured
Neither model has a result on the other 2 boards here
GeneralDirectional onlyPublic boards, shown as published, kept out of the index4 boards, none shared
General benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
IFBenchNot measured70.0%Only GPT-5.1-Codex measured
Long context reasoning (AA-LCR)Not measured69.3%Only GPT-5.1-Codex measured
DTBench62.7%Not measuredOnly DeepSeek V3 measured
LMCA15.2%Not measuredOnly DeepSeek V3 measured
Neither model has a result on the other 42 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for DeepSeek V3 and GPT-5.1-Codex
BenchmarkDeepSeek V3GPT-5.1-CodexLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

DeepSeek V3$0.0008Fits in one request
GPT-5.1-Codex$0.0063Fits in one request

DeepSeek V3 costs less

Repository review

50K input + 3K output tokens

DeepSeek V3$0.016Fits in one request
GPT-5.1-Codex$0.092Fits in one request

DeepSeek V3 costs less

Agent loop

200K input + 10K output tokens

DeepSeek V3$0.062Exceeds the context window
GPT-5.1-Codex$0.350Fits in one request

DeepSeek V3 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of DeepSeek V3 and GPT-5.1-Codex
SpecificationDeepSeek V3OpenAI GPT-5.1-Codex
MakerDeepSeekOpenAI
WeightsOpen weightsNo public weights listed
ReleasedDecember 26, 2024November 13, 2025
Context window164K400K
Input $/Mtok$0.2574$1.25
Output $/Mtok$1.0287$10.00
Coding index70.250.5
Independent measurements behind it12
Cost per solved taskNot computable$0.892
SourceOpenRouter listingOpenRouter listing

Questions

Is DeepSeek V3 better than GPT-5.1-Codex for coding?

DeepSeek V3 scores 70.2 and GPT-5.1-Codex 50.5 on the Vibe Coding Index, but no coding benchmark measured both, so the gap is directional, not a ranking. Pick DeepSeek V3 when output tokens cost 9.7x less; pick GPT-5.1-Codex when the context window is larger, 400K against 164K tokens, or when what matters is Design Arena: websites or Design Arena: UI components, where it leads.

Which is cheaper, DeepSeek V3 or GPT-5.1-Codex?

DeepSeek V3 costs $0.2574 per million input tokens and $1.0287 per million output tokens; GPT-5.1-Codex costs $1.25 and $10.00. Cost per solved task is known for GPT-5.1-Codex only.

Which has the bigger context window, DeepSeek V3 or GPT-5.1-Codex?

GPT-5.1-Codex, with 400K tokens against 164K.

How many benchmarks is the DeepSeek V3 vs GPT-5.1-Codex comparison based on?

5 benchmarks have a result for both models as of October 21, 2026. DeepSeek V3's coding index rests on 1 independent benchmark and GPT-5.1-Codex's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next