LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

DeepSeek V3 vs GPT-4o (2024-08-06)

Updated October 21, 2026. 4 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

DeepSeek V3DeepSeek
Coding
70.2
Overall
No data
Output $/M
$1.0287
4
GPT-4o (2024-08-06)OpenAI
Coding
23.1
Overall
7.7
Output $/M
$10.00
0
vs boards won of 4 shared

Decision reading

Pick DeepSeek V3 for coding: it scores 70.2 on the Vibe Coding Index against 23.1 for GPT-4o (2024-08-06).

GPT-4o (2024-08-06) is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Shared results
4
DeepSeek V3 only
9
GPT-4o (2024-08-06) only
54
Like-for-like categories
3 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
DeepSeek V3 70.2 from 1 benchmark, GPT-4o (2024-08-06) 23.1 from 1 benchmark.
Widest category
Math, 42.5 points apart on average over 1 shared benchmark.
Widest single gap
Aider polyglot: DeepSeek V3 70.2% against GPT-4o (2024-08-06) 23.1%, 47.1 points apart on a 0 to 100 scale.
Output price
DeepSeek V3 $1.0287 against GPT-4o (2024-08-06) $10.00 per million output tokens, 9.7x apart.
Context window
DeepSeek V3 takes 164K tokens, GPT-4o (2024-08-06) 128K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDeepSeek V3BarsGPT-4o (2024-08-06)Ties
Coding20
Reasoning10
Math10
All shared boards40
CodingLike-for-likeFour of these boards feed the Vibe Coding Index20
Coding benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
Aider polyglot70.2%23.1%DeepSeek V3
SWE-bench Lite30.7%21.7%DeepSeek V3
LiveCodeBench (Artificial Analysis run)Not measured31.7%Only GPT-4o (2024-08-06) measured
Terminal-Bench Hard (Artificial Analysis run)Not measured8.3%Only GPT-4o (2024-08-06) measured
LMArena Text: codingNot measured1283Only GPT-4o (2024-08-06) measured
LMArena Text: software and ITNot measured1278Only GPT-4o (2024-08-06) measured
Neither model has a result on the other 32 boards here
IntelligenceDirectional onlyPublic boards, shown as published, kept out of the index1 board, none shared
Intelligence benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
AA Intelligence IndexNot measured7.7Only GPT-4o (2024-08-06) measured
Neither model has a result on the other 1 board here
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index1 board, none shared
Agentic work benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
τ²-Bench TelecomNot measured28.9%Only GPT-4o (2024-08-06) measured
Neither model has a result on the other 38 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index10
Reasoning benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
MMMU Pro (Vals AI)Not measured64.0%Only GPT-4o (2024-08-06) measured
GPQA Diamond (Artificial Analysis run)Not measured52.1%Only GPT-4o (2024-08-06) measured
Humanity's Last Exam (Artificial Analysis run)Not measured2.3%Only GPT-4o (2024-08-06) measured
GPQA Diamond (Epoch AI run)71.2%49.2%DeepSeek V3
SimpleBenchNot measured17.8%Only GPT-4o (2024-08-06) measured
Chess puzzlesNot measured6.0%Only GPT-4o (2024-08-06) measured
LMArena Text: hard promptsNot measured1264Only GPT-4o (2024-08-06) measured
LMArena Text: expertNot measured1241Only GPT-4o (2024-08-06) measured
LMArena Text: hard prompts in EnglishNot measured1277Only GPT-4o (2024-08-06) measured
Neither model has a result on the other 12 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index10
Math benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
AIMENot measured14.0%Only GPT-4o (2024-08-06) measured
MATH 500 (Vals AI)Not measured75.2%Only GPT-4o (2024-08-06) measured
MGSM (Vals AI)Not measured90.7%Only GPT-4o (2024-08-06) measured
OTIS Mock AIME48.9%6.4%DeepSeek V3
FrontierMath, tiers 1 to 3Not measured0.4%Only GPT-4o (2024-08-06) measured
MATH level 5Not measured53.3%Only GPT-4o (2024-08-06) measured
LMArena Text: mathNot measured1285Only GPT-4o (2024-08-06) measured
LMArena Text: mathematical workNot measured1283Only GPT-4o (2024-08-06) measured
Neither model has a result on the other 5 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index12 boards, none shared
Knowledge benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
MMLU ProNot measured74.1%Only GPT-4o (2024-08-06) measured
LegalBench (Vals AI)Not measured80.1%Only GPT-4o (2024-08-06) measured
CorpFin (Vals AI)Not measured39.4%Only GPT-4o (2024-08-06) measured
TaxEval (Vals AI)Not measured71.1%Only GPT-4o (2024-08-06) measured
MortgageTax (Vals AI)Not measured61.0%Only GPT-4o (2024-08-06) measured
MedQA (Vals AI)Not measured88.2%Only GPT-4o (2024-08-06) measured
SimpleQA VerifiedNot measured26.0%Only GPT-4o (2024-08-06) measured
MMLUNot measured84.3%Only GPT-4o (2024-08-06) measured
LMArena Text: scienceNot measured1274Only GPT-4o (2024-08-06) measured
LMArena Text: medicine and healthcareNot measured1252Only GPT-4o (2024-08-06) measured
LMArena Text: legal and governmentNot measured1275Only GPT-4o (2024-08-06) measured
LMArena Text: business and financeNot measured1232Only GPT-4o (2024-08-06) measured
Neither model has a result on the other 5 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index7 boards, none shared
Web design benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
Design Arena: websites1120Not measuredOnly DeepSeek V3 measured
Design Arena: UI components1093Not measuredOnly DeepSeek V3 measured
Design Arena: game dev1054Not measuredOnly DeepSeek V3 measured
Design Arena: data viz1089Not measuredOnly DeepSeek V3 measured
Design Arena: 3D1087Not measuredOnly DeepSeek V3 measured
Design Arena: all code categories1108Not measuredOnly DeepSeek V3 measured
Design Arena: SVG976Not measuredOnly DeepSeek V3 measured
Neither model has a result on the other 2 boards here
GeneralDirectional onlyPublic boards, shown as published, kept out of the index23 boards, none shared
General benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
IFBenchNot measured36.0%Only GPT-4o (2024-08-06) measured
Long context reasoning (AA-LCR)Not measured41.0%Only GPT-4o (2024-08-06) measured
DTBench62.7%Not measuredOnly DeepSeek V3 measured
LMCA15.2%Not measuredOnly DeepSeek V3 measured
LMArena TextNot measured1283Only GPT-4o (2024-08-06) measured
LMArena Text: instruction followingNot measured1267Only GPT-4o (2024-08-06) measured
LMArena Text: creative writingNot measured1274Only GPT-4o (2024-08-06) measured
LMArena VisionNot measured1065Only GPT-4o (2024-08-06) measured
LMArena Text: EnglishNot measured1297Only GPT-4o (2024-08-06) measured
LMArena Text: non-EnglishNot measured1262Only GPT-4o (2024-08-06) measured
LMArena Text: ChineseNot measured1254Only GPT-4o (2024-08-06) measured
LMArena Text: GermanNot measured1257Only GPT-4o (2024-08-06) measured
LMArena Text: JapaneseNot measured1234Only GPT-4o (2024-08-06) measured
LMArena Text: KoreanNot measured1218Only GPT-4o (2024-08-06) measured
LMArena Text: FrenchNot measured1263Only GPT-4o (2024-08-06) measured
LMArena Text: SpanishNot measured1269Only GPT-4o (2024-08-06) measured
LMArena Text: RussianNot measured1272Only GPT-4o (2024-08-06) measured
LMArena Text: multi-turnNot measured1279Only GPT-4o (2024-08-06) measured
LMArena Text: longer queriesNot measured1283Only GPT-4o (2024-08-06) measured
LMArena Text: writing and languageNot measured1290Only GPT-4o (2024-08-06) measured
LMArena Text: entertainment and mediaNot measured1267Only GPT-4o (2024-08-06) measured
LMArena Vision: EnglishNot measured1072Only GPT-4o (2024-08-06) measured
LMArena Vision: ChineseNot measured1009Only GPT-4o (2024-08-06) measured
Neither model has a result on the other 23 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for DeepSeek V3 and GPT-4o (2024-08-06)
BenchmarkDeepSeek V3GPT-4o (2024-08-06)Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

DeepSeek V3$0.0008Fits in one request
GPT-4o (2024-08-06)$0.0075Fits in one request

DeepSeek V3 costs less

Repository review

50K input + 3K output tokens

DeepSeek V3$0.016Fits in one request
GPT-4o (2024-08-06)$0.155Fits in one request

DeepSeek V3 costs less

Agent loop

200K input + 10K output tokens

DeepSeek V3$0.062Exceeds the context window
GPT-4o (2024-08-06)$0.600Exceeds the context window

DeepSeek V3 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of DeepSeek V3 and GPT-4o (2024-08-06)
SpecificationDeepSeek V3OpenAI GPT-4o (2024-08-06)
MakerDeepSeekOpenAI
WeightsOpen weightsNo public weights listed
ReleasedDecember 26, 2024August 6, 2024
Context window164K128K
Input $/Mtok$0.2574$2.50
Output $/Mtok$1.0287$10.00
Coding index70.223.1
Independent measurements behind it11
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is DeepSeek V3 better than GPT-4o (2024-08-06) for coding?

Pick DeepSeek V3 for coding: it scores 70.2 on the Vibe Coding Index against 23.1 for GPT-4o (2024-08-06). GPT-4o (2024-08-06) is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Which is cheaper, DeepSeek V3 or GPT-4o (2024-08-06)?

DeepSeek V3 costs $0.2574 per million input tokens and $1.0287 per million output tokens; GPT-4o (2024-08-06) costs $2.50 and $10.00. Cost per solved task is known for neither of them.

Which has the bigger context window, DeepSeek V3 or GPT-4o (2024-08-06)?

DeepSeek V3, with 164K tokens against 128K.

How many benchmarks is the DeepSeek V3 vs GPT-4o (2024-08-06) comparison based on?

4 benchmarks have a result for both models as of October 21, 2026. DeepSeek V3's coding index rests on 1 independent benchmark and GPT-4o (2024-08-06)'s on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next