LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

DeepSeek V3 0324 vs o1

Updated October 21, 2026. 29 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace DeepSeek V3 0324 Replace o1
DeepSeek V3 0324DeepSeek
Coding
42.0
Overall
9.7
Output $/M
$1.14
4
o1OpenAI
Coding
61.7
Overall
15.2
Output $/M
$60.00
25
vs boards won of 29 shared

Decision reading

Pick o1 for coding: it scores 61.7 on the Vibe Coding Index against 42.0 for DeepSeek V3 0324.

Pick DeepSeek V3 0324 when output tokens cost 52.6x less, or when what matters is LiveCodeBench (Vals AI) or Terminal-Bench Hard (Artificial Analysis run), where it leads.

Model ADeepSeek V3 0324DeepSeek42.0/1001 independent benchmarkNo cost per solved taskModel Bo1OpenAI61.7/1001 independent benchmarkNo cost per solved task
Shared results
29
DeepSeek V3 0324 only
6
o1 only
39
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
DeepSeek V3 0324 42.0 from 1 benchmark, o1 61.7 from 1 benchmark.
Widest category
General, 18.4 points apart on average over 6 shared benchmarks.
Widest single gap
OTIS Mock AIME: DeepSeek V3 0324 37.8% against o1 73.3%, 35.6 points apart on a 0 to 100 scale.
Output price
DeepSeek V3 0324 $1.14 against o1 $60.00 per million output tokens, 52.6x apart.
Context window
DeepSeek V3 0324 takes 164K tokens, o1 200K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDeepSeek V3 0324Barso1Ties
Coding23
Intelligence01
Agentic work02
Reasoning05
Math14
Knowledge05
General15
All shared boards425
CodingLike-for-likeFour of these boards feed the Vibe Coding Index23
Coding benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
Aider polyglotNot measured61.7%Only o1 measured
SWE-bench Verified42.0%Not measuredOnly DeepSeek V3 0324 measured
AA Coding Index21.239.7o1
LiveCodeBench (Vals AI)65.5%50.3%DeepSeek V3 0324
LiveCodeBench (Artificial Analysis run)40.5%67.9%o1
SciCode39.0%Not measuredOnly DeepSeek V3 0324 measured
Terminal-Bench Hard (Artificial Analysis run)15.2%12.9%DeepSeek V3 0324
WeirdML36.1%46.1%o1
LMArena Text: codingNot measured1367Only o1 measured
LMArena Text: software and ITNot measured1366Only o1 measured
Neither model has a result on the other 28 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
AA Intelligence Index9.715.2o1
Epoch Capabilities IndexNot measured141.7Only o1 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index02
Agentic work benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
AA Agentic Index0.8Not measuredOnly DeepSeek V3 0324 measured
τ²-Bench Telecom47.1%62.6%o1
METR time horizons49.6%51.1%o1
Neither model has a result on the other 36 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index05
Reasoning benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
GPQA Diamond61.6%73.2%o1
MMMU Pro (Vals AI)Not measured77.4%Only o1 measured
GPQA Diamond (Artificial Analysis run)65.5%74.7%o1
Humanity's Last Exam (Artificial Analysis run)4.7%7.0%o1
GPQA Diamond (Epoch AI run)67.6%76.8%o1
ARC-AGINot measured30.7%Only o1 measured
SimpleBench27.2%40.1%o1
Chess puzzlesNot measured10.0%Only o1 measured
VPCTNot measured37.0%Only o1 measured
LMArena Text: hard promptsNot measured1371Only o1 measured
LMArena Text: expertNot measured1361Only o1 measured
LMArena Text: hard prompts in EnglishNot measured1372Only o1 measured
Neither model has a result on the other 9 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index14
Math benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
AIME52.2%71.5%o1
MATH 500 (Vals AI)88.6%90.4%o1
MGSM (Vals AI)91.7%89.3%DeepSeek V3 0324
AA Math Index41.0Not measuredOnly DeepSeek V3 0324 measured
AIME 2025 (Artificial Analysis run)41.0%Not measuredOnly DeepSeek V3 0324 measured
OTIS Mock AIME37.8%73.3%o1
FrontierMath, tiers 1 to 3Not measured14.7%Only o1 measured
MATH level 575.5%94.7%o1
LMArena Text: mathNot measured1388Only o1 measured
LMArena Text: mathematical workNot measured1390Only o1 measured
Neither model has a result on the other 3 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index05
Knowledge benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
MMLU Pro79.5%83.5%o1
LegalBench (Vals AI)77.7%80.4%o1
CorpFin (Vals AI)54.7%Not measuredOnly DeepSeek V3 0324 measured
TaxEval (Vals AI)71.1%74.3%o1
MedQA (Vals AI)82.0%96.5%o1
MMLU Pro (Artificial Analysis run)81.9%84.1%o1
SimpleQA VerifiedNot measured41.1%Only o1 measured
GeoBenchNot measured80.0%Only o1 measured
LMArena Text: scienceNot measured1369Only o1 measured
LMArena Text: medicine and healthcareNot measured1355Only o1 measured
LMArena Text: legal and governmentNot measured1368Only o1 measured
LMArena Text: business and financeNot measured1328Only o1 measured
Neither model has a result on the other 5 boards here
Web designNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Web design benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
Neither model has a result on 9 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index15
General benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
IFBench41.0%70.3%o1
Long context reasoning (AA-LCR)40.7%65.0%o1
DTBench64.8%74.7%o1
LMCA15.5%22.3%o1
Fiction.LiveBench50.0%83.3%o1
Creative writing (Lech Mazur)77.0%70.2%DeepSeek V3 0324
LMArena TextNot measured1366Only o1 measured
LMArena Text: instruction followingNot measured1367Only o1 measured
LMArena Text: creative writingNot measured1347Only o1 measured
LMArena VisionNot measured1168Only o1 measured
LMArena Text: EnglishNot measured1372Only o1 measured
LMArena Text: non-EnglishNot measured1358Only o1 measured
LMArena Text: ChineseNot measured1394Only o1 measured
LMArena Text: GermanNot measured1337Only o1 measured
LMArena Text: JapaneseNot measured1346Only o1 measured
LMArena Text: KoreanNot measured1396Only o1 measured
LMArena Text: FrenchNot measured1344Only o1 measured
LMArena Text: SpanishNot measured1345Only o1 measured
LMArena Text: RussianNot measured1356Only o1 measured
LMArena Text: multi-turnNot measured1355Only o1 measured
LMArena Text: longer queriesNot measured1378Only o1 measured
LMArena Text: writing and languageNot measured1360Only o1 measured
LMArena Text: entertainment and mediaNot measured1358Only o1 measured
LMArena Vision: EnglishNot measured1162Only o1 measured
LMArena Vision: ChineseNot measured1235Only o1 measured
Neither model has a result on the other 21 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for DeepSeek V3 0324 and o1
BenchmarkDeepSeek V3 0324o1Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

DeepSeek V3 0324$0.0009Fits in one request
o1$0.045Fits in one request

DeepSeek V3 0324 costs less

Repository review

50K input + 3K output tokens

DeepSeek V3 0324$0.018Fits in one request
o1$0.930Fits in one request

DeepSeek V3 0324 costs less

Agent loop

200K input + 10K output tokens

DeepSeek V3 0324$0.069Exceeds the context window
o1$3.60Exceeds the context window

DeepSeek V3 0324 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of DeepSeek V3 0324 and o1
SpecificationDeepSeek V3 0324OpenAI o1
MakerDeepSeekOpenAI
WeightsOpen weightsNo public weights listed
ReleasedMarch 24, 2025December 17, 2024
Context window164K200K
Input $/Mtok$0.29$15.00
Output $/Mtok$1.14$60.00
Coding index42.061.7
Independent measurements behind it11
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is DeepSeek V3 0324 better than o1 for coding?

Pick o1 for coding: it scores 61.7 on the Vibe Coding Index against 42.0 for DeepSeek V3 0324. Pick DeepSeek V3 0324 when output tokens cost 52.6x less, or when what matters is LiveCodeBench (Vals AI) or Terminal-Bench Hard (Artificial Analysis run), where it leads.

Which is cheaper, DeepSeek V3 0324 or o1?

DeepSeek V3 0324 costs $0.29 per million input tokens and $1.14 per million output tokens; o1 costs $15.00 and $60.00. Cost per solved task is known for neither of them.

Which has the bigger context window, DeepSeek V3 0324 or o1?

o1, with 200K tokens against 164K.

How many benchmarks is the DeepSeek V3 0324 vs o1 comparison based on?

29 benchmarks have a result for both models as of October 21, 2026. DeepSeek V3 0324's coding index rests on 1 independent benchmark and o1's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next