Claude Haiku 4.5 vs o4 Mini

Updated October 21, 2026. 61 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace Claude Haiku 4.5 Replace o4 Mini

Claude Haiku 4.5Anthropic

Coding: 49.8
Overall: 16.9
Output $/M: $5.00

o4 MiniOpenAI

Coding: 68.6
Overall: 16.7
Output $/M: $4.40

vs boards won of 61 shared

Decision reading

Pick o4 Mini for coding: it scores 68.6 on the Vibe Coding Index against 49.8 for Claude Haiku 4.5, though on 2 benchmarks against 3.

Pick Claude Haiku 4.5 when what matters is SWE-bench Verified or LMArena Text: coding, where it leads.

Model AClaude Haiku 4.5Anthropic49.8/1003 independent benchmarks$0.56 per solved task Model Bo4 MiniOpenAI68.6/1002 independent benchmarksNo cost per solved task

613333

Shared results: 61
Claude Haiku 4.5 only: 33
o4 Mini only: 33
Like-for-like categories: 7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, four public coding benchmarks
o4 Mini
o4 Mini scores 68.6 against 49.8.
3 and 2 benchmarks behind the scores
Intelligence
AA Intelligence Index
Claude Haiku 4.5
Claude Haiku 4.5 leads, 16.9 against 16.7.
Same board, both measured
Agentic work
AA Agentic Index
No call
Only Claude Haiku 4.5 has a AA Agentic Index result, 8.0.
Directional only
Reasoning
GPQA Diamond
o4 Mini
o4 Mini leads, 74.5% against 72.2%.
Same board, both measured
Math
AIME
o4 Mini
o4 Mini leads, 83.7% against 82.7%.
Same board, both measured
Knowledge
MMLU Pro
o4 Mini
o4 Mini leads, 80.6% against 78.7%.
Same board, both measured
Web design
Design Arena: websites
Claude Haiku 4.5
Claude Haiku 4.5 leads, 1122 against 985.
Same board, both measured
Long documents
Listed context window
No call
Both take 200K tokens.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
o4 Mini
Claude Haiku 4.5 $0.0035, o4 Mini $0.0033 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
No call
Only Claude Haiku 4.5 has the number, $0.56.
Directional only

At a glance

Coding index: Claude Haiku 4.5 49.8 from 3 benchmarks, o4 Mini 68.6 from 2 benchmarks.
Widest category: Web design, 17.4 points apart on average over 6 shared benchmarks.
Widest single gap: LiveCodeBench (Vals AI): Claude Haiku 4.5 41.2% against o4 Mini 82.2%, 41.0 points apart on a 0 to 100 scale.
Output price: Claude Haiku 4.5 $5.00 against o4 Mini $4.40 per million output tokens, 1.1x apart.
Context window: Both take 200K tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	Claude Haiku 4.5	o4 Mini
Coding	3	2
Intelligence	1	1
Reasoning	3	6
Math	2	4
Knowledge	6	6
Web design	6	0
General	18	3
All shared boards	39	22

CodingLike-for-likeFour of these boards feed the Vibe Coding Index32

Coding benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
Aider polyglot	Not measured	72.0%	Only o4 Mini measured
SWE-bench Verified	66.6%	64.6%	Claude Haiku 4.5
SWE-bench Multimodal	Not measured	33.9%	Only o4 Mini measured
SWE-bench Multilingual	64.7%	Not measured	Only Claude Haiku 4.5 measured
LiveBench coding	48.1%	Not measured	Only Claude Haiku 4.5 measured
LMArena WebDev	1330	Not measured	Only Claude Haiku 4.5 measured
AA Coding Index	43.9	Not measured	Only Claude Haiku 4.5 measured
LiveCodeBench (Vals AI)	41.2%	82.2%	o4 Mini
SWE-bench Verified (Vals AI)	66.6%	Not measured	Only Claude Haiku 4.5 measured
Vibe Code Bench (Vals AI)	11.4%	Not measured	Only Claude Haiku 4.5 measured
Code migration (Vals AI)	7.5%	Not measured	Only Claude Haiku 4.5 measured
ProgramBench (Vals AI)	0.0%	Not measured	Only Claude Haiku 4.5 measured
Terminal-Bench 2.1 (Vals AI)	43.8%	Not measured	Only Claude Haiku 4.5 measured
LiveCodeBench (Artificial Analysis run)	Not measured	85.9%	Only o4 Mini measured
Terminal-Bench Hard (Artificial Analysis run)	Not measured	15.2%	Only o4 Mini measured
Terminal-Bench	35.5%	Not measured	Only Claude Haiku 4.5 measured
GSO-Bench	Not measured	3.6%	Only o4 Mini measured
WeirdML	45.4%	52.6%	o4 Mini
LMArena Text: coding	1454	1368	Claude Haiku 4.5
LMArena Text: software and IT	1439	1367	Claude Haiku 4.5
LMArena WebDev: React	1326	Not measured	Only Claude Haiku 4.5 measured
LMArena WebDev: HTML	1318	Not measured	Only Claude Haiku 4.5 measured
Neither model has a result on the other 16 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index11

Intelligence benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
AA Intelligence Index	16.9	16.7	Claude Haiku 4.5
Epoch Capabilities Index	142.2	145.5	o4 Mini

Agentic workDirectional onlyPublic boards, shown as published, kept out of the index13 boards, none shared

Agentic work benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
AA Agentic Index	8.0	Not measured	Only Claude Haiku 4.5 measured
LiveBench research	42.2%	Not measured	Only Claude Haiku 4.5 measured
LiveBench browser	40.0%	Not measured	Only Claude Haiku 4.5 measured
LiveBench long agentic	11.1%	Not measured	Only Claude Haiku 4.5 measured
Finance Agent (Vals AI)	31.0%	Not measured	Only Claude Haiku 4.5 measured
Tax Agent Bench (Vals AI)	5.9%	Not measured	Only Claude Haiku 4.5 measured
Legal Research Bench (Vals AI)	10.6%	Not measured	Only Claude Haiku 4.5 measured
Excel Modeling Benchmark (Vals AI)	22.7%	Not measured	Only Claude Haiku 4.5 measured
τ²-Bench Telecom	Not measured	55.6%	Only o4 Mini measured
METR time horizons	Not measured	63.9%	Only o4 Mini measured
BALROG	31.2%	Not measured	Only Claude Haiku 4.5 measured
DeepResearch Bench	45.5%	Not measured	Only Claude Haiku 4.5 measured
Vending-Bench 2	$459	Not measured	Only Claude Haiku 4.5 measured
Neither model has a result on the other 26 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index36

Reasoning benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
GPQA Diamond	72.2%	74.5%	o4 Mini
LiveBench reasoning	61.7%	Not measured	Only Claude Haiku 4.5 measured
MMMU Pro (Vals AI)	46.1%	79.7%	o4 Mini
GPQA Diamond (Artificial Analysis run)	Not measured	78.4%	Only o4 Mini measured
Humanity's Last Exam (Artificial Analysis run)	Not measured	16.5%	Only o4 Mini measured
GPQA Diamond (Epoch AI run)	71.2%	79.6%	o4 Mini
ARC-AGI	47.7%	58.7%	o4 Mini
ARC-AGI-2	4.0%	6.1%	o4 Mini
SimpleBench	Not measured	38.7%	Only o4 Mini measured
Chess puzzles	8.0%	22.0%	o4 Mini
Mystery game puzzles	Not measured	5.0%	Only o4 Mini measured
VPCT	Not measured	57.5%	Only o4 Mini measured
LMArena Text: hard prompts	1421	1351	Claude Haiku 4.5
LMArena Text: expert	1443	1343	Claude Haiku 4.5
LMArena Text: hard prompts in English	1435	1366	Claude Haiku 4.5
LMArena Vision: diagrams	Not measured	1197	Only o4 Mini measured
LMArena Vision: homework	Not measured	1234	Only o4 Mini measured
Neither model has a result on the other 4 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index24

Math benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
AIME	82.7%	83.7%	o4 Mini
MATH 500 (Vals AI)	Not measured	94.2%	Only o4 Mini measured
MGSM (Vals AI)	92.2%	93.4%	o4 Mini
AA Math Index	Not measured	90.7	Only o4 Mini measured
AIME 2025 (Artificial Analysis run)	Not measured	90.7%	Only o4 Mini measured
OTIS Mock AIME	66.7%	81.7%	o4 Mini
FrontierMath, tiers 1 to 3	Not measured	36.1%	Only o4 Mini measured
FrontierMath, tier 4	Not measured	4.9%	Only o4 Mini measured
MATH level 5	96.4%	97.8%	o4 Mini
LMArena Text: math	1398	1389	Claude Haiku 4.5
LMArena Text: mathematical work	1430	1379	Claude Haiku 4.5
Neither model has a result on the other 2 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index66

Knowledge benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
MMLU Pro	78.7%	80.6%	o4 Mini
LegalBench (Vals AI)	81.2%	79.2%	Claude Haiku 4.5
CaseLaw (Vals AI)	56.5%	Not measured	Only Claude Haiku 4.5 measured
CorpFin (Vals AI)	60.6%	59.0%	Claude Haiku 4.5
TaxEval (Vals AI)	67.5%	74.8%	o4 Mini
MortgageTax (Vals AI)	62.2%	64.8%	o4 Mini
MedQA (Vals AI)	79.6%	96.0%	o4 Mini
MedCode (Vals AI)	32.7%	33.8%	o4 Mini
MMLU Pro (Artificial Analysis run)	Not measured	83.2%	Only o4 Mini measured
SimpleQA Verified	13.2%	19.6%	o4 Mini
GeoBench	Not measured	64.0%	Only o4 Mini measured
LMArena Text: science	1406	1354	Claude Haiku 4.5
LMArena Text: medicine and healthcare	1394	1361	Claude Haiku 4.5
LMArena Text: legal and government	1400	1350	Claude Haiku 4.5
LMArena Text: business and finance	1400	1325	Claude Haiku 4.5
Neither model has a result on the other 2 boards here

Web designLike-for-likePublic boards, shown as published, kept out of the index60

Web design benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
Design Arena: websites	1122	985	Claude Haiku 4.5
Design Arena: UI components	1100	983	Claude Haiku 4.5
Design Arena: game dev	1097	1004	Claude Haiku 4.5
Design Arena: data viz	1124	990	Claude Haiku 4.5
Design Arena: 3D	1072	854	Claude Haiku 4.5
Design Arena: all code categories	1115	977	Claude Haiku 4.5
Design Arena: SVG	1025	Not measured	Only Claude Haiku 4.5 measured
Design Arena: ASCII art	1139	Not measured	Only Claude Haiku 4.5 measured
LiveBench design	59.9%	Not measured	Only Claude Haiku 4.5 measured

GeneralLike-for-likePublic boards, shown as published, kept out of the index183

General benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
LiveBench data analysis	59.3%	Not measured	Only Claude Haiku 4.5 measured
Public Benefits Bench (Vals AI)	54.3%	Not measured	Only Claude Haiku 4.5 measured
SAGE (Vals AI)	31.8%	41.1%	o4 Mini
MedScribe (Vals AI)	85.2%	69.1%	Claude Haiku 4.5
Vals Multimodal Index	42.9%	Not measured	Only Claude Haiku 4.5 measured
IFBench	Not measured	68.7%	Only o4 Mini measured
Long context reasoning (AA-LCR)	Not measured	61.0%	Only o4 Mini measured
DTBench	73.6%	77.6%	o4 Mini
LMCA	30.9%	26.5%	Claude Haiku 4.5
Fiction.LiveBench	Not measured	77.8%	Only o4 Mini measured
Creative writing (Lech Mazur)	Not measured	75.0%	Only o4 Mini measured
ExploitBench	13.7%	Not measured	Only Claude Haiku 4.5 measured
LMArena Text	1397	1353	Claude Haiku 4.5
LMArena Text: instruction following	1414	1320	Claude Haiku 4.5
LMArena Text: creative writing	1371	1294	Claude Haiku 4.5
LMArena Vision	Not measured	1194	Only o4 Mini measured
LMArena Text: English	1414	1367	Claude Haiku 4.5
LMArena Text: non-English	1377	1337	Claude Haiku 4.5
LMArena Text: Chinese	1418	1354	Claude Haiku 4.5
LMArena Text: German	1374	1336	Claude Haiku 4.5
LMArena Text: Japanese	1338	1308	Claude Haiku 4.5
LMArena Text: Korean	1346	1312	Claude Haiku 4.5
LMArena Text: French	1411	1364	Claude Haiku 4.5
LMArena Text: Spanish	1421	1346	Claude Haiku 4.5
LMArena Text: Russian	1381	1334	Claude Haiku 4.5
LMArena Text: Polish	1343	1358	o4 Mini
LMArena Text: multi-turn	1409	1350	Claude Haiku 4.5
LMArena Text: longer queries	1427	1315	Claude Haiku 4.5
LMArena Text: writing and language	1386	1316	Claude Haiku 4.5
LMArena Text: entertainment and media	1369	1308	Claude Haiku 4.5
LMArena Vision: English	Not measured	1200	Only o4 Mini measured
LMArena Vision: Chinese	Not measured	1218	Only o4 Mini measured
LMArena Vision: reading text	Not measured	1197	Only o4 Mini measured
LMArena Vision: humor	Not measured	1199	Only o4 Mini measured
LMArena Vision: captioning	Not measured	1204	Only o4 Mini measured
LMArena Vision: recognizing things	Not measured	1218	Only o4 Mini measured
LMArena Vision: creative writing	Not measured	1166	Only o4 Mini measured
LMArena Document	1420	Not measured	Only Claude Haiku 4.5 measured
Neither model has a result on the other 8 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for Claude Haiku 4.5 and o4 Mini
Benchmark	Claude Haiku 4.5	o4 Mini	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Haiku 4.5$0.0035Fits in one request

o4 Mini$0.0033Fits in one request

o4 Mini costs less

Repository review

50K input + 3K output tokens

Claude Haiku 4.5$0.065Fits in one request

o4 Mini$0.068Fits in one request

Claude Haiku 4.5 costs less

Agent loop

200K input + 10K output tokens

Claude Haiku 4.5$0.250Exceeds the context window

o4 Mini$0.264Exceeds the context window

Claude Haiku 4.5 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Haiku 4.5 and o4 Mini
Specification	Anthropic Claude Haiku 4.5	OpenAI o4 Mini
Maker	Anthropic	OpenAI
Weights	No public weights listed	No public weights listed
Released	October 15, 2025	April 16, 2025
Context window	200K	200K
Input $/Mtok	$1.00	$1.10
Output $/Mtok	$5.00	$4.40
Coding index	49.8	68.6
Independent measurements behind it	3	2
Cost per solved task	$0.56	Not computable
Source	OpenRouter listing	OpenRouter listing

Questions

Is Claude Haiku 4.5 better than o4 Mini for coding?

Pick o4 Mini for coding: it scores 68.6 on the Vibe Coding Index against 49.8 for Claude Haiku 4.5, though on 2 benchmarks against 3. Pick Claude Haiku 4.5 when what matters is SWE-bench Verified or LMArena Text: coding, where it leads.

Which is cheaper, Claude Haiku 4.5 or o4 Mini?

Claude Haiku 4.5 costs $1.00 per million input tokens and $5.00 per million output tokens; o4 Mini costs $1.10 and $4.40. Cost per solved task is known for Claude Haiku 4.5 only.

Which has the bigger context window, Claude Haiku 4.5 or o4 Mini?

Neither: both take 200K tokens.

How many benchmarks is the Claude Haiku 4.5 vs o4 Mini comparison based on?

61 benchmarks have a result for both models as of October 21, 2026. Claude Haiku 4.5's coding index rests on 3 independent benchmarks and o4 Mini's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/claude-haiku-4-5-vs-o4-mini" title="Claude Haiku 4.5 vs o4 Mini, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/claude-haiku-4-5-vs-o4-mini">LLMBenchmark.ai, Claude Haiku 4.5 vs o4 Mini</a></p>

Decision reading

Which one for your work

Coding

Intelligence

Agentic work

Reasoning

Math

Knowledge

Web design

Long documents

Everyday cost

Cost per solved task