Enter opens the highlighted result. Esc closes.

Claude Haiku 4.5 vs Mistral Medium 3.5

Claude Haiku 4.5 leads Mistral Medium 3.5 on coding, 35.6 to 25.5 on the Vibe Coding Index, and Claude Haiku 4.5 costs 1.5x less per output token ($5.00 vs $7.50 per million). Updated October 22, 2026; 63 benchmarks have a result for both.

Replace Claude Haiku 4.5 Replace Mistral Medium 3.5
Claude Haiku 4.5Anthropic
Coding
35.6
Overall
41.0
Output $/M
$5.00
32
Mistral Medium 3.5Mistral AI
Coding
25.5
Overall
37.3
Output $/M
$7.50
31
vs boards won of 63 shared

Claude Haiku 4.5 or Mistral Medium 3.5: which to pick

Pick Claude Haiku 4.5 for coding: it scores 35.6 on the Vibe Coding Index against 25.5 for Mistral Medium 3.5.

Pick Mistral Medium 3.5 for a larger context window (262K against 200K tokens) and work measured by AA Coding Index or LMArena Text: coding, where it leads.

Model AClaude Haiku 4.5Anthropic35.6/1004 independent benchmarks$0.56 per solved taskModel BMistral Medium 3.5Mistral AI25.5/1003 independent benchmarks$6.02 per solved task
Shared results
63
Claude Haiku 4.5 only
35
Mistral Medium 3.5 only
19
Like-for-like categories
8 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Haiku 4.5 35.6 from 4 benchmarks, Mistral Medium 3.5 25.5 from 3 benchmarks.
Widest category
Reasoning, 10.9 points apart on average over 4 shared benchmarks.
Widest single gap
GPQA Diamond: Claude Haiku 4.5 72.2% against Mistral Medium 3.5 34.9%, 37.4 points apart on a 0 to 100 scale.
Output price
Claude Haiku 4.5 $5.00 against Mistral Medium 3.5 $7.50 per million output tokens, 1.5x apart.
Context window
Claude Haiku 4.5 takes 200K tokens, Mistral Medium 3.5 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Haiku 4.5BarsMistral Medium 3.5Ties
Coding73
Intelligence20
Agentic work41
Reasoning22
Math02
Knowledge46
Web design62
General715
All shared boards3231
CodingLike-for-likeSix of these boards feed the Vibe Coding Index73
Coding benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
SWE-bench Verified66.6%Not measuredOnly Claude Haiku 4.5 measured
SWE-bench Multilingual64.7%Not measuredOnly Claude Haiku 4.5 measured
LiveBench coding48.1%Not measuredOnly Claude Haiku 4.5 measured
LMArena WebDev13301264Claude Haiku 4.5
AA Coding Index43.946.9Mistral Medium 3.5
LiveCodeBench (Vals AI)41.2%Not measuredOnly Claude Haiku 4.5 measured
SWE-bench Verified (Vals AI)66.6%66.4%Claude Haiku 4.5
Vibe Code Bench (Vals AI)11.4%2.9%Claude Haiku 4.5
Code migration (Vals AI)7.5%5.1%Claude Haiku 4.5
ProgramBench (Vals AI)0.0%Not measuredOnly Claude Haiku 4.5 measured
Terminal-Bench 2.1 (Vals AI)43.8%39.0%Claude Haiku 4.5
SciCodeNot measured40.2%Only Mistral Medium 3.5 measured
Terminal-Bench Hard (Artificial Analysis run)Not measured33.3%Only Mistral Medium 3.5 measured
Terminal-Bench35.5%Not measuredOnly Claude Haiku 4.5 measured
WeirdML45.4%Not measuredOnly Claude Haiku 4.5 measured
ALE-BenchNot measured764.0Only Mistral Medium 3.5 measured
LMArena Text: coding14541460Mistral Medium 3.5
LMArena Text: software and IT14391458Mistral Medium 3.5
LMArena WebDev: React13261254Claude Haiku 4.5
LMArena WebDev: HTML13181308Claude Haiku 4.5
Neither model has a result on the other 23 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
AA Intelligence Index16.914.2Claude Haiku 4.5
Epoch Capabilities Index142.2141.4Claude Haiku 4.5
Agentic workLike-for-likePublic boards, shown as published, kept out of the index41
Agentic work benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
AA Agentic Index8.07.0Claude Haiku 4.5
LiveBench research42.2%Not measuredOnly Claude Haiku 4.5 measured
LiveBench browser40.0%Not measuredOnly Claude Haiku 4.5 measured
LiveBench long agentic11.1%Not measuredOnly Claude Haiku 4.5 measured
Finance Agent (Vals AI)31.0%32.1%Mistral Medium 3.5
Tax Agent Bench (Vals AI)5.9%4.5%Claude Haiku 4.5
Legal Research Bench (Vals AI)10.6%9.1%Claude Haiku 4.5
Excel Modeling Benchmark (Vals AI)22.7%11.2%Claude Haiku 4.5
τ²-Bench TelecomNot measured94.2%Only Mistral Medium 3.5 measured
BALROG31.2%Not measuredOnly Claude Haiku 4.5 measured
DeepResearch Bench45.5%Not measuredOnly Claude Haiku 4.5 measured
Vending-Bench 2$459Not measuredOnly Claude Haiku 4.5 measured
Berkeley Function Calling Leaderboard (BFCL)68.7%Not measuredOnly Claude Haiku 4.5 measured
MCP Atlas40.2%Not measuredOnly Claude Haiku 4.5 measured
Neither model has a result on the other 28 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index22
Reasoning benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
GPQA Diamond72.2%34.9%Claude Haiku 4.5
LiveBench reasoning61.7%Not measuredOnly Claude Haiku 4.5 measured
MMMU Pro (Vals AI)46.1%Not measuredOnly Claude Haiku 4.5 measured
GPQA Diamond (Artificial Analysis run)Not measured74.8%Only Mistral Medium 3.5 measured
Humanity's Last Exam (Artificial Analysis run)Not measured13.8%Only Mistral Medium 3.5 measured
GPQA Diamond (Epoch AI run)71.2%Not measuredOnly Claude Haiku 4.5 measured
ARC-AGI47.7%Not measuredOnly Claude Haiku 4.5 measured
ARC-AGI-24.0%Not measuredOnly Claude Haiku 4.5 measured
Chess puzzles8.0%Not measuredOnly Claude Haiku 4.5 measured
LMArena Text: hard prompts14211436Mistral Medium 3.5
LMArena Text: expert14431432Claude Haiku 4.5
LMArena Text: hard prompts in English14351445Mistral Medium 3.5
LMArena Vision: diagramsNot measured1254Only Mistral Medium 3.5 measured
LMArena Vision: homeworkNot measured1230Only Mistral Medium 3.5 measured
Kagi LLM BenchmarkNot measured41.4%Only Mistral Medium 3.5 measured
Neither model has a result on the other 8 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
AIME82.7%Not measuredOnly Claude Haiku 4.5 measured
MGSM (Vals AI)92.2%Not measuredOnly Claude Haiku 4.5 measured
OTIS Mock AIME66.7%Not measuredOnly Claude Haiku 4.5 measured
ProofBenchNot measured9.0%Only Mistral Medium 3.5 measured
MATH level 596.4%Not measuredOnly Claude Haiku 4.5 measured
LMArena Text: math13981431Mistral Medium 3.5
LMArena Text: mathematical work14301440Mistral Medium 3.5
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index46
Knowledge benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
MMLU Pro78.7%75.3%Claude Haiku 4.5
LegalBench (Vals AI)81.2%Not measuredOnly Claude Haiku 4.5 measured
CaseLaw (Vals AI)56.5%44.2%Claude Haiku 4.5
CorpFin (Vals AI)60.6%58.8%Claude Haiku 4.5
TaxEval (Vals AI)67.5%68.0%Mistral Medium 3.5
MortgageTax (Vals AI)62.2%28.9%Claude Haiku 4.5
MedQA (Vals AI)79.6%Not measuredOnly Claude Haiku 4.5 measured
MedCode (Vals AI)32.7%33.8%Mistral Medium 3.5
SimpleQA Verified13.2%Not measuredOnly Claude Haiku 4.5 measured
LMArena Text: science14061428Mistral Medium 3.5
LMArena Text: medicine and healthcare13941409Mistral Medium 3.5
LMArena Text: legal and government14001437Mistral Medium 3.5
LMArena Text: business and finance14001426Mistral Medium 3.5
Neither model has a result on the other 7 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index62
Web design benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
Design Arena: websites11221142Mistral Medium 3.5
Design Arena: UI components10971076Claude Haiku 4.5
Design Arena: game dev10961079Claude Haiku 4.5
Design Arena: data viz11241121Claude Haiku 4.5
Design Arena: 3D10711060Claude Haiku 4.5
Design Arena: all code categories11141121Mistral Medium 3.5
Design Arena: SVG1025949Claude Haiku 4.5
Design Arena: ASCII art11401062Claude Haiku 4.5
LiveBench design59.9%Not measuredOnly Claude Haiku 4.5 measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index715
General benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
LiveBench data analysis59.3%Not measuredOnly Claude Haiku 4.5 measured
Public Benefits Bench (Vals AI)54.3%Not measuredOnly Claude Haiku 4.5 measured
SAGE (Vals AI)31.8%37.6%Mistral Medium 3.5
MedScribe (Vals AI)85.2%67.7%Claude Haiku 4.5
Vals Multimodal Index42.9%34.8%Claude Haiku 4.5
IFBenchNot measured68.8%Only Mistral Medium 3.5 measured
Long context reasoning (AA-LCR)Not measured69.3%Only Mistral Medium 3.5 measured
DTBench73.6%75.5%Mistral Medium 3.5
LMCA30.9%26.1%Claude Haiku 4.5
Surface Evolver BenchNot measured26.9%Only Mistral Medium 3.5 measured
ExploitBench13.7%Not measuredOnly Claude Haiku 4.5 measured
LMArena Text13971421Mistral Medium 3.5
LMArena Text: instruction following14141415Mistral Medium 3.5
LMArena Text: creative writing13711374Mistral Medium 3.5
LMArena VisionNot measured1222Only Mistral Medium 3.5 measured
LMArena Text: English14141433Mistral Medium 3.5
LMArena Text: non-English13771404Mistral Medium 3.5
LMArena Text: Chinese14181444Mistral Medium 3.5
LMArena Text: German13741453Mistral Medium 3.5
LMArena Text: Japanese1338Not measuredOnly Claude Haiku 4.5 measured
LMArena Text: Korean13461384Mistral Medium 3.5
LMArena Text: French14111448Mistral Medium 3.5
LMArena Text: Spanish14211411Claude Haiku 4.5
LMArena Text: Russian13811395Mistral Medium 3.5
LMArena Text: Polish13431430Mistral Medium 3.5
LMArena Text: multi-turn14091423Mistral Medium 3.5
LMArena Text: longer queries14271415Claude Haiku 4.5
LMArena Text: writing and language13861384Claude Haiku 4.5
LMArena Text: entertainment and media13691382Mistral Medium 3.5
LMArena Vision: EnglishNot measured1240Only Mistral Medium 3.5 measured
LMArena Vision: ChineseNot measured1244Only Mistral Medium 3.5 measured
LMArena Vision: reading textNot measured1233Only Mistral Medium 3.5 measured
LMArena Vision: humorNot measured1216Only Mistral Medium 3.5 measured
LMArena Vision: creative writingNot measured1198Only Mistral Medium 3.5 measured
LMArena Document1420Not measuredOnly Claude Haiku 4.5 measured
MultiChallenge50.5%Not measuredOnly Claude Haiku 4.5 measured
EQ-Bench 41064993Claude Haiku 4.5
Neither model has a result on the other 11 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Haiku 4.5 and Mistral Medium 3.5
BenchmarkClaude Haiku 4.5Mistral Medium 3.5Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Haiku 4.5$0.0035Fits in one request
Mistral Medium 3.5$0.0053Fits in one request

Claude Haiku 4.5 costs less

Repository review

50K input + 3K output tokens

Claude Haiku 4.5$0.065Fits in one request
Mistral Medium 3.5$0.098Fits in one request

Claude Haiku 4.5 costs less

Agent loop

200K input + 10K output tokens

Claude Haiku 4.5$0.250Exceeds the context window
Mistral Medium 3.5$0.375Fits in one request

Claude Haiku 4.5 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Haiku 4.5 and Mistral Medium 3.5
SpecificationAnthropic Claude Haiku 4.5Mistral Medium 3.5
MakerAnthropicMistral AI
WeightsNo public weights listedNo public weights listed
ReleasedOctober 15, 2025April 30, 2026
Context window200K262K
Input $/Mtok$1.00$1.50
Output $/Mtok$5.00$7.50
Coding index35.625.5
Independent measurements behind it43
Cost per solved task$0.56$6.02
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Haiku 4.5 better than Mistral Medium 3.5 for coding?

Pick Claude Haiku 4.5 for coding: it scores 35.6 on the Vibe Coding Index against 25.5 for Mistral Medium 3.5. Pick Mistral Medium 3.5 for a larger context window (262K against 200K tokens) and work measured by AA Coding Index or LMArena Text: coding, where it leads.

Which is cheaper, Claude Haiku 4.5 or Mistral Medium 3.5?

Claude Haiku 4.5 costs $1.00 per million input tokens and $5.00 per million output tokens; Mistral Medium 3.5 costs $1.50 and $7.50. Per solved SWE-bench Verified task, Claude Haiku 4.5 costs $0.56 and Mistral Medium 3.5 $6.02.

Which has the bigger context window, Claude Haiku 4.5 or Mistral Medium 3.5?

Mistral Medium 3.5, with 262K tokens against 200K.

How many benchmarks is the Claude Haiku 4.5 vs Mistral Medium 3.5 comparison based on?

63 benchmarks have a result for both models as of October 22, 2026. Claude Haiku 4.5's coding index rests on 4 independent benchmarks and Mistral Medium 3.5's on 3. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/claude-haiku-4-5-vs-mistral-medium-3-5" title="Claude Haiku 4.5 vs Mistral Medium 3.5, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/claude-haiku-4-5-vs-mistral-medium-3-5">LLMBenchmark.ai, Claude Haiku 4.5 vs Mistral Medium 3.5</a></p>