LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Sonnet 5 vs Mistral Medium 3.5

Updated October 21, 2026. 76 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Sonnet 5Anthropic
Coding
63.5
Overall
38.2
Output $/M
$10.00
74
Mistral Medium 3.5Mistral AI
Coding
9.2
Overall
14.2
Output $/M
$7.50
2
vs boards won of 76 shared

Decision reading

Pick Claude Sonnet 5 for coding: it scores 63.5 on the Vibe Coding Index against 9.2 for Mistral Medium 3.5.

Pick Mistral Medium 3.5 when output tokens cost 1.3x less, or when what matters is LMArena Text: German or LMArena Text: Polish, where it leads.

Shared results
76
Claude Sonnet 5 only
44
Mistral Medium 3.5 only
4
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Sonnet 5 63.5 from 2 benchmarks, Mistral Medium 3.5 9.2 from 1 benchmark.
Widest category
Agentic work, 34.2 points apart on average over 5 shared benchmarks.
Widest single gap
Vibe Code Bench (Vals AI): Claude Sonnet 5 81.3% against Mistral Medium 3.5 2.9%, 78.4 points apart on a 0 to 100 scale.
Output price
Claude Sonnet 5 $10.00 against Mistral Medium 3.5 $7.50 per million output tokens, 1.3x apart.
Context window
Claude Sonnet 5 takes 1M tokens, Mistral Medium 3.5 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Sonnet 5BarsMistral Medium 3.5Ties
Coding120
Intelligence20
Agentic work50
Reasoning80
Math30
Knowledge90
Web design80
General272
All shared boards742
CodingLike-for-likeFour of these boards feed the Vibe Coding Index120
Coding benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
LiveBench coding74.7%Not measuredOnly Claude Sonnet 5 measured
LMArena WebDev15401264Claude Sonnet 5
AA Coding Index71.546.9Claude Sonnet 5
LiveCodeBench (Vals AI)82.4%Not measuredOnly Claude Sonnet 5 measured
SWE-bench Verified (Vals AI)79.6%66.4%Claude Sonnet 5
Terminal-Bench 4 (Vals AI)10.6%Not measuredOnly Claude Sonnet 5 measured
Vibe Code Bench (Vals AI)81.3%2.9%Claude Sonnet 5
Code migration (Vals AI)44.4%5.1%Claude Sonnet 5
ProgramBench (Vals AI)0.0%Not measuredOnly Claude Sonnet 5 measured
IOI (Vals AI)45.0%Not measuredOnly Claude Sonnet 5 measured
Terminal-Bench 2.1 (Vals AI)74.5%39.0%Claude Sonnet 5
Vibe Code Bench 1-100 (Vals AI)13.8%Not measuredOnly Claude Sonnet 5 measured
SkillsBench (Vals AI)46.5%Not measuredOnly Claude Sonnet 5 measured
CyberBench (Vals AI)70.3%Not measuredOnly Claude Sonnet 5 measured
SciCode54.3%40.2%Claude Sonnet 5
Terminal-Bench Hard (Artificial Analysis run)Not measured33.3%Only Mistral Medium 3.5 measured
FrontierCode42.7%Not measuredOnly Claude Sonnet 5 measured
GSO-Bench37.3%Not measuredOnly Claude Sonnet 5 measured
WeirdML68.8%Not measuredOnly Claude Sonnet 5 measured
ALE-Bench1463.1764.0Claude Sonnet 5
LMArena Text: coding14831460Claude Sonnet 5
LMArena Text: software and IT14741458Claude Sonnet 5
LMArena WebDev: React15411254Claude Sonnet 5
LMArena WebDev: HTML15271308Claude Sonnet 5
LMArena WebDev: from an image1540Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 13 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
AA Intelligence Index38.214.2Claude Sonnet 5
Epoch Capabilities Index156.9141.4Claude Sonnet 5
Agentic workLike-for-likePublic boards, shown as published, kept out of the index50
Agentic work benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
AA Agentic Index43.67.0Claude Sonnet 5
Design Arena: agents building web apps1245Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building full-stack apps1249Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building mobile apps1215Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building Android apps1231Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building Godot games1225Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building games1227Not measuredOnly Claude Sonnet 5 measured
Design Arena: HTML slides1218Not measuredOnly Claude Sonnet 5 measured
Design Arena: PowerPoint slides1216Not measuredOnly Claude Sonnet 5 measured
Design Arena: spreadsheets1004Not measuredOnly Claude Sonnet 5 measured
LiveBench research82.8%Not measuredOnly Claude Sonnet 5 measured
LiveBench browser72.0%Not measuredOnly Claude Sonnet 5 measured
LiveBench long agentic39.0%Not measuredOnly Claude Sonnet 5 measured
SREBench (Vals AI)0.4%Not measuredOnly Claude Sonnet 5 measured
Finance Agent (Vals AI)53.9%32.1%Claude Sonnet 5
Tax Agent Bench (Vals AI)29.4%4.5%Claude Sonnet 5
Legal Research Bench (Vals AI)41.8%9.1%Claude Sonnet 5
Excel Modeling Benchmark (Vals AI)66.3%11.2%Claude Sonnet 5
Terminal-Bench-Science (Vals AI)5.7%Not measuredOnly Claude Sonnet 5 measured
τ²-Bench TelecomNot measured94.2%Only Mistral Medium 3.5 measured
APEX-Agents54.5%Not measuredOnly Claude Sonnet 5 measured
Vending-Bench 2$6,378Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 17 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index80
Reasoning benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
GPQA Diamond88.9%34.9%Claude Sonnet 5
LiveBench reasoning88.7%Not measuredOnly Claude Sonnet 5 measured
MMMU Pro (Vals AI)83.0%Not measuredOnly Claude Sonnet 5 measured
GPQA Diamond (Artificial Analysis run)91.1%74.8%Claude Sonnet 5
Humanity's Last Exam (Artificial Analysis run)41.3%13.8%Claude Sonnet 5
GPQA Diamond (Epoch AI run)90.5%Not measuredOnly Claude Sonnet 5 measured
SimpleBench60.6%Not measuredOnly Claude Sonnet 5 measured
Chess puzzles45.0%Not measuredOnly Claude Sonnet 5 measured
Mystery game puzzles35.0%Not measuredOnly Claude Sonnet 5 measured
LMArena Text: hard prompts14611436Claude Sonnet 5
LMArena Text: expert14891432Claude Sonnet 5
LMArena Text: hard prompts in English14641445Claude Sonnet 5
LMArena Vision: diagrams12931254Claude Sonnet 5
LMArena Vision: homework13111230Claude Sonnet 5
Neither model has a result on the other 7 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
OTIS Mock AIME94.7%Not measuredOnly Claude Sonnet 5 measured
FrontierMath, tiers 1 to 365.6%Not measuredOnly Claude Sonnet 5 measured
FrontierMath, tier 429.3%Not measuredOnly Claude Sonnet 5 measured
ProofBench77.0%9.0%Claude Sonnet 5
LMArena Text: math14671431Claude Sonnet 5
LMArena Text: mathematical work14811440Claude Sonnet 5
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index90
Knowledge benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
MMLU Pro87.5%75.3%Claude Sonnet 5
LegalBench (Vals AI)83.9%Not measuredOnly Claude Sonnet 5 measured
CaseLaw (Vals AI)Not measured44.2%Only Mistral Medium 3.5 measured
CorpFin (Vals AI)67.0%58.8%Claude Sonnet 5
TaxEval (Vals AI)75.6%68.0%Claude Sonnet 5
MortgageTax (Vals AI)70.0%28.9%Claude Sonnet 5
MedCode (Vals AI)47.5%33.8%Claude Sonnet 5
SimpleQA Verified33.7%Not measuredOnly Claude Sonnet 5 measured
LMArena Text: science14601428Claude Sonnet 5
LMArena Text: medicine and healthcare14421409Claude Sonnet 5
LMArena Text: legal and government14541437Claude Sonnet 5
LMArena Text: business and finance14361426Claude Sonnet 5
Neither model has a result on the other 5 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index80
Web design benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
Design Arena: websites12741142Claude Sonnet 5
Design Arena: UI components12791079Claude Sonnet 5
Design Arena: game dev12781079Claude Sonnet 5
Design Arena: data viz12511120Claude Sonnet 5
Design Arena: 3D12611061Claude Sonnet 5
Design Arena: all code categories12761122Claude Sonnet 5
Design Arena: SVG1193949Claude Sonnet 5
Design Arena: ASCII art12071062Claude Sonnet 5
LiveBench design82.0%Not measuredOnly Claude Sonnet 5 measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index272
General benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
LiveBench data analysis71.7%Not measuredOnly Claude Sonnet 5 measured
Public Benefits Bench (Vals AI)66.0%Not measuredOnly Claude Sonnet 5 measured
SAGE (Vals AI)48.9%37.6%Claude Sonnet 5
MedScribe (Vals AI)76.0%67.7%Claude Sonnet 5
Vals Multimodal Index68.8%34.8%Claude Sonnet 5
IFBenchNot measured68.8%Only Mistral Medium 3.5 measured
Long context reasoning (AA-LCR)82.0%69.3%Claude Sonnet 5
DTBench92.5%75.5%Claude Sonnet 5
LMCA50.0%26.1%Claude Sonnet 5
Surface Evolver Bench60.0%26.9%Claude Sonnet 5
LMArena Text14421421Claude Sonnet 5
LMArena Text: instruction following14521415Claude Sonnet 5
LMArena Text: creative writing14161374Claude Sonnet 5
LMArena Vision12731222Claude Sonnet 5
LMArena Text: English14501433Claude Sonnet 5
LMArena Text: non-English14311404Claude Sonnet 5
LMArena Text: Chinese14781444Claude Sonnet 5
LMArena Text: German14421453Mistral Medium 3.5
LMArena Text: Japanese1422Not measuredOnly Claude Sonnet 5 measured
LMArena Text: Korean14121384Claude Sonnet 5
LMArena Text: French14631448Claude Sonnet 5
LMArena Text: Spanish14381411Claude Sonnet 5
LMArena Text: Russian14501395Claude Sonnet 5
LMArena Text: Polish14251430Mistral Medium 3.5
LMArena Text: multi-turn14531423Claude Sonnet 5
LMArena Text: longer queries14621415Claude Sonnet 5
LMArena Text: writing and language14361384Claude Sonnet 5
LMArena Text: entertainment and media14111382Claude Sonnet 5
LMArena Vision: English12751240Claude Sonnet 5
LMArena Vision: Chinese13311244Claude Sonnet 5
LMArena Vision: reading text12881233Claude Sonnet 5
LMArena Vision: humor12611216Claude Sonnet 5
LMArena Vision: creative writing12461198Claude Sonnet 5
LMArena Document1466Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Sonnet 5 and Mistral Medium 3.5
BenchmarkClaude Sonnet 5Mistral Medium 3.5Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Sonnet 5$0.0070Fits in one request
Mistral Medium 3.5$0.0053Fits in one request

Mistral Medium 3.5 costs less

Repository review

50K input + 3K output tokens

Claude Sonnet 5$0.130Fits in one request
Mistral Medium 3.5$0.098Fits in one request

Mistral Medium 3.5 costs less

Agent loop

200K input + 10K output tokens

Claude Sonnet 5$0.500Fits in one request
Mistral Medium 3.5$0.375Fits in one request

Mistral Medium 3.5 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Sonnet 5 and Mistral Medium 3.5
SpecificationAnthropic Claude Sonnet 5Mistral Medium 3.5
MakerAnthropicMistral AI
WeightsNo public weights listedNo public weights listed
ReleasedJune 30, 2026April 30, 2026
Context window1M262K
Input $/Mtok$2.00$1.50
Output $/Mtok$10.00$7.50
Coding index63.59.2
Independent measurements behind it21
Cost per solved task$1.87$6.02
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Sonnet 5 better than Mistral Medium 3.5 for coding?

Pick Claude Sonnet 5 for coding: it scores 63.5 on the Vibe Coding Index against 9.2 for Mistral Medium 3.5. Pick Mistral Medium 3.5 when output tokens cost 1.3x less, or when what matters is LMArena Text: German or LMArena Text: Polish, where it leads.

Which is cheaper, Claude Sonnet 5 or Mistral Medium 3.5?

Claude Sonnet 5 costs $2.00 per million input tokens and $10.00 per million output tokens; Mistral Medium 3.5 costs $1.50 and $7.50. Per solved SWE-bench Verified task, Claude Sonnet 5 costs $1.87 and Mistral Medium 3.5 $6.02.

Which has the bigger context window, Claude Sonnet 5 or Mistral Medium 3.5?

Claude Sonnet 5, with 1M tokens against 262K.

How many benchmarks is the Claude Sonnet 5 vs Mistral Medium 3.5 comparison based on?

76 benchmarks have a result for both models as of October 21, 2026. Claude Sonnet 5's coding index rests on 2 independent benchmarks and Mistral Medium 3.5's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next