Enter opens the highlighted result. Esc closes.

GPT-5.4 Nano vs Mistral Medium 3.5

GPT-5.4 Nano leads Mistral Medium 3.5 on coding, 44.8 to 25.5 on the Vibe Coding Index, and GPT-5.4 Nano costs 6.0x less per output token ($1.25 vs $7.50 per million). Updated October 22, 2026; 69 benchmarks have a result for both.

Replace GPT-5.4 Nano Replace Mistral Medium 3.5
GPT-5.4 NanoOpenAI
Coding
44.8
Overall
45.7
Output $/M
$1.25
29
Mistral Medium 3.5Mistral AI
Coding
25.5
Overall
37.3
Output $/M
$7.50
40
vs boards won of 69 shared

GPT-5.4 Nano or Mistral Medium 3.5: which to pick

Pick GPT-5.4 Nano for coding: it scores 44.8 on the Vibe Coding Index against 25.5 for Mistral Medium 3.5, though on 2 benchmarks against 3.

Pick Mistral Medium 3.5 for work measured by LMArena Text: coding or LMArena Text: software and IT, where it leads.

Model AGPT-5.4 NanoOpenAI44.8/1002 independent benchmarks$0.14 per solved taskModel BMistral Medium 3.5Mistral AI25.5/1003 independent benchmarks$6.02 per solved task
Shared results
69
GPT-5.4 Nano only
16
Mistral Medium 3.5 only
12
Like-for-like categories
7 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-5.4 Nano 44.8 from 2 benchmarks, Mistral Medium 3.5 25.5 from 3 benchmarks.
Widest category
Agentic work, 11.7 points apart on average over 6 shared benchmarks.
Widest single gap
GPQA Diamond: GPT-5.4 Nano 77.5% against Mistral Medium 3.5 34.9%, 42.7 points apart on a 0 to 100 scale.
Output price
GPT-5.4 Nano $1.25 against Mistral Medium 3.5 $7.50 per million output tokens, 6.0x apart.
Context window
GPT-5.4 Nano takes 400K tokens, Mistral Medium 3.5 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-5.4 NanoBarsMistral Medium 3.5Ties
Coding82
Intelligence20
Agentic work42
Reasoning36
Math03
Knowledge55
General722
All shared boards2940
CodingLike-for-likeSix of these boards feed the Vibe Coding Index82
Coding benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
LMArena WebDevNot measured1264Only Mistral Medium 3.5 measured
AA Coding Index56.146.9GPT-5.4 Nano
LiveCodeBench (Vals AI)84.0%Not measuredOnly GPT-5.4 Nano measured
SWE-bench Verified (Vals AI)69.8%66.4%GPT-5.4 Nano
Vibe Code Bench (Vals AI)26.1%2.9%GPT-5.4 Nano
Code migration (Vals AI)14.5%5.1%GPT-5.4 Nano
Terminal-Bench 2.1 (Vals AI)41.6%39.0%GPT-5.4 Nano
SciCode47.2%40.2%GPT-5.4 Nano
Terminal-Bench Hard (Artificial Analysis run)42.4%33.3%GPT-5.4 Nano
WeirdML49.2%Not measuredOnly GPT-5.4 Nano measured
ALE-Bench1004.5764.0GPT-5.4 Nano
LMArena Text: coding14041460Mistral Medium 3.5
LMArena Text: software and IT14021458Mistral Medium 3.5
LMArena WebDev: ReactNot measured1254Only Mistral Medium 3.5 measured
LMArena WebDev: HTMLNot measured1308Only Mistral Medium 3.5 measured
Neither model has a result on the other 24 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
AA Intelligence Index20.714.2GPT-5.4 Nano
Epoch Capabilities Index146.0141.4GPT-5.4 Nano
Agentic workLike-for-likePublic boards, shown as published, kept out of the index42
Agentic work benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
AA Agentic Index16.07.0GPT-5.4 Nano
Finance Agent (Vals AI)38.2%32.1%GPT-5.4 Nano
Tax Agent Bench (Vals AI)5.0%4.5%GPT-5.4 Nano
Legal Research Bench (Vals AI)6.3%9.1%Mistral Medium 3.5
Excel Modeling Benchmark (Vals AI)44.8%11.2%GPT-5.4 Nano
τ²-Bench Telecom76.0%94.2%Mistral Medium 3.5
Neither model has a result on the other 35 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index36
Reasoning benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
GPQA Diamond77.5%34.9%GPT-5.4 Nano
MMMU Pro (Vals AI)73.6%Not measuredOnly GPT-5.4 Nano measured
GPQA Diamond (Artificial Analysis run)81.7%74.8%GPT-5.4 Nano
Humanity's Last Exam (Artificial Analysis run)28.3%13.8%GPT-5.4 Nano
GPQA Diamond (Epoch AI run)78.5%Not measuredOnly GPT-5.4 Nano measured
ARC-AGI51.5%Not measuredOnly GPT-5.4 Nano measured
ARC-AGI-25.7%Not measuredOnly GPT-5.4 Nano measured
Chess puzzles45.0%Not measuredOnly GPT-5.4 Nano measured
Mystery game puzzles9.0%Not measuredOnly GPT-5.4 Nano measured
LMArena Text: hard prompts13811436Mistral Medium 3.5
LMArena Text: expert13961432Mistral Medium 3.5
LMArena Text: hard prompts in English13871445Mistral Medium 3.5
LMArena Vision: diagrams12101254Mistral Medium 3.5
LMArena Vision: homework12251230Mistral Medium 3.5
Kagi LLM Benchmark39.7%41.4%Mistral Medium 3.5
Neither model has a result on the other 7 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index03
Math benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
AIME88.8%Not measuredOnly GPT-5.4 Nano measured
OTIS Mock AIME87.8%Not measuredOnly GPT-5.4 Nano measured
FrontierMath, tiers 1 to 344.9%Not measuredOnly GPT-5.4 Nano measured
FrontierMath, tier 412.2%Not measuredOnly GPT-5.4 Nano measured
ProofBench5.0%9.0%Mistral Medium 3.5
LMArena Text: math14051431Mistral Medium 3.5
LMArena Text: mathematical work14091440Mistral Medium 3.5
Neither model has a result on the other 6 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index55
Knowledge benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
MMLU Pro77.2%75.3%GPT-5.4 Nano
LegalBench (Vals AI)77.9%Not measuredOnly GPT-5.4 Nano measured
CaseLaw (Vals AI)51.9%44.2%GPT-5.4 Nano
CorpFin (Vals AI)61.2%58.8%GPT-5.4 Nano
TaxEval (Vals AI)67.4%68.0%Mistral Medium 3.5
MortgageTax (Vals AI)59.1%28.9%GPT-5.4 Nano
MedCode (Vals AI)41.0%33.8%GPT-5.4 Nano
SimpleQA Verified11.7%Not measuredOnly GPT-5.4 Nano measured
LMArena Text: science13741428Mistral Medium 3.5
LMArena Text: medicine and healthcare13691409Mistral Medium 3.5
LMArena Text: legal and government13681437Mistral Medium 3.5
LMArena Text: business and finance13661426Mistral Medium 3.5
Neither model has a result on the other 6 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
Design Arena: websitesNot measured1142Only Mistral Medium 3.5 measured
Design Arena: UI componentsNot measured1076Only Mistral Medium 3.5 measured
Design Arena: game devNot measured1079Only Mistral Medium 3.5 measured
Design Arena: data vizNot measured1120Only Mistral Medium 3.5 measured
Design Arena: 3DNot measured1060Only Mistral Medium 3.5 measured
Design Arena: all code categoriesNot measured1121Only Mistral Medium 3.5 measured
Design Arena: SVGNot measured949Only Mistral Medium 3.5 measured
Design Arena: ASCII artNot measured1062Only Mistral Medium 3.5 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index722
General benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
SAGE (Vals AI)38.1%37.6%GPT-5.4 Nano
MedScribe (Vals AI)77.1%67.7%GPT-5.4 Nano
Vals Multimodal Index47.6%34.8%GPT-5.4 Nano
IFBench75.9%68.8%GPT-5.4 Nano
Long context reasoning (AA-LCR)76.7%69.3%GPT-5.4 Nano
DTBench80.3%75.5%GPT-5.4 Nano
LMCA36.9%26.1%GPT-5.4 Nano
Surface Evolver BenchNot measured26.9%Only Mistral Medium 3.5 measured
LMArena Text13721421Mistral Medium 3.5
LMArena Text: instruction following13621415Mistral Medium 3.5
LMArena Text: creative writing13151374Mistral Medium 3.5
LMArena Vision11961222Mistral Medium 3.5
LMArena Text: English13811433Mistral Medium 3.5
LMArena Text: non-English13591404Mistral Medium 3.5
LMArena Text: Chinese13911444Mistral Medium 3.5
LMArena Text: German13681453Mistral Medium 3.5
LMArena Text: Japanese1343Not measuredOnly GPT-5.4 Nano measured
LMArena Text: Korean13211384Mistral Medium 3.5
LMArena Text: French13951448Mistral Medium 3.5
LMArena Text: Spanish13711411Mistral Medium 3.5
LMArena Text: Russian13631395Mistral Medium 3.5
LMArena Text: Polish13661430Mistral Medium 3.5
LMArena Text: multi-turn13821423Mistral Medium 3.5
LMArena Text: longer queries13651415Mistral Medium 3.5
LMArena Text: writing and language13381384Mistral Medium 3.5
LMArena Text: entertainment and media13251382Mistral Medium 3.5
LMArena Vision: English12021240Mistral Medium 3.5
LMArena Vision: Chinese12321244Mistral Medium 3.5
LMArena Vision: reading text12041233Mistral Medium 3.5
LMArena Vision: humor11611216Mistral Medium 3.5
LMArena Vision: recognizing things1141Not measuredOnly GPT-5.4 Nano measured
LMArena Vision: creative writing11591198Mistral Medium 3.5
Neither model has a result on the other 14 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-5.4 Nano and Mistral Medium 3.5
BenchmarkGPT-5.4 NanoMistral Medium 3.5Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-5.4 Nano$0.0008Fits in one request
Mistral Medium 3.5$0.0053Fits in one request

GPT-5.4 Nano costs less

Repository review

50K input + 3K output tokens

GPT-5.4 Nano$0.014Fits in one request
Mistral Medium 3.5$0.098Fits in one request

GPT-5.4 Nano costs less

Agent loop

200K input + 10K output tokens

GPT-5.4 Nano$0.052Fits in one request
Mistral Medium 3.5$0.375Fits in one request

GPT-5.4 Nano costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-5.4 Nano and Mistral Medium 3.5
SpecificationOpenAI GPT-5.4 NanoMistral Medium 3.5
MakerOpenAIMistral AI
WeightsNo public weights listedNo public weights listed
ReleasedMarch 17, 2026April 30, 2026
Context window400K262K
Input $/Mtok$0.20$1.50
Output $/Mtok$1.25$7.50
Coding index44.825.5
Independent measurements behind it23
Cost per solved task$0.14$6.02
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-5.4 Nano better than Mistral Medium 3.5 for coding?

Pick GPT-5.4 Nano for coding: it scores 44.8 on the Vibe Coding Index against 25.5 for Mistral Medium 3.5, though on 2 benchmarks against 3. Pick Mistral Medium 3.5 for work measured by LMArena Text: coding or LMArena Text: software and IT, where it leads.

Which is cheaper, GPT-5.4 Nano or Mistral Medium 3.5?

GPT-5.4 Nano costs $0.20 per million input tokens and $1.25 per million output tokens; Mistral Medium 3.5 costs $1.50 and $7.50. Per solved SWE-bench Verified task, GPT-5.4 Nano costs $0.14 and Mistral Medium 3.5 $6.02.

Which has the bigger context window, GPT-5.4 Nano or Mistral Medium 3.5?

GPT-5.4 Nano, with 400K tokens against 262K.

How many benchmarks is the GPT-5.4 Nano vs Mistral Medium 3.5 comparison based on?

69 benchmarks have a result for both models as of October 22, 2026. GPT-5.4 Nano's coding index rests on 2 independent benchmarks and Mistral Medium 3.5's on 3. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/gpt-5-4-nano-vs-mistral-medium-3-5" title="GPT-5.4 Nano vs Mistral Medium 3.5, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/gpt-5-4-nano-vs-mistral-medium-3-5">LLMBenchmark.ai, GPT-5.4 Nano vs Mistral Medium 3.5</a></p>