LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Mistral Medium 3.5

  • Mistral AI
  • Released April 30, 2026
  • No public weights listed
  • 262K context

As of October 20, 2026, Mistral Medium 3.5 ranks #124 of 213 models overall with 14.2 on the Artificial Analysis Intelligence Index. Its strongest category is agentic, where it ranks #58 of 87. Mistral Medium 3.5 costs $1.50 per million input tokens and $7.50 per million output tokens. It was released on April 30, 2026.

Its output price ranks 272 of 349 priced models, counting from the cheapest.

  • Coding index 9.2 Thin, 1 benchmark
  • Cost per solved task $6.02 One SWE-bench Verified task, solved
  • Output, per million tokens $7.50 272 of 349 from the cheapest
  • Input, per million tokens $1.50 OpenRouter list price
  • Context window 262K Tokens per request

About and specs

Mistral Medium 3.5 is a dense 128B instruction-following model from Mistral AI. It supports text and image inputs with text output, and is designed for agentic workflows, coding, and complex...

API model id mistralai/mistral-medium-3-5
  • Tool callingListed
  • Structured outputsListed
  • JSON modeListed
  • Reasoning modeListed
  • Web searchNot listed
Takes in
Text, Images, Files
Gives back
Text
Context window
262K tokens
Max output
210K tokens
Knowledge cutoff
Not published
Cached input $/Mtok
No cache price listed
Cache write $/Mtok
No cache write price listed
Reasoning $/Mtok
Not priced apart
Web search, per request
No search price listed
Tokenizer
Mistral
Requests moderated
No
Withdrawn on
No date announced
Parameters
Not published
Downloads, all time
No public weights
Training compute
No estimate published
Output speed
154 tokens/s
Time to first token
0.7 s
Speed on OpenRouter
142 tokens/s via Mistral, 30-minute median
First token on OpenRouter
0.3 s via Mistral, 30-minute median

Benchmarks: 80 of 190 measured

The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.

Where it stands

Full leaderboard
#124of 213 overall 14.2AA Intelligence Index

Measured in 5 of 6 categories. A place counts only the models measured on that board.

Coding index

9.2
  • Aider polyglot Not measured
  • SWE-bench Verified Not measured
  • LiveBench coding Not measured
  • LMArena WebDev Elo, scaled from 1200 to 1900 1264 Elo 9 of 100

The index averages only the coding benchmarks that have a result; the others are skipped, never filled in. How it is weighted

Other public boards

All rankings

Coding12 of 34 boards

6 more coding boards

Not measured on SWE-bench Lite, SWE-bench (full test set), SWE-bench Multimodal, SWE-bench Multilingual, LiveCodeBench (Vals AI), Terminal-Bench 4 (Vals AI), ProgramBench (Vals AI), IOI (Vals AI), SWE-bench Multimodal (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), CyberBench (Vals AI), LiveCodeBench (Artificial Analysis run), Terminal-Bench, DeepSWE, FrontierCode, FrontierSWE, GSO-Bench, WeirdML, MirrorCode, Cybench, LMArena WebDev: from an image

Intelligence2 of 2 boards

Agentic work6 of 39 boards

Not measured on Design Arena: agents building web apps, Design Arena: agents building full-stack apps, Design Arena: agents building mobile apps, Design Arena: agents building Android apps, Design Arena: agents building Godot games, Design Arena: agents building games, Design Arena: HTML slides, Design Arena: PowerPoint slides, Design Arena: spreadsheets, LiveBench research, LiveBench browser, LiveBench long agentic, SREBench (Vals AI), Harvey's Legal Agent Benchmark (Vals AI), BioMysteryBench (Vals AI), Terminal-Bench-Science (Vals AI), Vals Science Index, Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), APEX-Agents, METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, BALROG, DeepResearch Bench, PostTrainBench, TheAgentCompany, OSWorld, SpireClimb, Vending-Bench 2, LMArena Search

Reasoning8 of 21 boards

2 more reasoning boards

Not measured on LiveBench reasoning, MysteryMechanism (Vals AI), MMMU Pro (Vals AI), GPQA Diamond (Epoch AI run), ARC-AGI, ARC-AGI-2, Humanity's Last Exam, SimpleBench, Chess puzzles, Mystery game puzzles, EBR-bench, VPCT, BIG-Bench Hard

Math3 of 13 boards

Not measured on AIME, MATH 500 (Vals AI), MGSM (Vals AI), AA Math Index, AIME 2025 (Artificial Analysis run), OTIS Mock AIME, FrontierMath, tiers 1 to 3, FrontierMath, tier 4, MATH level 5, GSM8K

Knowledge10 of 17 boards

4 more knowledge boards

Not measured on LegalBench (Vals AI), MedQA (Vals AI), MMLU Pro (Artificial Analysis run), SimpleQA Verified, MMLU, GeoBench, AI2 Reasoning Challenge

Web design8 of 9 boards

2 more web design boards

Not measured on LiveBench design

General30 of 46 boards

24 more general boards

Not measured on Vals Index, LiveBench data analysis, Public Benefits Bench (Vals AI), Fiction.LiveBench, Creative writing (Lech Mazur), CL-bench, Furniture assembly, ExploitBench, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Text: Japanese, LMArena Vision: captioning, LMArena Vision: recognizing things, LMArena Document

Image generation0 of 5 boards

Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit

Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.

All 190 benchmarks as a table
Benchmark results for Mistral Medium 3.5
BenchmarkResultIndex weight
Aider polyglotCoding Not measured 35%
SWE-bench VerifiedCoding Not measured 30%
SWE-bench LiteCoding Not measured Not in index
SWE-bench (full test set)Coding Not measured Not in index
SWE-bench MultimodalCoding Not measured Not in index
SWE-bench MultilingualCoding Not measured Not in index
LiveBench codingCoding Not measured 20%
LMArena WebDevCoding 1264 15%
Vals IndexGeneral Not measured Not in index
GPQA DiamondReasoning 34.9% Not in index
AIMEMath Not measured Not in index
MMLU ProKnowledge 75.3% Not in index
AA Intelligence IndexIntelligence 14.2 Not in index
AA Coding IndexCoding 46.9 Not in index
AA Agentic IndexAgentic work 7.0 Not in index
Design Arena: websitesWeb design 1142 Not in index
Design Arena: UI componentsWeb design 1079 Not in index
Design Arena: game devWeb design 1079 Not in index
Design Arena: data vizWeb design 1120 Not in index
Design Arena: 3DWeb design 1061 Not in index
Design Arena: all code categoriesWeb design 1122 Not in index
Design Arena: SVGWeb design 948 Not in index
Design Arena: ASCII artWeb design 1063 Not in index
Design Arena: agents building web appsAgentic work Not measured Not in index
Design Arena: agents building full-stack appsAgentic work Not measured Not in index
Design Arena: agents building mobile appsAgentic work Not measured Not in index
Design Arena: agents building Android appsAgentic work Not measured Not in index
Design Arena: agents building Godot gamesAgentic work Not measured Not in index
Design Arena: agents building gamesAgentic work Not measured Not in index
Design Arena: HTML slidesAgentic work Not measured Not in index
Design Arena: PowerPoint slidesAgentic work Not measured Not in index
Design Arena: spreadsheetsAgentic work Not measured Not in index
Design Arena: imagesImage generation Not measured Not in index
Design Arena: graphic designImage generation Not measured Not in index
Design Arena: logosImage generation Not measured Not in index
LiveBench reasoningReasoning Not measured Not in index
LiveBench data analysisGeneral Not measured Not in index
LiveBench researchAgentic work Not measured Not in index
LiveBench browserAgentic work Not measured Not in index
LiveBench long agenticAgentic work Not measured Not in index
LiveBench designWeb design Not measured Not in index
LiveCodeBench (Vals AI)Coding Not measured Not in index
SWE-bench Verified (Vals AI)Coding 66.4% Not in index
Terminal-Bench 4 (Vals AI)Coding Not measured Not in index
Vibe Code Bench (Vals AI)Coding 2.9% Not in index
Code migration (Vals AI)Coding 5.1% Not in index
ProgramBench (Vals AI)Coding Not measured Not in index
SREBench (Vals AI)Agentic work Not measured Not in index
IOI (Vals AI)Coding Not measured Not in index
Terminal-Bench 2.1 (Vals AI)Coding 39.0% Not in index
SWE-bench Multimodal (Vals AI)Coding Not measured Not in index
Vibe Code Bench 1-100 (Vals AI)Coding Not measured Not in index
SkillsBench (Vals AI)Coding Not measured Not in index
CyberBench (Vals AI)Coding Not measured Not in index
Finance Agent (Vals AI)Agentic work 32.1% Not in index
Tax Agent Bench (Vals AI)Agentic work 4.5% Not in index
Legal Research Bench (Vals AI)Agentic work 9.1% Not in index
Harvey's Legal Agent Benchmark (Vals AI)Agentic work Not measured Not in index
Excel Modeling Benchmark (Vals AI)Agentic work 11.2% Not in index
BioMysteryBench (Vals AI)Agentic work Not measured Not in index
Terminal-Bench-Science (Vals AI)Agentic work Not measured Not in index
Vals Science IndexAgentic work Not measured Not in index
Time Horizon Index (Vals AI)Agentic work Not measured Not in index
CUA-bench (Vals AI)Agentic work Not measured Not in index
Robo-bench (Vals AI)Agentic work Not measured Not in index
Public Benefits Bench (Vals AI)General Not measured Not in index
MysteryMechanism (Vals AI)Reasoning Not measured Not in index
MMMU Pro (Vals AI)Reasoning Not measured Not in index
MATH 500 (Vals AI)Math Not measured Not in index
MGSM (Vals AI)Math Not measured Not in index
SAGE (Vals AI)General 37.6% Not in index
LegalBench (Vals AI)Knowledge Not measured Not in index
CaseLaw (Vals AI)Knowledge 44.2% Not in index
CorpFin (Vals AI)Knowledge 58.8% Not in index
TaxEval (Vals AI)Knowledge 68.0% Not in index
MortgageTax (Vals AI)Knowledge 28.9% Not in index
MedQA (Vals AI)Knowledge Not measured Not in index
MedCode (Vals AI)Knowledge 33.8% Not in index
MedScribe (Vals AI)General 67.7% Not in index
Vals Multimodal IndexGeneral 34.8% Not in index
AA Math IndexMath Not measured Not in index
GPQA Diamond (Artificial Analysis run)Reasoning 74.8% Not in index
Humanity's Last Exam (Artificial Analysis run)Reasoning 13.8% Not in index
MMLU Pro (Artificial Analysis run)Knowledge Not measured Not in index
LiveCodeBench (Artificial Analysis run)Coding Not measured Not in index
SciCodeCoding 40.2% Not in index
Terminal-Bench Hard (Artificial Analysis run)Coding 33.3% Not in index
IFBenchGeneral 68.8% Not in index
Long context reasoning (AA-LCR)General 69.3% Not in index
τ²-Bench TelecomAgentic work 94.2% Not in index
AIME 2025 (Artificial Analysis run)Math Not measured Not in index
Terminal-BenchCoding Not measured Not in index
DeepSWECoding Not measured Not in index
FrontierCodeCoding Not measured Not in index
FrontierSWECoding Not measured Not in index
GSO-BenchCoding Not measured Not in index
WeirdMLCoding Not measured Not in index
MirrorCodeCoding Not measured Not in index
APEX-AgentsAgentic work Not measured Not in index
METR time horizonsAgentic work Not measured Not in index
Remote Labor IndexAgentic work Not measured Not in index
GDPvalAgentic work Not measured Not in index
OSWorld 2.0Agentic work Not measured Not in index
BALROGAgentic work Not measured Not in index
DeepResearch BenchAgentic work Not measured Not in index
PostTrainBenchAgentic work Not measured Not in index
GPQA Diamond (Epoch AI run)Reasoning Not measured Not in index
ARC-AGIReasoning Not measured Not in index
ARC-AGI-2Reasoning Not measured Not in index
Humanity's Last ExamReasoning Not measured Not in index
SimpleBenchReasoning Not measured Not in index
Chess puzzlesReasoning Not measured Not in index
Mystery game puzzlesReasoning Not measured Not in index
EBR-benchReasoning Not measured Not in index
OTIS Mock AIMEMath Not measured Not in index
FrontierMath, tiers 1 to 3Math Not measured Not in index
FrontierMath, tier 4Math Not measured Not in index
ProofBenchMath 9.0% Not in index
MATH level 5Math Not measured Not in index
GSM8KMath Not measured Not in index
SimpleQA VerifiedKnowledge Not measured Not in index
MMLUKnowledge Not measured Not in index
GeoBenchKnowledge Not measured Not in index
DTBenchGeneral 75.5% Not in index
LMCAGeneral 26.1% Not in index
Fiction.LiveBenchGeneral Not measured Not in index
Creative writing (Lech Mazur)General Not measured Not in index
CL-benchGeneral Not measured Not in index
Surface Evolver BenchGeneral 26.9% Not in index
Furniture assemblyGeneral Not measured Not in index
ExploitBenchGeneral Not measured Not in index
CybenchCoding Not measured Not in index
TheAgentCompanyAgentic work Not measured Not in index
OSWorldAgentic work Not measured Not in index
SpireClimbAgentic work Not measured Not in index
VPCTReasoning Not measured Not in index
BIG-Bench HardReasoning Not measured Not in index
AI2 Reasoning ChallengeKnowledge Not measured Not in index
HellaSwagGeneral Not measured Not in index
WinoGrandeGeneral Not measured Not in index
PIQAGeneral Not measured Not in index
CL-bench LifeGeneral Not measured Not in index
ALE-BenchCoding 764.0 Not in index
Vending-Bench 2Agentic work Not measured Not in index
Epoch Capabilities IndexIntelligence 141.5 Not in index
LMArena TextGeneral 1421 Not in index
LMArena Text: codingCoding 1461 Not in index
LMArena Text: hard promptsReasoning 1437 Not in index
LMArena Text: mathMath 1431 Not in index
LMArena Text: instruction followingGeneral 1415 Not in index
LMArena Text: creative writingGeneral 1374 Not in index
LMArena VisionGeneral 1222 Not in index
LMArena Text: EnglishGeneral 1433 Not in index
LMArena Text: non-EnglishGeneral 1405 Not in index
LMArena Text: ChineseGeneral 1444 Not in index
LMArena Text: GermanGeneral 1453 Not in index
LMArena Text: JapaneseGeneral Not measured Not in index
LMArena Text: KoreanGeneral 1384 Not in index
LMArena Text: FrenchGeneral 1449 Not in index
LMArena Text: SpanishGeneral 1411 Not in index
LMArena Text: RussianGeneral 1395 Not in index
LMArena Text: PolishGeneral 1430 Not in index
LMArena Text: multi-turnGeneral 1424 Not in index
LMArena Text: longer queriesGeneral 1416 Not in index
LMArena Text: expertReasoning 1432 Not in index
LMArena Text: hard prompts in EnglishReasoning 1445 Not in index
LMArena Text: software and ITCoding 1458 Not in index
LMArena Text: mathematical workMath 1441 Not in index
LMArena Text: scienceKnowledge 1428 Not in index
LMArena Text: medicine and healthcareKnowledge 1408 Not in index
LMArena Text: legal and governmentKnowledge 1438 Not in index
LMArena Text: business and financeKnowledge 1426 Not in index
LMArena Text: writing and languageGeneral 1384 Not in index
LMArena Text: entertainment and mediaGeneral 1382 Not in index
LMArena WebDev: ReactCoding 1254 Not in index
LMArena WebDev: HTMLCoding 1308 Not in index
LMArena WebDev: from an imageCoding Not measured Not in index
LMArena Vision: EnglishGeneral 1240 Not in index
LMArena Vision: ChineseGeneral 1244 Not in index
LMArena Vision: reading textGeneral 1233 Not in index
LMArena Vision: diagramsReasoning 1254 Not in index
LMArena Vision: homeworkReasoning 1230 Not in index
LMArena Vision: humorGeneral 1216 Not in index
LMArena Vision: captioningGeneral Not measured Not in index
LMArena Vision: recognizing thingsGeneral Not measured Not in index
LMArena Vision: creative writingGeneral 1198 Not in index
LMArena SearchAgentic work Not measured Not in index
LMArena DocumentGeneral Not measured Not in index
LMArena Text to ImageImage generation Not measured Not in index
LMArena Image EditImage generation Not measured Not in index

What it costs

A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.

Output price against the market

Mistral Medium 3.5 pricing
$0.0112Dashed line: median $1.80, log scale$600.00
$7.50 per million output tokens is cheaper than 22% of the 344 paid models in the catalog.

Cost per solved task

How it is computed
$4.00one attempt, Vals AI 66.4%tasks solved $6.02per solved task

Nearly as good as Mistral Medium 3.5, for less

What the boards say about its runs

Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.

What each board publishes about the runs behind Mistral: Mistral Medium 3.5's results
BoardResultWhat the run costAlso published
SWE-bench Verified (Vals AI) 66.4% $4.00 per test Duration, as printed 19m 04s
Vibe Code Bench (Vals AI) 2.9% $16.74 per test Duration, as printed 41m 11s
Code migration (Vals AI) 5.1% $18.62 per test Duration, as printed 3h 38m
Terminal-Bench 2.1 (Vals AI) 39.0% $1.19 per test Duration, as printed 16m 29s
Finance Agent (Vals AI) 32.1% $1.91 per test Duration, as printed 12m 48s
Tax Agent Bench (Vals AI) 4.5% $1.44 per test Duration, as printed 7m 11s
Legal Research Bench (Vals AI) 9.1% $1.31 per test Duration, as printed 10m 13s
Excel Modeling Benchmark (Vals AI) 11.2% $10.60 per test Duration, as printed 51m 22s
Vals Multimodal Index 34.8% $3.45 per test Duration, as printed 12m 15s
ProofBench 9.0% $1.302 per test Time per proof 7m 59s
Surface Evolver Bench 26.9% $6.3482 of the run Pass rate 6.3% · Tokens for the run 2.8M
ALE-Bench 764.0 $0.273 per problem Tokens per problem 38,906
55 more boards
What each board publishes about the runs behind Mistral: Mistral Medium 3.5's results, continued
LMArena WebDev 1264 Elo Not published Votes 2,317 · Interval (±) ±14.8
GPQA Diamond 34.9% Not published Latency, as printed 4m 16s
MMLU Pro 75.3% Not published Latency, as printed 1m 06s
Design Arena: websites 1142 Elo Not published Battles 5,825
Design Arena: UI components 1079 Elo Not published Battles 889
Design Arena: game dev 1079 Elo Not published Battles 1,521
Design Arena: data viz 1120 Elo Not published Battles 811
Design Arena: 3D 1061 Elo Not published Battles 2,065
Design Arena: all code categories 1122 Elo Not published Battles 10,894
Design Arena: SVG 948 Elo Not published Battles 1,157
Design Arena: ASCII art 1063 Elo Not published Battles 205
SAGE (Vals AI) 37.6% Not published Latency, as printed 56 s
CaseLaw (Vals AI) 44.2% Not published Latency, as printed 1m 05s
CorpFin (Vals AI) 58.8% Not published Latency, as printed 44 s
TaxEval (Vals AI) 68.0% Not published Latency, as printed 1m 42s
MortgageTax (Vals AI) 28.9% Not published Latency, as printed 1m 08s
MedCode (Vals AI) 33.8% Not published Latency, as printed 35 s
MedScribe (Vals AI) 67.7% Not published Latency, as printed 1m 44s
LMArena Text 1421 Elo Not published Votes 11,778 · Interval (±) ±6.4
LMArena Text: coding 1461 Elo Not published Votes 3,293 · Interval (±) ±10.7
LMArena Text: hard prompts 1437 Elo Not published Votes 7,648 · Interval (±) ±7.7
LMArena Text: math 1431 Elo Not published Votes 565 · Interval (±) ±24.3
LMArena Text: instruction following 1415 Elo Not published Votes 3,831 · Interval (±) ±9.9
LMArena Text: creative writing 1374 Elo Not published Votes 2,073 · Interval (±) ±13.7
LMArena Vision 1222 Elo Not published Votes 5,375 · Interval (±) ±9.5
LMArena Text: English 1433 Elo Not published Votes 5,651 · Interval (±) ±8.4
LMArena Text: non-English 1405 Elo Not published Votes 6,127 · Interval (±) ±8.1
LMArena Text: Chinese 1444 Elo Not published Votes 620 · Interval (±) ±23.4
LMArena Text: German 1453 Elo Not published Votes 174 · Interval (±) ±43.5
LMArena Text: Korean 1384 Elo Not published Votes 189 · Interval (±) ±43.5
LMArena Text: French 1449 Elo Not published Votes 452 · Interval (±) ±29.7
LMArena Text: Spanish 1411 Elo Not published Votes 389 · Interval (±) ±31.1
LMArena Text: Russian 1395 Elo Not published Votes 1,235 · Interval (±) ±17.1
LMArena Text: Polish 1430 Elo Not published Votes 233 · Interval (±) ±37.1
LMArena Text: multi-turn 1424 Elo Not published Votes 1,917 · Interval (±) ±13.9
LMArena Text: longer queries 1416 Elo Not published Votes 5,095 · Interval (±) ±9.0
LMArena Text: expert 1432 Elo Not published Votes 1,208 · Interval (±) ±16.9
LMArena Text: hard prompts in English 1445 Elo Not published Votes 3,851 · Interval (±) ±10.0
LMArena Text: software and IT 1458 Elo Not published Votes 4,593 · Interval (±) ±9.2
LMArena Text: mathematical work 1441 Elo Not published Votes 652 · Interval (±) ±22.8
LMArena Text: science 1428 Elo Not published Votes 1,940 · Interval (±) ±13.6
LMArena Text: medicine and healthcare 1408 Elo Not published Votes 845 · Interval (±) ±20.8
LMArena Text: legal and government 1438 Elo Not published Votes 890 · Interval (±) ±20.2
LMArena Text: business and finance 1426 Elo Not published Votes 2,257 · Interval (±) ±12.7
LMArena Text: writing and language 1384 Elo Not published Votes 2,988 · Interval (±) ±11.2
LMArena Text: entertainment and media 1382 Elo Not published Votes 2,681 · Interval (±) ±12.0
LMArena WebDev: React 1254 Elo Not published Votes 1,972 · Interval (±) ±16.2
LMArena WebDev: HTML 1308 Elo Not published Votes 261 · Interval (±) ±41.3
LMArena Vision: English 1240 Elo Not published Votes 2,314 · Interval (±) ±13.7
LMArena Vision: Chinese 1244 Elo Not published Votes 287 · Interval (±) ±37.5
LMArena Vision: reading text 1233 Elo Not published Votes 3,905 · Interval (±) ±10.4
LMArena Vision: diagrams 1254 Elo Not published Votes 1,538 · Interval (±) ±16.0
LMArena Vision: homework 1230 Elo Not published Votes 803 · Interval (±) ±22.0
LMArena Vision: humor 1216 Elo Not published Votes 238 · Interval (±) ±39.3
LMArena Vision: creative writing 1198 Elo Not published Votes 343 · Interval (±) ±33.1

On these lists

Compare with models of a similar score

All 135 comparisons for Mistral Medium 3.5