LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Mistral Medium 3.5 vs Qwen3.8 27B

Updated October 21, 2026. 65 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Mistral Medium 3.5Mistral AI
Coding
9.2
Overall
14.2
Output $/M
$7.50
2
Qwen3.8 27BQwen
Coding
73.6
Overall
33.7
Output $/M
$1.35
63
vs boards won of 65 shared

Decision reading

Pick Qwen3.8 27B for coding: it scores 73.6 on the Vibe Coding Index against 9.2 for Mistral Medium 3.5.

Pick Mistral Medium 3.5 when what matters is MedCode (Vals AI) or LMArena Text: German, where it leads.

Shared results
65
Mistral Medium 3.5 only
15
Qwen3.8 27B only
20
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Mistral Medium 3.5 9.2 from 1 benchmark, Qwen3.8 27B 73.6 from 2 benchmarks.
Widest category
Agentic work, 31.4 points apart on average over 5 shared benchmarks.
Widest single gap
Vibe Code Bench (Vals AI): Mistral Medium 3.5 2.9% against Qwen3.8 27B 64.8%, 62.0 points apart on a 0 to 100 scale.
Output price
Mistral Medium 3.5 $7.50 against Qwen3.8 27B $1.35 per million output tokens, 5.6x apart.
Context window
Mistral Medium 3.5 takes 262K tokens, Qwen3.8 27B 1M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryMistral Medium 3.5BarsQwen3.8 27BTies
Coding011
Intelligence02
Agentic work05
Reasoning08
Math03
Knowledge17
General127
All shared boards263
CodingLike-for-likeFour of these boards feed the Vibe Coding Index011
Coding benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
LiveBench codingNot measured86.8%Only Qwen3.8 27B measured
LMArena WebDev12641593Qwen3.8 27B
AA Coding Index46.968.1Qwen3.8 27B
LiveCodeBench (Vals AI)Not measured84.0%Only Qwen3.8 27B measured
SWE-bench Verified (Vals AI)66.4%86.0%Qwen3.8 27B
Vibe Code Bench (Vals AI)2.9%64.8%Qwen3.8 27B
Code migration (Vals AI)5.1%14.2%Qwen3.8 27B
ProgramBench (Vals AI)Not measured0.0%Only Qwen3.8 27B measured
IOI (Vals AI)Not measured39.1%Only Qwen3.8 27B measured
Terminal-Bench 2.1 (Vals AI)39.0%58.4%Qwen3.8 27B
SkillsBench (Vals AI)Not measured38.1%Only Qwen3.8 27B measured
CyberBench (Vals AI)Not measured67.8%Only Qwen3.8 27B measured
SciCode40.2%46.6%Qwen3.8 27B
Terminal-Bench Hard (Artificial Analysis run)33.3%Not measuredOnly Mistral Medium 3.5 measured
ALE-Bench764.0Not measuredOnly Mistral Medium 3.5 measured
LMArena Text: coding14601483Qwen3.8 27B
LMArena Text: software and IT14581478Qwen3.8 27B
LMArena WebDev: React12541602Qwen3.8 27B
LMArena WebDev: HTML13081570Qwen3.8 27B
LMArena WebDev: from an imageNot measured1577Only Qwen3.8 27B measured
Neither model has a result on the other 18 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02
Intelligence benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
AA Intelligence Index14.233.7Qwen3.8 27B
Epoch Capabilities Index141.4151.7Qwen3.8 27B
Agentic workLike-for-likePublic boards, shown as published, kept out of the index05
Agentic work benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
AA Agentic Index7.045.8Qwen3.8 27B
LiveBench researchNot measured59.4%Only Qwen3.8 27B measured
LiveBench browserNot measured32.0%Only Qwen3.8 27B measured
LiveBench long agenticNot measured27.9%Only Qwen3.8 27B measured
Finance Agent (Vals AI)32.1%48.5%Qwen3.8 27B
Tax Agent Bench (Vals AI)4.5%30.9%Qwen3.8 27B
Legal Research Bench (Vals AI)9.1%36.1%Qwen3.8 27B
Excel Modeling Benchmark (Vals AI)11.2%59.7%Qwen3.8 27B
Terminal-Bench-Science (Vals AI)Not measured0.0%Only Qwen3.8 27B measured
τ²-Bench Telecom94.2%Not measuredOnly Mistral Medium 3.5 measured
APEX-AgentsNot measured47.5%Only Qwen3.8 27B measured
Neither model has a result on the other 28 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index08
Reasoning benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
GPQA Diamond34.9%88.9%Qwen3.8 27B
LiveBench reasoningNot measured80.0%Only Qwen3.8 27B measured
MMMU Pro (Vals AI)Not measured83.9%Only Qwen3.8 27B measured
GPQA Diamond (Artificial Analysis run)74.8%90.5%Qwen3.8 27B
Humanity's Last Exam (Artificial Analysis run)13.8%33.9%Qwen3.8 27B
ARC-AGINot measured87.5%Only Qwen3.8 27B measured
ARC-AGI-2Not measured42.4%Only Qwen3.8 27B measured
LMArena Text: hard prompts14361459Qwen3.8 27B
LMArena Text: expert14321479Qwen3.8 27B
LMArena Text: hard prompts in English14451461Qwen3.8 27B
LMArena Vision: diagrams12541285Qwen3.8 27B
LMArena Vision: homework12301295Qwen3.8 27B
Neither model has a result on the other 9 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index03
Math benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
ProofBench9.0%16.0%Qwen3.8 27B
LMArena Text: math14311455Qwen3.8 27B
LMArena Text: mathematical work14401458Qwen3.8 27B
Neither model has a result on the other 10 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index17
Knowledge benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
MMLU Pro75.3%84.3%Qwen3.8 27B
LegalBench (Vals AI)Not measured82.4%Only Qwen3.8 27B measured
CaseLaw (Vals AI)44.2%Not measuredOnly Mistral Medium 3.5 measured
CorpFin (Vals AI)58.8%Not measuredOnly Mistral Medium 3.5 measured
TaxEval (Vals AI)68.0%70.8%Qwen3.8 27B
MortgageTax (Vals AI)28.9%64.9%Qwen3.8 27B
MedCode (Vals AI)33.8%28.7%Mistral Medium 3.5
LMArena Text: science14281467Qwen3.8 27B
LMArena Text: medicine and healthcare14091437Qwen3.8 27B
LMArena Text: legal and government14371447Qwen3.8 27B
LMArena Text: business and finance14261438Qwen3.8 27B
Neither model has a result on the other 6 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
Design Arena: websites1142Not measuredOnly Mistral Medium 3.5 measured
Design Arena: UI components1079Not measuredOnly Mistral Medium 3.5 measured
Design Arena: game dev1079Not measuredOnly Mistral Medium 3.5 measured
Design Arena: data viz1120Not measuredOnly Mistral Medium 3.5 measured
Design Arena: 3D1061Not measuredOnly Mistral Medium 3.5 measured
Design Arena: all code categories1122Not measuredOnly Mistral Medium 3.5 measured
Design Arena: SVG949Not measuredOnly Mistral Medium 3.5 measured
Design Arena: ASCII art1062Not measuredOnly Mistral Medium 3.5 measured
LiveBench designNot measured75.9%Only Qwen3.8 27B measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index127
General benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
LiveBench data analysisNot measured76.6%Only Qwen3.8 27B measured
SAGE (Vals AI)37.6%52.4%Qwen3.8 27B
MedScribe (Vals AI)67.7%83.8%Qwen3.8 27B
Vals Multimodal Index34.8%Not measuredOnly Mistral Medium 3.5 measured
IFBench68.8%Not measuredOnly Mistral Medium 3.5 measured
Long context reasoning (AA-LCR)69.3%82.0%Qwen3.8 27B
DTBench75.5%88.0%Qwen3.8 27B
LMCA26.1%41.4%Qwen3.8 27B
Surface Evolver Bench26.9%45.0%Qwen3.8 27B
LMArena Text14211440Qwen3.8 27B
LMArena Text: instruction following14151436Qwen3.8 27B
LMArena Text: creative writing13741383Qwen3.8 27B
LMArena Vision12221269Qwen3.8 27B
LMArena Text: English14331448Qwen3.8 27B
LMArena Text: non-English14041428Qwen3.8 27B
LMArena Text: Chinese14441501Qwen3.8 27B
LMArena Text: German14531443Mistral Medium 3.5
LMArena Text: JapaneseNot measured1387Only Qwen3.8 27B measured
LMArena Text: Korean13841384Qwen3.8 27B
LMArena Text: French14481465Qwen3.8 27B
LMArena Text: Spanish14111449Qwen3.8 27B
LMArena Text: Russian13951415Qwen3.8 27B
LMArena Text: Polish14301439Qwen3.8 27B
LMArena Text: multi-turn14231440Qwen3.8 27B
LMArena Text: longer queries14151448Qwen3.8 27B
LMArena Text: writing and language13841405Qwen3.8 27B
LMArena Text: entertainment and media13821393Qwen3.8 27B
LMArena Vision: English12401267Qwen3.8 27B
LMArena Vision: Chinese12441326Qwen3.8 27B
LMArena Vision: reading text12331281Qwen3.8 27B
LMArena Vision: humor12161235Qwen3.8 27B
LMArena Vision: creative writing11981237Qwen3.8 27B
Neither model has a result on the other 14 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Mistral Medium 3.5 and Qwen3.8 27B
BenchmarkMistral Medium 3.5Qwen3.8 27BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Mistral Medium 3.5$0.0053Fits in one request
Qwen3.8 27B$0.0007Fits in one request

Qwen3.8 27B costs less

Repository review

50K input + 3K output tokens

Mistral Medium 3.5$0.098Fits in one request
Qwen3.8 27B$0.0060Fits in one request

Qwen3.8 27B costs less

Agent loop

200K input + 10K output tokens

Mistral Medium 3.5$0.375Fits in one request
Qwen3.8 27B$0.021Fits in one request

Qwen3.8 27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Mistral Medium 3.5 and Qwen3.8 27B
SpecificationMistral Medium 3.5Qwen3.8 27B
MakerMistral AIQwen
WeightsNo public weights listedOpen weights
ReleasedApril 30, 2026August 14, 2026
Context window262K1M
Input $/Mtok$1.50$0.04
Output $/Mtok$7.50$1.35
Coding index9.273.6
Independent measurements behind it12
Cost per solved task$6.02$1.26
SourceOpenRouter listingOpenRouter listing

Questions

Is Mistral Medium 3.5 better than Qwen3.8 27B for coding?

Pick Qwen3.8 27B for coding: it scores 73.6 on the Vibe Coding Index against 9.2 for Mistral Medium 3.5. Pick Mistral Medium 3.5 when what matters is MedCode (Vals AI) or LMArena Text: German, where it leads.

Which is cheaper, Mistral Medium 3.5 or Qwen3.8 27B?

Mistral Medium 3.5 costs $1.50 per million input tokens and $7.50 per million output tokens; Qwen3.8 27B costs $0.04 and $1.35. Per solved SWE-bench Verified task, Mistral Medium 3.5 costs $6.02 and Qwen3.8 27B $1.26.

Which has the bigger context window, Mistral Medium 3.5 or Qwen3.8 27B?

Qwen3.8 27B, with 1M tokens against 262K.

How many benchmarks is the Mistral Medium 3.5 vs Qwen3.8 27B comparison based on?

65 benchmarks have a result for both models as of October 21, 2026. Mistral Medium 3.5's coding index rests on 1 independent benchmark and Qwen3.8 27B's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next