Enter opens the highlighted result. Esc closes.

Claude Sonnet 5 vs Qwen3.8 27B

Qwen3.8 27B leads Claude Sonnet 5 on coding, 74.2 to 57.7 on the Vibe Coding Index, and Qwen3.8 27B costs 3.9x less per output token ($2.55 vs $10.00 per million). Updated October 22, 2026; 83 benchmarks have a result for both.

Replace Claude Sonnet 5 Replace Qwen3.8 27B
Claude Sonnet 5Anthropic
Coding
57.7
Overall
63.2
Output $/M
$10.00
58
Qwen3.8 27BQwen
Coding
74.2
Overall
59.6
Output $/M
$2.55
22
vs boards won of 83 shared, 3 tied

Claude Sonnet 5 or Qwen3.8 27B: which to pick

Pick Qwen3.8 27B for coding: it scores 74.2 on the Vibe Coding Index against 57.7 for Claude Sonnet 5, though on 4 benchmarks against 6.

Pick Claude Sonnet 5 for work measured by AA Coding Index or Vibe Code Bench (Vals AI), where it leads.

Model AClaude Sonnet 5Anthropic57.7/1006 independent benchmarks$1.87 per solved taskModel BQwen3.8 27BQwen74.2/1004 independent benchmarks$1.26 per solved task
Shared results
83
Claude Sonnet 5 only
38
Qwen3.8 27B only
2
Like-for-like categories
8 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Sonnet 5 57.7 from 6 benchmarks, Qwen3.8 27B 74.2 from 4 benchmarks.
Widest category
Math, 22.3 points apart on average over 3 shared benchmarks.
Widest single gap
ProofBench: Claude Sonnet 5 77.0% against Qwen3.8 27B 16.0%, 61.0 points apart on a 0 to 100 scale.
Output price
Claude Sonnet 5 $10.00 against Qwen3.8 27B $2.55 per million output tokens, 3.9x apart.
Context window
Both take 1M tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Sonnet 5BarsQwen3.8 27BTies
Coding891 tie
Intelligence20
Agentic work82
Reasoning811 tie
Math30
Knowledge72
Web design10
General2181 tie
All shared boards58223 ties
CodingLike-for-likeSix of these boards feed the Vibe Coding Index89
Coding benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
LiveBench coding74.7%86.8%Qwen3.8 27B
LMArena WebDev15401593Qwen3.8 27B
AA Coding Index71.568.1Claude Sonnet 5
LiveCodeBench (Vals AI)82.4%84.0%Qwen3.8 27B
SWE-bench Verified (Vals AI)79.6%86.0%Qwen3.8 27B
Terminal-Bench 4 (Vals AI)10.6%Not measuredOnly Claude Sonnet 5 measured
Vibe Code Bench (Vals AI)81.3%64.8%Claude Sonnet 5
Code migration (Vals AI)44.4%14.2%Claude Sonnet 5
ProgramBench (Vals AI)0.0%0.0%Tie
IOI (Vals AI)45.0%39.1%Claude Sonnet 5
Terminal-Bench 2.1 (Vals AI)74.5%58.4%Claude Sonnet 5
Vibe Code Bench 1-100 (Vals AI)13.8%Not measuredOnly Claude Sonnet 5 measured
SkillsBench (Vals AI)46.5%38.1%Claude Sonnet 5
CyberBench (Vals AI)70.3%67.8%Claude Sonnet 5
SciCode54.3%46.6%Claude Sonnet 5
FrontierCode42.7%Not measuredOnly Claude Sonnet 5 measured
GSO-Bench37.3%Not measuredOnly Claude Sonnet 5 measured
WeirdML68.8%Not measuredOnly Claude Sonnet 5 measured
ALE-Bench1463.1Not measuredOnly Claude Sonnet 5 measured
LMArena Text: coding14831483Qwen3.8 27B
LMArena Text: software and IT14741478Qwen3.8 27B
LMArena WebDev: React15411602Qwen3.8 27B
LMArena WebDev: HTML15271570Qwen3.8 27B
LMArena WebDev: from an image15401577Qwen3.8 27B
SciCode10.7%Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 14 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
AA Intelligence Index38.233.7Claude Sonnet 5
Epoch Capabilities Index156.9151.7Claude Sonnet 5
Agentic workLike-for-likePublic boards, shown as published, kept out of the index82
Agentic work benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
AA Agentic Index43.645.8Qwen3.8 27B
Design Arena: agents building web apps1245Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building full-stack apps1249Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building mobile apps1214Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building Android apps1227Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building Godot games1225Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building games1227Not measuredOnly Claude Sonnet 5 measured
Design Arena: HTML slides1168Not measuredOnly Claude Sonnet 5 measured
Design Arena: PowerPoint slides1193Not measuredOnly Claude Sonnet 5 measured
Design Arena: spreadsheets1077Not measuredOnly Claude Sonnet 5 measured
LiveBench research82.8%59.4%Claude Sonnet 5
LiveBench browser72.0%32.0%Claude Sonnet 5
LiveBench long agentic39.0%27.9%Claude Sonnet 5
SREBench (Vals AI)0.4%Not measuredOnly Claude Sonnet 5 measured
Finance Agent (Vals AI)53.9%48.5%Claude Sonnet 5
Tax Agent Bench (Vals AI)29.4%30.9%Qwen3.8 27B
Legal Research Bench (Vals AI)41.8%36.1%Claude Sonnet 5
Excel Modeling Benchmark (Vals AI)66.3%59.7%Claude Sonnet 5
Terminal-Bench-Science (Vals AI)5.7%0.0%Claude Sonnet 5
APEX-Agents54.5%47.5%Claude Sonnet 5
Vending-Bench 2$6,378Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 20 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index81
Reasoning benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
GPQA Diamond88.9%88.9%Tie
LiveBench reasoning88.7%80.0%Claude Sonnet 5
MMMU Pro (Vals AI)83.0%83.9%Qwen3.8 27B
GPQA Diamond (Artificial Analysis run)91.1%90.5%Claude Sonnet 5
Humanity's Last Exam (Artificial Analysis run)41.3%33.9%Claude Sonnet 5
GPQA Diamond (Epoch AI run)90.5%Not measuredOnly Claude Sonnet 5 measured
ARC-AGINot measured87.5%Only Qwen3.8 27B measured
ARC-AGI-2Not measured42.4%Only Qwen3.8 27B measured
SimpleBench60.6%Not measuredOnly Claude Sonnet 5 measured
Chess puzzles45.0%Not measuredOnly Claude Sonnet 5 measured
Mystery game puzzles35.0%Not measuredOnly Claude Sonnet 5 measured
LMArena Text: hard prompts14611459Claude Sonnet 5
LMArena Text: expert14891479Claude Sonnet 5
LMArena Text: hard prompts in English14641461Claude Sonnet 5
LMArena Vision: diagrams12931285Claude Sonnet 5
LMArena Vision: homework13111295Claude Sonnet 5
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
OTIS Mock AIME94.7%Not measuredOnly Claude Sonnet 5 measured
FrontierMath, tiers 1 to 365.6%Not measuredOnly Claude Sonnet 5 measured
FrontierMath, tier 429.3%Not measuredOnly Claude Sonnet 5 measured
ProofBench77.0%16.0%Claude Sonnet 5
LMArena Text: math14671455Claude Sonnet 5
LMArena Text: mathematical work14811458Claude Sonnet 5
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index72
Knowledge benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
MMLU Pro87.5%84.3%Claude Sonnet 5
LegalBench (Vals AI)83.9%82.4%Claude Sonnet 5
CorpFin (Vals AI)67.0%Not measuredOnly Claude Sonnet 5 measured
TaxEval (Vals AI)75.6%70.8%Claude Sonnet 5
MortgageTax (Vals AI)70.0%64.9%Claude Sonnet 5
MedCode (Vals AI)47.5%28.7%Claude Sonnet 5
SimpleQA Verified33.7%Not measuredOnly Claude Sonnet 5 measured
LMArena Text: science14601467Qwen3.8 27B
LMArena Text: medicine and healthcare14421437Claude Sonnet 5
LMArena Text: legal and government14541447Claude Sonnet 5
LMArena Text: business and finance14361438Qwen3.8 27B
Neither model has a result on the other 7 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index10
Web design benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
Design Arena: websites1274Not measuredOnly Claude Sonnet 5 measured
Design Arena: UI components1277Not measuredOnly Claude Sonnet 5 measured
Design Arena: game dev1276Not measuredOnly Claude Sonnet 5 measured
Design Arena: data viz1252Not measuredOnly Claude Sonnet 5 measured
Design Arena: 3D1260Not measuredOnly Claude Sonnet 5 measured
Design Arena: all code categories1275Not measuredOnly Claude Sonnet 5 measured
Design Arena: SVG1192Not measuredOnly Claude Sonnet 5 measured
Design Arena: ASCII art1207Not measuredOnly Claude Sonnet 5 measured
LiveBench design82.0%75.9%Claude Sonnet 5
GeneralLike-for-likePublic boards, shown as published, kept out of the index218
General benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
LiveBench data analysis71.7%76.6%Qwen3.8 27B
Public Benefits Bench (Vals AI)66.0%Not measuredOnly Claude Sonnet 5 measured
SAGE (Vals AI)48.9%52.4%Qwen3.8 27B
MedScribe (Vals AI)76.0%83.8%Qwen3.8 27B
Vals Multimodal Index68.8%Not measuredOnly Claude Sonnet 5 measured
Long context reasoning (AA-LCR)82.0%82.0%Tie
DTBench92.5%88.0%Claude Sonnet 5
LMCA50.0%41.4%Claude Sonnet 5
Surface Evolver Bench60.0%45.0%Claude Sonnet 5
LMArena Text14421440Claude Sonnet 5
LMArena Text: instruction following14521436Claude Sonnet 5
LMArena Text: creative writing14161383Claude Sonnet 5
LMArena Vision12731269Claude Sonnet 5
LMArena Text: English14501448Claude Sonnet 5
LMArena Text: non-English14311428Claude Sonnet 5
LMArena Text: Chinese14781501Qwen3.8 27B
LMArena Text: German14421443Qwen3.8 27B
LMArena Text: Japanese14221387Claude Sonnet 5
LMArena Text: Korean14121384Claude Sonnet 5
LMArena Text: French14631465Qwen3.8 27B
LMArena Text: Spanish14381449Qwen3.8 27B
LMArena Text: Russian14501415Claude Sonnet 5
LMArena Text: Polish14251439Qwen3.8 27B
LMArena Text: multi-turn14531440Claude Sonnet 5
LMArena Text: longer queries14621448Claude Sonnet 5
LMArena Text: writing and language14361405Claude Sonnet 5
LMArena Text: entertainment and media14111393Claude Sonnet 5
LMArena Vision: English12751267Claude Sonnet 5
LMArena Vision: Chinese13311326Claude Sonnet 5
LMArena Vision: reading text12881281Claude Sonnet 5
LMArena Vision: humor12611235Claude Sonnet 5
LMArena Vision: creative writing12461237Claude Sonnet 5
LMArena Document1466Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 13 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Sonnet 5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5Qwen3.8 27BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Sonnet 5$0.0070Fits in one request
Qwen3.8 27B$0.0017Fits in one request

Qwen3.8 27B costs less

Repository review

50K input + 3K output tokens

Claude Sonnet 5$0.130Fits in one request
Qwen3.8 27B$0.029Fits in one request

Qwen3.8 27B costs less

Agent loop

200K input + 10K output tokens

Claude Sonnet 5$0.500Fits in one request
Qwen3.8 27B$0.111Fits in one request

Qwen3.8 27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Sonnet 5 and Qwen3.8 27B
SpecificationAnthropic Claude Sonnet 5Qwen3.8 27B
MakerAnthropicQwen
WeightsNo public weights listedOpen weights
ReleasedJune 30, 2026August 14, 2026
Context window1M1M
Input $/Mtok$2.00$0.425
Output $/Mtok$10.00$2.55
Coding index57.774.2
Independent measurements behind it64
Cost per solved task$1.87$1.26
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Sonnet 5 better than Qwen3.8 27B for coding?

Pick Qwen3.8 27B for coding: it scores 74.2 on the Vibe Coding Index against 57.7 for Claude Sonnet 5, though on 4 benchmarks against 6. Pick Claude Sonnet 5 for work measured by AA Coding Index or Vibe Code Bench (Vals AI), where it leads.

Which is cheaper, Claude Sonnet 5 or Qwen3.8 27B?

Claude Sonnet 5 costs $2.00 per million input tokens and $10.00 per million output tokens; Qwen3.8 27B costs $0.425 and $2.55. Per solved SWE-bench Verified task, Claude Sonnet 5 costs $1.87 and Qwen3.8 27B $1.26.

Which has the bigger context window, Claude Sonnet 5 or Qwen3.8 27B?

Neither: both take 1M tokens.

How many benchmarks is the Claude Sonnet 5 vs Qwen3.8 27B comparison based on?

83 benchmarks have a result for both models as of October 22, 2026. Claude Sonnet 5's coding index rests on 6 independent benchmarks and Qwen3.8 27B's on 4. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/claude-sonnet-5-vs-qwen3-8-27b" title="Claude Sonnet 5 vs Qwen3.8 27B, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/claude-sonnet-5-vs-qwen3-8-27b">LLMBenchmark.ai, Claude Sonnet 5 vs Qwen3.8 27B</a></p>