Enter opens the highlighted result. Esc closes.

Claude Sonnet 5.5 vs Qwen3.8 27B

Updated October 21, 2026. 64 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace Claude Sonnet 5.5 Replace Qwen3.8 27B
Claude Sonnet 5.5Anthropic
Coding
88.9
Overall
56.0
Output $/M
$10.00
61
Qwen3.8 27BQwen
Coding
73.6
Overall
33.7
Output $/M
$1.35
3
vs boards won of 64 shared

Decision reading

Pick Claude Sonnet 5.5 for coding: it scores 88.9 on the Vibe Coding Index against 73.6 for Qwen3.8 27B.

Pick Qwen3.8 27B when output tokens cost 7.4x less, or when what matters is CyberBench (Vals AI) or LiveBench data analysis, where it leads.

Model AClaude Sonnet 5.5Anthropic88.9/1002 independent benchmarksNo cost per solved taskModel BQwen3.8 27BQwen73.6/1002 independent benchmarks$1.26 per solved task
Shared results
64
Claude Sonnet 5.5 only
31
Qwen3.8 27B only
21
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Sonnet 5.5 88.9 from 2 benchmarks, Qwen3.8 27B 73.6 from 2 benchmarks.
Widest category
Math, 33.3 points apart on average over 3 shared benchmarks.
Widest single gap
ProofBench: Claude Sonnet 5.5 100.0% against Qwen3.8 27B 16.0%, 84.0 points apart on a 0 to 100 scale.
Output price
Claude Sonnet 5.5 $10.00 against Qwen3.8 27B $1.35 per million output tokens, 7.4x apart.
Context window
Both take 1M tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Sonnet 5.5BarsQwen3.8 27BTies
Coding131
Intelligence20
Agentic work90
Reasoning70
Math30
Knowledge50
Web design10
General212
All shared boards613
CodingLike-for-likeFour of these boards feed the Vibe Coding Index131
Coding benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
LiveBench coding94.7%86.8%Claude Sonnet 5.5
LMArena WebDev17681593Claude Sonnet 5.5
AA Coding IndexNot measured68.1Only Qwen3.8 27B measured
LiveCodeBench (Vals AI)Not measured84.0%Only Qwen3.8 27B measured
SWE-bench Verified (Vals AI)Not measured86.0%Only Qwen3.8 27B measured
Terminal-Bench 4 (Vals AI)64.1%Not measuredOnly Claude Sonnet 5.5 measured
Vibe Code Bench (Vals AI)92.4%64.8%Claude Sonnet 5.5
Code migration (Vals AI)69.8%14.2%Claude Sonnet 5.5
ProgramBench (Vals AI)6.5%0.0%Claude Sonnet 5.5
IOI (Vals AI)83.1%39.1%Claude Sonnet 5.5
Terminal-Bench 2.1 (Vals AI)83.2%58.4%Claude Sonnet 5.5
SWE-bench Multimodal (Vals AI)58.3%Not measuredOnly Claude Sonnet 5.5 measured
SkillsBench (Vals AI)Not measured38.1%Only Qwen3.8 27B measured
CyberBench (Vals AI)59.6%67.8%Qwen3.8 27B
SciCode61.0%46.6%Claude Sonnet 5.5
FrontierCode52.1%Not measuredOnly Claude Sonnet 5.5 measured
FrontierSWE61.9%Not measuredOnly Claude Sonnet 5.5 measured
ALE-Bench1819.1Not measuredOnly Claude Sonnet 5.5 measured
LMArena Text: coding15131483Claude Sonnet 5.5
LMArena Text: software and IT15041478Claude Sonnet 5.5
LMArena WebDev: React18171602Claude Sonnet 5.5
LMArena WebDev: HTML17411570Claude Sonnet 5.5
LMArena WebDev: from an image17371577Claude Sonnet 5.5
Neither model has a result on the other 15 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
AA Intelligence Index56.033.7Claude Sonnet 5.5
Epoch Capabilities Index166.2151.7Claude Sonnet 5.5
Agentic workLike-for-likePublic boards, shown as published, kept out of the index90
Agentic work benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
AA Agentic IndexNot measured45.8Only Qwen3.8 27B measured
Design Arena: agents building web apps1303Not measuredOnly Claude Sonnet 5.5 measured
Design Arena: agents building mobile apps1265Not measuredOnly Claude Sonnet 5.5 measured
Design Arena: spreadsheets1245Not measuredOnly Claude Sonnet 5.5 measured
LiveBench research83.6%59.4%Claude Sonnet 5.5
LiveBench browser84.0%32.0%Claude Sonnet 5.5
LiveBench long agentic78.8%27.9%Claude Sonnet 5.5
SREBench (Vals AI)30.1%Not measuredOnly Claude Sonnet 5.5 measured
Finance Agent (Vals AI)58.1%48.5%Claude Sonnet 5.5
Tax Agent Bench (Vals AI)42.0%30.9%Claude Sonnet 5.5
Legal Research Bench (Vals AI)48.1%36.1%Claude Sonnet 5.5
Harvey's Legal Agent Benchmark (Vals AI)10.4%Not measuredOnly Claude Sonnet 5.5 measured
Excel Modeling Benchmark (Vals AI)75.7%59.7%Claude Sonnet 5.5
BioMysteryBench (Vals AI)81.1%Not measuredOnly Claude Sonnet 5.5 measured
Terminal-Bench-Science (Vals AI)47.1%0.0%Claude Sonnet 5.5
Vals Science Index59.1%Not measuredOnly Claude Sonnet 5.5 measured
APEX-Agents75.5%47.5%Claude Sonnet 5.5
SpireClimb1.3%Not measuredOnly Claude Sonnet 5.5 measured
Vending-Bench 2$11,165Not measuredOnly Claude Sonnet 5.5 measured
Neither model has a result on the other 20 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index70
Reasoning benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
GPQA DiamondNot measured88.9%Only Qwen3.8 27B measured
LiveBench reasoning91.6%80.0%Claude Sonnet 5.5
MysteryMechanism (Vals AI)49.1%Not measuredOnly Claude Sonnet 5.5 measured
MMMU Pro (Vals AI)Not measured83.9%Only Qwen3.8 27B measured
GPQA Diamond (Artificial Analysis run)Not measured90.5%Only Qwen3.8 27B measured
Humanity's Last Exam (Artificial Analysis run)55.0%33.9%Claude Sonnet 5.5
GPQA Diamond (Epoch AI run)95.6%Not measuredOnly Claude Sonnet 5.5 measured
ARC-AGINot measured87.5%Only Qwen3.8 27B measured
ARC-AGI-2Not measured42.4%Only Qwen3.8 27B measured
Chess puzzles59.0%Not measuredOnly Claude Sonnet 5.5 measured
Mystery game puzzles65.0%Not measuredOnly Claude Sonnet 5.5 measured
LMArena Text: hard prompts14941459Claude Sonnet 5.5
LMArena Text: expert15311479Claude Sonnet 5.5
LMArena Text: hard prompts in English15021461Claude Sonnet 5.5
LMArena Vision: diagrams13291285Claude Sonnet 5.5
LMArena Vision: homework13311295Claude Sonnet 5.5
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
OTIS Mock AIME100.0%Not measuredOnly Claude Sonnet 5.5 measured
FrontierMath, tiers 1 to 388.8%Not measuredOnly Claude Sonnet 5.5 measured
FrontierMath, tier 480.5%Not measuredOnly Claude Sonnet 5.5 measured
ProofBench100.0%16.0%Claude Sonnet 5.5
LMArena Text: math14971455Claude Sonnet 5.5
LMArena Text: mathematical work15101458Claude Sonnet 5.5
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index50
Knowledge benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
MMLU ProNot measured84.3%Only Qwen3.8 27B measured
LegalBench (Vals AI)Not measured82.4%Only Qwen3.8 27B measured
TaxEval (Vals AI)Not measured70.8%Only Qwen3.8 27B measured
MortgageTax (Vals AI)Not measured64.9%Only Qwen3.8 27B measured
MedCode (Vals AI)52.9%28.7%Claude Sonnet 5.5
SimpleQA Verified46.5%Not measuredOnly Claude Sonnet 5.5 measured
LMArena Text: science14831467Claude Sonnet 5.5
LMArena Text: medicine and healthcare14641437Claude Sonnet 5.5
LMArena Text: legal and government14831447Claude Sonnet 5.5
LMArena Text: business and finance14681438Claude Sonnet 5.5
Neither model has a result on the other 7 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index10
Web design benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
Design Arena: websites1326Not measuredOnly Claude Sonnet 5.5 measured
Design Arena: UI components1367Not measuredOnly Claude Sonnet 5.5 measured
Design Arena: game dev1469Not measuredOnly Claude Sonnet 5.5 measured
Design Arena: data viz1389Not measuredOnly Claude Sonnet 5.5 measured
Design Arena: 3D1458Not measuredOnly Claude Sonnet 5.5 measured
Design Arena: all code categories1364Not measuredOnly Claude Sonnet 5.5 measured
LiveBench design85.0%75.9%Claude Sonnet 5.5
Neither model has a result on the other 2 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index212
General benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
Vals Index70.8%Not measuredOnly Claude Sonnet 5.5 measured
LiveBench data analysis59.5%76.6%Qwen3.8 27B
Public Benefits Bench (Vals AI)67.2%Not measuredOnly Claude Sonnet 5.5 measured
SAGE (Vals AI)51.8%52.4%Qwen3.8 27B
MedScribe (Vals AI)91.1%83.8%Claude Sonnet 5.5
Long context reasoning (AA-LCR)82.7%82.0%Claude Sonnet 5.5
DTBench97.3%88.0%Claude Sonnet 5.5
LMCA68.3%41.4%Claude Sonnet 5.5
Surface Evolver BenchNot measured45.0%Only Qwen3.8 27B measured
Furniture assembly75.0%Not measuredOnly Claude Sonnet 5.5 measured
LMArena Text14731440Claude Sonnet 5.5
LMArena Text: instruction following14921436Claude Sonnet 5.5
LMArena Text: creative writing14671383Claude Sonnet 5.5
LMArena Vision12871269Claude Sonnet 5.5
LMArena Text: English14841448Claude Sonnet 5.5
LMArena Text: non-English14561428Claude Sonnet 5.5
LMArena Text: Chinese15351501Claude Sonnet 5.5
LMArena Text: GermanNot measured1443Only Qwen3.8 27B measured
LMArena Text: JapaneseNot measured1387Only Qwen3.8 27B measured
LMArena Text: KoreanNot measured1384Only Qwen3.8 27B measured
LMArena Text: French14991465Claude Sonnet 5.5
LMArena Text: Spanish14511449Claude Sonnet 5.5
LMArena Text: Russian14541415Claude Sonnet 5.5
LMArena Text: PolishNot measured1439Only Qwen3.8 27B measured
LMArena Text: multi-turn14651440Claude Sonnet 5.5
LMArena Text: longer queries14951448Claude Sonnet 5.5
LMArena Text: writing and language14741405Claude Sonnet 5.5
LMArena Text: entertainment and media14611393Claude Sonnet 5.5
LMArena Vision: English12891267Claude Sonnet 5.5
LMArena Vision: ChineseNot measured1326Only Qwen3.8 27B measured
LMArena Vision: reading text12971281Claude Sonnet 5.5
LMArena Vision: humorNot measured1235Only Qwen3.8 27B measured
LMArena Vision: creative writing12421237Claude Sonnet 5.5
Neither model has a result on the other 13 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Sonnet 5.5 and Qwen3.8 27B
BenchmarkClaude Sonnet 5.5Qwen3.8 27BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Sonnet 5.5$0.0070Fits in one request
Qwen3.8 27B$0.0007Fits in one request

Qwen3.8 27B costs less

Repository review

50K input + 3K output tokens

Claude Sonnet 5.5$0.130Fits in one request
Qwen3.8 27B$0.0060Fits in one request

Qwen3.8 27B costs less

Agent loop

200K input + 10K output tokens

Claude Sonnet 5.5$0.500Fits in one request
Qwen3.8 27B$0.021Fits in one request

Qwen3.8 27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Sonnet 5.5 and Qwen3.8 27B
SpecificationAnthropic Claude Sonnet 5.5Qwen3.8 27B
MakerAnthropicQwen
WeightsNo public weights listedOpen weights
ReleasedSeptember 28, 2026August 14, 2026
Context window1M1M
Input $/Mtok$2.00$0.04
Output $/Mtok$10.00$1.35
Coding index88.973.6
Independent measurements behind it22
Cost per solved taskNot computable$1.26
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Sonnet 5.5 better than Qwen3.8 27B for coding?

Pick Claude Sonnet 5.5 for coding: it scores 88.9 on the Vibe Coding Index against 73.6 for Qwen3.8 27B. Pick Qwen3.8 27B when output tokens cost 7.4x less, or when what matters is CyberBench (Vals AI) or LiveBench data analysis, where it leads.

Which is cheaper, Claude Sonnet 5.5 or Qwen3.8 27B?

Claude Sonnet 5.5 costs $2.00 per million input tokens and $10.00 per million output tokens; Qwen3.8 27B costs $0.04 and $1.35. Cost per solved task is known for Qwen3.8 27B only.

Which has the bigger context window, Claude Sonnet 5.5 or Qwen3.8 27B?

Neither: both take 1M tokens.

How many benchmarks is the Claude Sonnet 5.5 vs Qwen3.8 27B comparison based on?

64 benchmarks have a result for both models as of October 21, 2026. Claude Sonnet 5.5's coding index rests on 2 independent benchmarks and Qwen3.8 27B's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/claude-sonnet-5-5-vs-qwen3-8-27b" title="Claude Sonnet 5.5 vs Qwen3.8 27B, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/claude-sonnet-5-5-vs-qwen3-8-27b">LLMBenchmark.ai, Claude Sonnet 5.5 vs Qwen3.8 27B</a></p>