LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Sonnet 5 vs Qwen3.5-27B

Updated October 21, 2026. 48 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Sonnet 5Anthropic
Coding
63.5
Overall
38.2
Output $/M
$10.00
47
Qwen3.5-27BQwen
Coding
22.6
Overall
22.9
Output $/M
$2.16
1
vs boards won of 48 shared

Decision reading

Pick Claude Sonnet 5 for coding: it scores 63.5 on the Vibe Coding Index against 22.6 for Qwen3.5-27B.

Pick Qwen3.5-27B when output tokens cost 4.6x less, or when the benchmark that matters is LMArena Text: Chinese, where it leads.

Shared results
48
Claude Sonnet 5 only
72
Qwen3.5-27B only
5
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Sonnet 5 63.5 from 2 benchmarks, Qwen3.5-27B 22.6 from 1 benchmark.
Widest category
Agentic work, 38.6 points apart on average over 1 shared benchmark.
Widest single gap
Vending-Bench 2: Claude Sonnet 5 $6,378 against Qwen3.5-27B $202, 38.6 points apart on a 0 to 100 scale.
Output price
Claude Sonnet 5 $10.00 against Qwen3.5-27B $2.16 per million output tokens, 4.6x apart.
Context window
Claude Sonnet 5 takes 1M tokens, Qwen3.5-27B 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Sonnet 5BarsQwen3.5-27BTies
Coding70
Intelligence10
Agentic work10
Reasoning70
Math20
Knowledge40
General251
All shared boards471
CodingLike-for-likeFour of these boards feed the Vibe Coding Index70
Coding benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
LiveBench coding74.7%Not measuredOnly Claude Sonnet 5 measured
LMArena WebDev15401358Claude Sonnet 5
AA Coding Index71.5Not measuredOnly Claude Sonnet 5 measured
LiveCodeBench (Vals AI)82.4%Not measuredOnly Claude Sonnet 5 measured
SWE-bench Verified (Vals AI)79.6%Not measuredOnly Claude Sonnet 5 measured
Terminal-Bench 4 (Vals AI)10.6%Not measuredOnly Claude Sonnet 5 measured
Vibe Code Bench (Vals AI)81.3%Not measuredOnly Claude Sonnet 5 measured
Code migration (Vals AI)44.4%Not measuredOnly Claude Sonnet 5 measured
ProgramBench (Vals AI)0.0%Not measuredOnly Claude Sonnet 5 measured
IOI (Vals AI)45.0%Not measuredOnly Claude Sonnet 5 measured
Terminal-Bench 2.1 (Vals AI)74.5%Not measuredOnly Claude Sonnet 5 measured
Vibe Code Bench 1-100 (Vals AI)13.8%Not measuredOnly Claude Sonnet 5 measured
SkillsBench (Vals AI)46.5%Not measuredOnly Claude Sonnet 5 measured
CyberBench (Vals AI)70.3%Not measuredOnly Claude Sonnet 5 measured
SciCode54.3%Not measuredOnly Claude Sonnet 5 measured
Terminal-Bench Hard (Artificial Analysis run)Not measured32.6%Only Qwen3.5-27B measured
FrontierCode42.7%Not measuredOnly Claude Sonnet 5 measured
GSO-Bench37.3%Not measuredOnly Claude Sonnet 5 measured
WeirdML68.8%39.5%Claude Sonnet 5
ALE-Bench1463.1349.4Claude Sonnet 5
LMArena Text: coding14831427Claude Sonnet 5
LMArena Text: software and IT14741431Claude Sonnet 5
LMArena WebDev: React15411346Claude Sonnet 5
LMArena WebDev: HTML15271386Claude Sonnet 5
LMArena WebDev: from an image1540Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 13 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
AA Intelligence Index38.222.9Claude Sonnet 5
Epoch Capabilities Index156.9Not measuredOnly Claude Sonnet 5 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
AA Agentic Index43.6Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building web apps1245Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building full-stack apps1249Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building mobile apps1215Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building Android apps1231Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building Godot games1225Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building games1227Not measuredOnly Claude Sonnet 5 measured
Design Arena: HTML slides1218Not measuredOnly Claude Sonnet 5 measured
Design Arena: PowerPoint slides1216Not measuredOnly Claude Sonnet 5 measured
Design Arena: spreadsheets1004Not measuredOnly Claude Sonnet 5 measured
LiveBench research82.8%Not measuredOnly Claude Sonnet 5 measured
LiveBench browser72.0%Not measuredOnly Claude Sonnet 5 measured
LiveBench long agentic39.0%Not measuredOnly Claude Sonnet 5 measured
SREBench (Vals AI)0.4%Not measuredOnly Claude Sonnet 5 measured
Finance Agent (Vals AI)53.9%Not measuredOnly Claude Sonnet 5 measured
Tax Agent Bench (Vals AI)29.4%Not measuredOnly Claude Sonnet 5 measured
Legal Research Bench (Vals AI)41.8%Not measuredOnly Claude Sonnet 5 measured
Excel Modeling Benchmark (Vals AI)66.3%Not measuredOnly Claude Sonnet 5 measured
Terminal-Bench-Science (Vals AI)5.7%Not measuredOnly Claude Sonnet 5 measured
τ²-Bench TelecomNot measured93.9%Only Qwen3.5-27B measured
APEX-Agents54.5%Not measuredOnly Claude Sonnet 5 measured
Vending-Bench 2$6,378$202Claude Sonnet 5
Neither model has a result on the other 17 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index70
Reasoning benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
GPQA Diamond88.9%Not measuredOnly Claude Sonnet 5 measured
LiveBench reasoning88.7%Not measuredOnly Claude Sonnet 5 measured
MMMU Pro (Vals AI)83.0%Not measuredOnly Claude Sonnet 5 measured
GPQA Diamond (Artificial Analysis run)91.1%85.8%Claude Sonnet 5
Humanity's Last Exam (Artificial Analysis run)41.3%23.9%Claude Sonnet 5
GPQA Diamond (Epoch AI run)90.5%Not measuredOnly Claude Sonnet 5 measured
SimpleBench60.6%Not measuredOnly Claude Sonnet 5 measured
Chess puzzles45.0%Not measuredOnly Claude Sonnet 5 measured
Mystery game puzzles35.0%Not measuredOnly Claude Sonnet 5 measured
LMArena Text: hard prompts14611415Claude Sonnet 5
LMArena Text: expert14891427Claude Sonnet 5
LMArena Text: hard prompts in English14641429Claude Sonnet 5
LMArena Vision: diagrams12931249Claude Sonnet 5
LMArena Vision: homework13111256Claude Sonnet 5
Neither model has a result on the other 7 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index20
Math benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
OTIS Mock AIME94.7%Not measuredOnly Claude Sonnet 5 measured
FrontierMath, tiers 1 to 365.6%Not measuredOnly Claude Sonnet 5 measured
FrontierMath, tier 429.3%Not measuredOnly Claude Sonnet 5 measured
ProofBench77.0%Not measuredOnly Claude Sonnet 5 measured
LMArena Text: math14671429Claude Sonnet 5
LMArena Text: mathematical work14811429Claude Sonnet 5
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index40
Knowledge benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
MMLU Pro87.5%Not measuredOnly Claude Sonnet 5 measured
LegalBench (Vals AI)83.9%Not measuredOnly Claude Sonnet 5 measured
CorpFin (Vals AI)67.0%Not measuredOnly Claude Sonnet 5 measured
TaxEval (Vals AI)75.6%Not measuredOnly Claude Sonnet 5 measured
MortgageTax (Vals AI)70.0%Not measuredOnly Claude Sonnet 5 measured
MedCode (Vals AI)47.5%Not measuredOnly Claude Sonnet 5 measured
SimpleQA Verified33.7%Not measuredOnly Claude Sonnet 5 measured
LMArena Text: science14601437Claude Sonnet 5
LMArena Text: medicine and healthcare14421425Claude Sonnet 5
LMArena Text: legal and government14541405Claude Sonnet 5
LMArena Text: business and finance14361399Claude Sonnet 5
Neither model has a result on the other 6 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
Design Arena: websites1274Not measuredOnly Claude Sonnet 5 measured
Design Arena: UI components1279Not measuredOnly Claude Sonnet 5 measured
Design Arena: game dev1278Not measuredOnly Claude Sonnet 5 measured
Design Arena: data viz1251Not measuredOnly Claude Sonnet 5 measured
Design Arena: 3D1261Not measuredOnly Claude Sonnet 5 measured
Design Arena: all code categories1276Not measuredOnly Claude Sonnet 5 measured
Design Arena: SVG1193Not measuredOnly Claude Sonnet 5 measured
Design Arena: ASCII art1207Not measuredOnly Claude Sonnet 5 measured
LiveBench design82.0%Not measuredOnly Claude Sonnet 5 measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index251
General benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
LiveBench data analysis71.7%Not measuredOnly Claude Sonnet 5 measured
Public Benefits Bench (Vals AI)66.0%Not measuredOnly Claude Sonnet 5 measured
SAGE (Vals AI)48.9%Not measuredOnly Claude Sonnet 5 measured
MedScribe (Vals AI)76.0%Not measuredOnly Claude Sonnet 5 measured
Vals Multimodal Index68.8%Not measuredOnly Claude Sonnet 5 measured
IFBenchNot measured75.6%Only Qwen3.5-27B measured
Long context reasoning (AA-LCR)82.0%77.7%Claude Sonnet 5
DTBench92.5%82.4%Claude Sonnet 5
LMCA50.0%34.0%Claude Sonnet 5
Surface Evolver Bench60.0%Not measuredOnly Claude Sonnet 5 measured
LMArena Text14421409Claude Sonnet 5
LMArena Text: instruction following14521393Claude Sonnet 5
LMArena Text: creative writing14161362Claude Sonnet 5
LMArena Vision12731241Claude Sonnet 5
LMArena Text: English14501425Claude Sonnet 5
LMArena Text: non-English14311390Claude Sonnet 5
LMArena Text: Chinese14781478Qwen3.5-27B
LMArena Text: German14421392Claude Sonnet 5
LMArena Text: Japanese14221346Claude Sonnet 5
LMArena Text: Korean14121359Claude Sonnet 5
LMArena Text: French14631410Claude Sonnet 5
LMArena Text: Spanish14381407Claude Sonnet 5
LMArena Text: Russian14501390Claude Sonnet 5
LMArena Text: Polish14251375Claude Sonnet 5
LMArena Text: multi-turn14531410Claude Sonnet 5
LMArena Text: longer queries14621413Claude Sonnet 5
LMArena Text: writing and language14361380Claude Sonnet 5
LMArena Text: entertainment and media14111363Claude Sonnet 5
LMArena Vision: English12751246Claude Sonnet 5
LMArena Vision: Chinese13311301Claude Sonnet 5
LMArena Vision: reading text12881246Claude Sonnet 5
LMArena Vision: humor12611227Claude Sonnet 5
LMArena Vision: captioningNot measured1170Only Qwen3.5-27B measured
LMArena Vision: recognizing thingsNot measured1210Only Qwen3.5-27B measured
LMArena Vision: creative writing12461224Claude Sonnet 5
LMArena Document1466Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 10 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Sonnet 5 and Qwen3.5-27B
BenchmarkClaude Sonnet 5Qwen3.5-27BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Sonnet 5$0.0070Fits in one request
Qwen3.5-27B$0.0014Fits in one request

Qwen3.5-27B costs less

Repository review

50K input + 3K output tokens

Claude Sonnet 5$0.130Fits in one request
Qwen3.5-27B$0.020Fits in one request

Qwen3.5-27B costs less

Agent loop

200K input + 10K output tokens

Claude Sonnet 5$0.500Fits in one request
Qwen3.5-27B$0.076Fits in one request

Qwen3.5-27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Sonnet 5 and Qwen3.5-27B
SpecificationAnthropic Claude Sonnet 5Qwen3.5-27B
MakerAnthropicQwen
WeightsNo public weights listedOpen weights
ReleasedJune 30, 2026February 25, 2026
Context window1M262K
Input $/Mtok$2.00$0.27
Output $/Mtok$10.00$2.16
Coding index63.522.6
Independent measurements behind it21
Cost per solved task$1.87Not computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Sonnet 5 better than Qwen3.5-27B for coding?

Pick Claude Sonnet 5 for coding: it scores 63.5 on the Vibe Coding Index against 22.6 for Qwen3.5-27B. Pick Qwen3.5-27B when output tokens cost 4.6x less, or when the benchmark that matters is LMArena Text: Chinese, where it leads.

Which is cheaper, Claude Sonnet 5 or Qwen3.5-27B?

Claude Sonnet 5 costs $2.00 per million input tokens and $10.00 per million output tokens; Qwen3.5-27B costs $0.27 and $2.16. Cost per solved task is known for Claude Sonnet 5 only.

Which has the bigger context window, Claude Sonnet 5 or Qwen3.5-27B?

Claude Sonnet 5, with 1M tokens against 262K.

How many benchmarks is the Claude Sonnet 5 vs Qwen3.5-27B comparison based on?

48 benchmarks have a result for both models as of October 21, 2026. Claude Sonnet 5's coding index rests on 2 independent benchmarks and Qwen3.5-27B's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next