LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Opus 4.6 vs Qwen3.5-27B

Updated October 21, 2026. 51 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Opus 4.6Anthropic
Coding
66.9
Overall
31.9
Output $/M
$25.00
49
Qwen3.5-27BQwen
Coding
22.6
Overall
22.9
Output $/M
$2.16
2
vs boards won of 51 shared

Decision reading

Pick Claude Opus 4.6 for coding: it scores 66.9 on the Vibe Coding Index against 22.6 for Qwen3.5-27B.

Pick Qwen3.5-27B when output tokens cost 11.6x less, or when what matters is τ²-Bench Telecom or IFBench, where it leads.

Shared results
51
Claude Opus 4.6 only
57
Qwen3.5-27B only
2
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Opus 4.6 66.9 from 2 benchmarks, Qwen3.5-27B 22.6 from 1 benchmark.
Widest category
Agentic work, 25.3 points apart on average over 2 shared benchmarks.
Widest single gap
Vending-Bench 2: Claude Opus 4.6 $8,018 against Qwen3.5-27B $202, 48.8 points apart on a 0 to 100 scale.
Output price
Claude Opus 4.6 $25.00 against Qwen3.5-27B $2.16 per million output tokens, 11.6x apart.
Context window
Claude Opus 4.6 takes 1M tokens, Qwen3.5-27B 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Opus 4.6BarsQwen3.5-27BTies
Coding70
Intelligence10
Agentic work11
Reasoning70
Math20
Knowledge40
General271
All shared boards492
CodingLike-for-likeFour of these boards feed the Vibe Coding Index70
Coding benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
SWE-bench Verified75.6%Not measuredOnly Claude Opus 4.6 measured
SWE-bench Multilingual72.0%Not measuredOnly Claude Opus 4.6 measured
LMArena WebDev15471358Claude Opus 4.6
LiveCodeBench (Vals AI)84.7%Not measuredOnly Claude Opus 4.6 measured
SWE-bench Verified (Vals AI)78.2%Not measuredOnly Claude Opus 4.6 measured
Vibe Code Bench (Vals AI)57.6%Not measuredOnly Claude Opus 4.6 measured
Terminal-Bench Hard (Artificial Analysis run)48.5%32.6%Claude Opus 4.6
Terminal-Bench79.8%Not measuredOnly Claude Opus 4.6 measured
FrontierCode26.6%Not measuredOnly Claude Opus 4.6 measured
GSO-Bench41.2%Not measuredOnly Claude Opus 4.6 measured
WeirdML78.0%39.5%Claude Opus 4.6
Cybench93.0%Not measuredOnly Claude Opus 4.6 measured
ALE-BenchNot measured349.4Only Qwen3.5-27B measured
LMArena Text: coding15341427Claude Opus 4.6
LMArena Text: software and IT15271431Claude Opus 4.6
LMArena WebDev: React15391346Claude Opus 4.6
LMArena WebDev: HTML15591386Claude Opus 4.6
LMArena WebDev: from an image1543Not measuredOnly Claude Opus 4.6 measured
Neither model has a result on the other 20 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
AA Intelligence Index31.922.9Claude Opus 4.6
Epoch Capabilities Index155.7Not measuredOnly Claude Opus 4.6 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index11
Agentic work benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
Design Arena: agents building web apps1206Not measuredOnly Claude Opus 4.6 measured
Design Arena: agents building full-stack apps1220Not measuredOnly Claude Opus 4.6 measured
Design Arena: agents building mobile apps1207Not measuredOnly Claude Opus 4.6 measured
Design Arena: agents building Android apps1204Not measuredOnly Claude Opus 4.6 measured
Design Arena: agents building games1214Not measuredOnly Claude Opus 4.6 measured
τ²-Bench Telecom92.1%93.9%Qwen3.5-27B
APEX-Agents46.3%Not measuredOnly Claude Opus 4.6 measured
METR time horizons78.9%Not measuredOnly Claude Opus 4.6 measured
Remote Labor Index4.2%Not measuredOnly Claude Opus 4.6 measured
DeepResearch Bench55.3%Not measuredOnly Claude Opus 4.6 measured
Vending-Bench 2$8,018$202Claude Opus 4.6
Neither model has a result on the other 28 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index70
Reasoning benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
GPQA Diamond89.7%Not measuredOnly Claude Opus 4.6 measured
MMMU Pro (Vals AI)83.9%Not measuredOnly Claude Opus 4.6 measured
GPQA Diamond (Artificial Analysis run)89.6%85.8%Claude Opus 4.6
Humanity's Last Exam (Artificial Analysis run)39.9%23.9%Claude Opus 4.6
GPQA Diamond (Epoch AI run)90.5%Not measuredOnly Claude Opus 4.6 measured
ARC-AGI94.0%Not measuredOnly Claude Opus 4.6 measured
ARC-AGI-269.2%Not measuredOnly Claude Opus 4.6 measured
SimpleBench67.6%Not measuredOnly Claude Opus 4.6 measured
Chess puzzles21.0%Not measuredOnly Claude Opus 4.6 measured
Mystery game puzzles25.0%Not measuredOnly Claude Opus 4.6 measured
EBR-bench12.7%Not measuredOnly Claude Opus 4.6 measured
LMArena Text: hard prompts15251415Claude Opus 4.6
LMArena Text: expert15441427Claude Opus 4.6
LMArena Text: hard prompts in English15301429Claude Opus 4.6
LMArena Vision: diagrams13401249Claude Opus 4.6
LMArena Vision: homework13371256Claude Opus 4.6
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index20
Math benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
AIME95.6%Not measuredOnly Claude Opus 4.6 measured
OTIS Mock AIME94.4%Not measuredOnly Claude Opus 4.6 measured
FrontierMath, tiers 1 to 366.0%Not measuredOnly Claude Opus 4.6 measured
FrontierMath, tier 426.8%Not measuredOnly Claude Opus 4.6 measured
ProofBench50.0%Not measuredOnly Claude Opus 4.6 measured
LMArena Text: math15181429Claude Opus 4.6
LMArena Text: mathematical work15251429Claude Opus 4.6
Neither model has a result on the other 6 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index40
Knowledge benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
MMLU Pro89.1%Not measuredOnly Claude Opus 4.6 measured
LegalBench (Vals AI)85.3%Not measuredOnly Claude Opus 4.6 measured
CaseLaw (Vals AI)62.1%Not measuredOnly Claude Opus 4.6 measured
CorpFin (Vals AI)67.0%Not measuredOnly Claude Opus 4.6 measured
TaxEval (Vals AI)76.0%Not measuredOnly Claude Opus 4.6 measured
MortgageTax (Vals AI)68.5%Not measuredOnly Claude Opus 4.6 measured
MedQA (Vals AI)95.4%Not measuredOnly Claude Opus 4.6 measured
MedCode (Vals AI)49.1%Not measuredOnly Claude Opus 4.6 measured
SimpleQA Verified47.0%Not measuredOnly Claude Opus 4.6 measured
LMArena Text: science15191437Claude Opus 4.6
LMArena Text: medicine and healthcare15041425Claude Opus 4.6
LMArena Text: legal and government15121405Claude Opus 4.6
LMArena Text: business and finance14971399Claude Opus 4.6
Neither model has a result on the other 4 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
Design Arena: websites1291Not measuredOnly Claude Opus 4.6 measured
Design Arena: UI components1284Not measuredOnly Claude Opus 4.6 measured
Design Arena: game dev1278Not measuredOnly Claude Opus 4.6 measured
Design Arena: data viz1279Not measuredOnly Claude Opus 4.6 measured
Design Arena: 3D1274Not measuredOnly Claude Opus 4.6 measured
Design Arena: all code categories1289Not measuredOnly Claude Opus 4.6 measured
Design Arena: SVG1227Not measuredOnly Claude Opus 4.6 measured
Design Arena: ASCII art1254Not measuredOnly Claude Opus 4.6 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index271
General benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
SAGE (Vals AI)51.6%Not measuredOnly Claude Opus 4.6 measured
MedScribe (Vals AI)86.7%Not measuredOnly Claude Opus 4.6 measured
IFBench53.1%75.6%Qwen3.5-27B
Long context reasoning (AA-LCR)78.0%77.7%Claude Opus 4.6
DTBench91.2%82.4%Claude Opus 4.6
LMCA55.8%34.0%Claude Opus 4.6
CL-bench20.7%Not measuredOnly Claude Opus 4.6 measured
Furniture assembly28.3%Not measuredOnly Claude Opus 4.6 measured
CL-bench Life17.0%Not measuredOnly Claude Opus 4.6 measured
LMArena Text15011409Claude Opus 4.6
LMArena Text: instruction following15211393Claude Opus 4.6
LMArena Text: creative writing15051362Claude Opus 4.6
LMArena Vision13161241Claude Opus 4.6
LMArena Text: English15111425Claude Opus 4.6
LMArena Text: non-English14881390Claude Opus 4.6
LMArena Text: Chinese15511478Claude Opus 4.6
LMArena Text: German15001392Claude Opus 4.6
LMArena Text: Japanese14881346Claude Opus 4.6
LMArena Text: Korean14641359Claude Opus 4.6
LMArena Text: French15121410Claude Opus 4.6
LMArena Text: Spanish15101407Claude Opus 4.6
LMArena Text: Russian14971390Claude Opus 4.6
LMArena Text: Polish14991375Claude Opus 4.6
LMArena Text: multi-turn15111410Claude Opus 4.6
LMArena Text: longer queries15181413Claude Opus 4.6
LMArena Text: writing and language15021380Claude Opus 4.6
LMArena Text: entertainment and media14921363Claude Opus 4.6
LMArena Vision: English13241246Claude Opus 4.6
LMArena Vision: Chinese13701301Claude Opus 4.6
LMArena Vision: reading text13261246Claude Opus 4.6
LMArena Vision: humor13141227Claude Opus 4.6
LMArena Vision: captioningNot measured1170Only Qwen3.5-27B measured
LMArena Vision: recognizing things12741210Claude Opus 4.6
LMArena Vision: creative writing13311224Claude Opus 4.6
LMArena Document1507Not measuredOnly Claude Opus 4.6 measured
Neither model has a result on the other 11 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Opus 4.6 and Qwen3.5-27B
BenchmarkClaude Opus 4.6Qwen3.5-27BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Opus 4.6$0.018Fits in one request
Qwen3.5-27B$0.0014Fits in one request

Qwen3.5-27B costs less

Repository review

50K input + 3K output tokens

Claude Opus 4.6$0.325Fits in one request
Qwen3.5-27B$0.020Fits in one request

Qwen3.5-27B costs less

Agent loop

200K input + 10K output tokens

Claude Opus 4.6$1.25Fits in one request
Qwen3.5-27B$0.076Fits in one request

Qwen3.5-27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Opus 4.6 and Qwen3.5-27B
SpecificationAnthropic Claude Opus 4.6Qwen3.5-27B
MakerAnthropicQwen
WeightsNo public weights listedOpen weights
ReleasedFebruary 4, 2026February 25, 2026
Context window1M262K
Input $/Mtok$5.00$0.27
Output $/Mtok$25.00$2.16
Coding index66.922.6
Independent measurements behind it21
Cost per solved task$1.56Not computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Opus 4.6 better than Qwen3.5-27B for coding?

Pick Claude Opus 4.6 for coding: it scores 66.9 on the Vibe Coding Index against 22.6 for Qwen3.5-27B. Pick Qwen3.5-27B when output tokens cost 11.6x less, or when what matters is τ²-Bench Telecom or IFBench, where it leads.

Which is cheaper, Claude Opus 4.6 or Qwen3.5-27B?

Claude Opus 4.6 costs $5.00 per million input tokens and $25.00 per million output tokens; Qwen3.5-27B costs $0.27 and $2.16. Cost per solved task is known for Claude Opus 4.6 only.

Which has the bigger context window, Claude Opus 4.6 or Qwen3.5-27B?

Claude Opus 4.6, with 1M tokens against 262K.

How many benchmarks is the Claude Opus 4.6 vs Qwen3.5-27B comparison based on?

51 benchmarks have a result for both models as of October 21, 2026. Claude Opus 4.6's coding index rests on 2 independent benchmarks and Qwen3.5-27B's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next