LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Sonnet 4.6 vs Qwen3.5-Flash

Updated October 21, 2026. 51 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace Claude Sonnet 4.6 Replace Qwen3.5-Flash
Claude Sonnet 4.6Anthropic
Coding
57.8
Overall
30.1
Output $/M
$15.00
47
Qwen3.5-FlashQwen
Coding
6.2
Overall
No data
Output $/M
$0.26
4
vs boards won of 51 shared

Decision reading

Pick Claude Sonnet 4.6 for coding: it scores 57.8 on the Vibe Coding Index against 6.2 for Qwen3.5-Flash.

Pick Qwen3.5-Flash when output tokens cost 57.7x less, or when a solved task costs $0.40 against $1.68.

Model AClaude Sonnet 4.6Anthropic57.8/1002 independent benchmarks$1.68 per solved taskModel BQwen3.5-FlashQwen6.2/1001 independent benchmark$0.40 per solved task
Shared results
51
Claude Sonnet 4.6 only
66
Qwen3.5-Flash only
4
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Sonnet 4.6 57.8 from 2 benchmarks, Qwen3.5-Flash 6.2 from 1 benchmark.
Widest category
Coding, 24.1 points apart on average over 7 shared benchmarks.
Widest single gap
LMArena WebDev: React: Claude Sonnet 4.6 1512 against Qwen3.5-Flash 1229, 47.2 points apart on a 0 to 100 scale.
Output price
Claude Sonnet 4.6 $15.00 against Qwen3.5-Flash $0.26 per million output tokens, 57.7x apart.
Context window
Both take 1M tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Sonnet 4.6BarsQwen3.5-FlashTies
Coding61
Intelligence10
Reasoning71
Math31
Knowledge101
General200
All shared boards474
CodingLike-for-likeFour of these boards feed the Vibe Coding Index61
Coding benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
LiveBench coding66.6%Not measuredOnly Claude Sonnet 4.6 measured
LMArena WebDev15231244Claude Sonnet 4.6
AA Coding Index63.0Not measuredOnly Claude Sonnet 4.6 measured
LiveCodeBench (Vals AI)82.1%83.3%Qwen3.5-Flash
SWE-bench Verified (Vals AI)77.4%64.4%Claude Sonnet 4.6
Vibe Code Bench (Vals AI)55.8%Not measuredOnly Claude Sonnet 4.6 measured
Code migration (Vals AI)39.9%Not measuredOnly Claude Sonnet 4.6 measured
ProgramBench (Vals AI)0.5%Not measuredOnly Claude Sonnet 4.6 measured
Terminal-Bench 2.1 (Vals AI)57.3%Not measuredOnly Claude Sonnet 4.6 measured
SkillsBench (Vals AI)49.0%Not measuredOnly Claude Sonnet 4.6 measured
SciCode50.1%Not measuredOnly Claude Sonnet 4.6 measured
Terminal-Bench Hard (Artificial Analysis run)53.0%Not measuredOnly Claude Sonnet 4.6 measured
Terminal-Bench53.4%Not measuredOnly Claude Sonnet 4.6 measured
FrontierCode24.3%Not measuredOnly Claude Sonnet 4.6 measured
WeirdML66.1%Not measuredOnly Claude Sonnet 4.6 measured
ALE-BenchNot measured265.9Only Qwen3.5-Flash measured
LMArena Text: coding15031412Claude Sonnet 4.6
LMArena Text: software and IT14911416Claude Sonnet 4.6
LMArena WebDev: React15121229Claude Sonnet 4.6
LMArena WebDev: HTML15271291Claude Sonnet 4.6
LMArena WebDev: from an image1529Not measuredOnly Claude Sonnet 4.6 measured
Neither model has a result on the other 17 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
AA Intelligence Index30.1Not measuredOnly Claude Sonnet 4.6 measured
Epoch Capabilities Index152.8143.5Claude Sonnet 4.6
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index20 boards, none shared
Agentic work benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
AA Agentic Index31.8Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building web apps1190Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building full-stack apps1213Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building mobile apps1212Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building Android apps1202Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building Godot games1226Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building games1177Not measuredOnly Claude Sonnet 4.6 measured
LiveBench research63.6%Not measuredOnly Claude Sonnet 4.6 measured
LiveBench browser68.0%Not measuredOnly Claude Sonnet 4.6 measured
LiveBench long agentic23.1%Not measuredOnly Claude Sonnet 4.6 measured
Finance Agent (Vals AI)51.0%Not measuredOnly Claude Sonnet 4.6 measured
Tax Agent Bench (Vals AI)25.8%Not measuredOnly Claude Sonnet 4.6 measured
Legal Research Bench (Vals AI)38.5%Not measuredOnly Claude Sonnet 4.6 measured
Excel Modeling Benchmark (Vals AI)60.2%Not measuredOnly Claude Sonnet 4.6 measured
τ²-Bench Telecom79.5%Not measuredOnly Claude Sonnet 4.6 measured
APEX-Agents43.0%Not measuredOnly Claude Sonnet 4.6 measured
OSWorld 2.09.3%Not measuredOnly Claude Sonnet 4.6 measured
DeepResearch Bench54.9%Not measuredOnly Claude Sonnet 4.6 measured
OSWorld72.1%Not measuredOnly Claude Sonnet 4.6 measured
Vending-Bench 2$7,204Not measuredOnly Claude Sonnet 4.6 measured
Neither model has a result on the other 19 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index71
Reasoning benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
GPQA Diamond85.6%82.8%Claude Sonnet 4.6
LiveBench reasoning86.4%Not measuredOnly Claude Sonnet 4.6 measured
MMMU Pro (Vals AI)83.6%81.9%Claude Sonnet 4.6
GPQA Diamond (Artificial Analysis run)87.5%Not measuredOnly Claude Sonnet 4.6 measured
Humanity's Last Exam (Artificial Analysis run)33.6%Not measuredOnly Claude Sonnet 4.6 measured
GPQA Diamond (Epoch AI run)87.4%82.3%Claude Sonnet 4.6
ARC-AGI86.5%Not measuredOnly Claude Sonnet 4.6 measured
ARC-AGI-260.4%Not measuredOnly Claude Sonnet 4.6 measured
Chess puzzles23.0%14.0%Claude Sonnet 4.6
Mystery game puzzles16.0%20.0%Qwen3.5-Flash
LMArena Text: hard prompts14851403Claude Sonnet 4.6
LMArena Text: expert15001407Claude Sonnet 4.6
LMArena Text: hard prompts in English14931409Claude Sonnet 4.6
LMArena Vision: diagrams1306Not measuredOnly Claude Sonnet 4.6 measured
LMArena Vision: homework1311Not measuredOnly Claude Sonnet 4.6 measured
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index31
Math benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
AIME92.3%92.5%Qwen3.5-Flash
OTIS Mock AIME85.8%84.4%Claude Sonnet 4.6
FrontierMath, tiers 1 to 3Not measured18.2%Only Qwen3.5-Flash measured
ProofBench45.0%Not measuredOnly Claude Sonnet 4.6 measured
LMArena Text: math14621407Claude Sonnet 4.6
LMArena Text: mathematical work14831413Claude Sonnet 4.6
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index101
Knowledge benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
MMLU Pro87.3%84.1%Claude Sonnet 4.6
LegalBench (Vals AI)82.1%84.3%Qwen3.5-Flash
CaseLaw (Vals AI)64.0%56.0%Claude Sonnet 4.6
CorpFin (Vals AI)65.3%63.6%Claude Sonnet 4.6
TaxEval (Vals AI)77.1%72.2%Claude Sonnet 4.6
MortgageTax (Vals AI)67.7%67.4%Claude Sonnet 4.6
MedQA (Vals AI)92.1%Not measuredOnly Claude Sonnet 4.6 measured
MedCode (Vals AI)Not measured33.0%Only Qwen3.5-Flash measured
SimpleQA Verified35.5%20.3%Claude Sonnet 4.6
LMArena Text: science14741415Claude Sonnet 4.6
LMArena Text: medicine and healthcare14511407Claude Sonnet 4.6
LMArena Text: legal and government14701398Claude Sonnet 4.6
LMArena Text: business and finance14641394Claude Sonnet 4.6
Neither model has a result on the other 4 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
Design Arena: websites1285Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: UI components1271Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: game dev1259Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: data viz1278Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: 3D1234Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: all code categories1276Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: SVG1196Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: ASCII art1235Not measuredOnly Claude Sonnet 4.6 measured
LiveBench design71.8%Not measuredOnly Claude Sonnet 4.6 measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index200
General benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
LiveBench data analysis76.1%Not measuredOnly Claude Sonnet 4.6 measured
Public Benefits Bench (Vals AI)62.5%Not measuredOnly Claude Sonnet 4.6 measured
SAGE (Vals AI)46.6%42.5%Claude Sonnet 4.6
MedScribe (Vals AI)Not measured70.6%Only Qwen3.5-Flash measured
Vals Multimodal Index60.6%Not measuredOnly Claude Sonnet 4.6 measured
IFBench56.6%Not measuredOnly Claude Sonnet 4.6 measured
Long context reasoning (AA-LCR)80.0%Not measuredOnly Claude Sonnet 4.6 measured
DTBench89.9%82.9%Claude Sonnet 4.6
LMCA46.5%29.1%Claude Sonnet 4.6
ExploitBench23.6%Not measuredOnly Claude Sonnet 4.6 measured
LMArena Text14581397Claude Sonnet 4.6
LMArena Text: instruction following14761374Claude Sonnet 4.6
LMArena Text: creative writing14351343Claude Sonnet 4.6
LMArena Vision1283Not measuredOnly Claude Sonnet 4.6 measured
LMArena Text: English14721404Claude Sonnet 4.6
LMArena Text: non-English14401385Claude Sonnet 4.6
LMArena Text: Chinese14911445Claude Sonnet 4.6
LMArena Text: German14281390Claude Sonnet 4.6
LMArena Text: Japanese14201369Claude Sonnet 4.6
LMArena Text: Korean14101344Claude Sonnet 4.6
LMArena Text: French14651413Claude Sonnet 4.6
LMArena Text: Spanish14641400Claude Sonnet 4.6
LMArena Text: Russian14401380Claude Sonnet 4.6
LMArena Text: Polish14431376Claude Sonnet 4.6
LMArena Text: multi-turn14641393Claude Sonnet 4.6
LMArena Text: longer queries14791392Claude Sonnet 4.6
LMArena Text: writing and language14441369Claude Sonnet 4.6
LMArena Text: entertainment and media14311347Claude Sonnet 4.6
LMArena Vision: English1298Not measuredOnly Claude Sonnet 4.6 measured
LMArena Vision: Chinese1307Not measuredOnly Claude Sonnet 4.6 measured
LMArena Vision: reading text1296Not measuredOnly Claude Sonnet 4.6 measured
LMArena Vision: humor1248Not measuredOnly Claude Sonnet 4.6 measured
LMArena Vision: recognizing things1195Not measuredOnly Claude Sonnet 4.6 measured
LMArena Vision: creative writing1272Not measuredOnly Claude Sonnet 4.6 measured
LMArena Document1482Not measuredOnly Claude Sonnet 4.6 measured
Neither model has a result on the other 11 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Sonnet 4.6 and Qwen3.5-Flash
BenchmarkClaude Sonnet 4.6Qwen3.5-FlashLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Sonnet 4.6$0.011Fits in one request
Qwen3.5-Flash$0.0002Fits in one request

Qwen3.5-Flash costs less

Repository review

50K input + 3K output tokens

Claude Sonnet 4.6$0.195Fits in one request
Qwen3.5-Flash$0.0040Fits in one request

Qwen3.5-Flash costs less

Agent loop

200K input + 10K output tokens

Claude Sonnet 4.6$0.750Fits in one request
Qwen3.5-Flash$0.016Fits in one request

Qwen3.5-Flash costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Sonnet 4.6 and Qwen3.5-Flash
SpecificationAnthropic Claude Sonnet 4.6Qwen3.5-Flash
MakerAnthropicQwen
WeightsNo public weights listedNo public weights listed
ReleasedFebruary 17, 2026February 25, 2026
Context window1M1M
Input $/Mtok$3.00$0.065
Output $/Mtok$15.00$0.26
Coding index57.86.2
Independent measurements behind it21
Cost per solved task$1.68$0.40
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Sonnet 4.6 better than Qwen3.5-Flash for coding?

Pick Claude Sonnet 4.6 for coding: it scores 57.8 on the Vibe Coding Index against 6.2 for Qwen3.5-Flash. Pick Qwen3.5-Flash when output tokens cost 57.7x less, or when a solved task costs $0.40 against $1.68.

Which is cheaper, Claude Sonnet 4.6 or Qwen3.5-Flash?

Claude Sonnet 4.6 costs $3.00 per million input tokens and $15.00 per million output tokens; Qwen3.5-Flash costs $0.065 and $0.26. Per solved SWE-bench Verified task, Claude Sonnet 4.6 costs $1.68 and Qwen3.5-Flash $0.40.

Which has the bigger context window, Claude Sonnet 4.6 or Qwen3.5-Flash?

Neither: both take 1M tokens.

How many benchmarks is the Claude Sonnet 4.6 vs Qwen3.5-Flash comparison based on?

51 benchmarks have a result for both models as of October 21, 2026. Claude Sonnet 4.6's coding index rests on 2 independent benchmarks and Qwen3.5-Flash's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next