LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Opus 5 vs Qwen3.8 27B

Updated October 21, 2026. 84 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace Claude Opus 5 Replace Qwen3.8 27B
Claude Opus 5Anthropic
Coding
81.8
Overall
50.8
Output $/M
$25.00
80
Qwen3.8 27BQwen
Coding
73.6
Overall
33.7
Output $/M
$1.35
3
vs boards won of 84 shared, 1 tied

Decision reading

Pick Claude Opus 5 for coding: it scores 81.8 on the Vibe Coding Index against 73.6 for Qwen3.8 27B.

Pick Qwen3.8 27B when output tokens cost 18.5x less, or when a solved task costs $1.26 against $1.33.

Model AClaude Opus 5Anthropic81.8/1002 independent benchmarks$1.33 per solved taskModel BQwen3.8 27BQwen73.6/1002 independent benchmarks$1.26 per solved task
Shared results
84
Claude Opus 5 only
46
Qwen3.8 27B only
1
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Opus 5 81.8 from 2 benchmarks, Qwen3.8 27B 73.6 from 2 benchmarks.
Widest category
Math, 36.8 points apart on average over 3 shared benchmarks.
Widest single gap
ProofBench: Claude Opus 5 99.0% against Qwen3.8 27B 16.0%, 83.0 points apart on a 0 to 100 scale.
Output price
Claude Opus 5 $25.00 against Qwen3.8 27B $1.35 per million output tokens, 18.5x apart.
Context window
Both take 1M tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Opus 5BarsQwen3.8 27BTies
Coding171
Intelligence20
Agentic work100
Reasoning120
Math30
Knowledge90
Web design10
General2621 tie
All shared boards8031 tie
CodingLike-for-likeFour of these boards feed the Vibe Coding Index171
Coding benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
LiveBench coding90.8%86.8%Claude Opus 5
LMArena WebDev16891593Claude Opus 5
AA Coding Index78.068.1Claude Opus 5
LiveCodeBench (Vals AI)89.0%84.0%Claude Opus 5
SWE-bench Verified (Vals AI)97.0%86.0%Claude Opus 5
Terminal-Bench 4 (Vals AI)53.5%Not measuredOnly Claude Opus 5 measured
Vibe Code Bench (Vals AI)88.4%64.8%Claude Opus 5
Code migration (Vals AI)57.5%14.2%Claude Opus 5
ProgramBench (Vals AI)3.0%0.0%Claude Opus 5
IOI (Vals AI)84.3%39.1%Claude Opus 5
Terminal-Bench 2.1 (Vals AI)84.6%58.4%Claude Opus 5
Vibe Code Bench 1-100 (Vals AI)28.5%Not measuredOnly Claude Opus 5 measured
SkillsBench (Vals AI)60.4%38.1%Claude Opus 5
CyberBench (Vals AI)65.4%67.8%Qwen3.8 27B
SciCode56.4%46.6%Claude Opus 5
FrontierCode53.4%Not measuredOnly Claude Opus 5 measured
FrontierSWE52.0%Not measuredOnly Claude Opus 5 measured
WeirdML91.8%Not measuredOnly Claude Opus 5 measured
ALE-Bench2164.6Not measuredOnly Claude Opus 5 measured
LMArena Text: coding15331483Claude Opus 5
LMArena Text: software and IT15271478Claude Opus 5
LMArena WebDev: React17111602Claude Opus 5
LMArena WebDev: HTML16801570Claude Opus 5
LMArena WebDev: from an image16621577Claude Opus 5
Neither model has a result on the other 14 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
AA Intelligence Index50.833.7Claude Opus 5
Epoch Capabilities Index163.9151.7Claude Opus 5
Agentic workLike-for-likePublic boards, shown as published, kept out of the index100
Agentic work benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
AA Agentic Index56.545.8Claude Opus 5
Design Arena: agents building web apps1266Not measuredOnly Claude Opus 5 measured
Design Arena: agents building full-stack apps1306Not measuredOnly Claude Opus 5 measured
Design Arena: agents building mobile apps1348Not measuredOnly Claude Opus 5 measured
Design Arena: agents building Android apps1258Not measuredOnly Claude Opus 5 measured
Design Arena: agents building Godot games1279Not measuredOnly Claude Opus 5 measured
Design Arena: agents building games1261Not measuredOnly Claude Opus 5 measured
Design Arena: PowerPoint slides1265Not measuredOnly Claude Opus 5 measured
LiveBench research88.9%59.4%Claude Opus 5
LiveBench browser84.0%32.0%Claude Opus 5
LiveBench long agentic62.1%27.9%Claude Opus 5
SREBench (Vals AI)12.2%Not measuredOnly Claude Opus 5 measured
Finance Agent (Vals AI)58.6%48.5%Claude Opus 5
Tax Agent Bench (Vals AI)45.5%30.9%Claude Opus 5
Legal Research Bench (Vals AI)55.3%36.1%Claude Opus 5
Excel Modeling Benchmark (Vals AI)73.6%59.7%Claude Opus 5
BioMysteryBench (Vals AI)79.3%Not measuredOnly Claude Opus 5 measured
Terminal-Bench-Science (Vals AI)27.1%0.0%Claude Opus 5
Vals Science Index47.9%Not measuredOnly Claude Opus 5 measured
Time Horizon Index (Vals AI)18.8%Not measuredOnly Claude Opus 5 measured
CUA-bench (Vals AI)9.0%Not measuredOnly Claude Opus 5 measured
APEX-Agents65.8%47.5%Claude Opus 5
OSWorld 2.031.4%Not measuredOnly Claude Opus 5 measured
BALROG63.4%Not measuredOnly Claude Opus 5 measured
PostTrainBench35.0%Not measuredOnly Claude Opus 5 measured
Vending-Bench 2$11,182Not measuredOnly Claude Opus 5 measured
LMArena Search1242Not measuredOnly Claude Opus 5 measured
Neither model has a result on the other 12 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index120
Reasoning benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
GPQA Diamond93.4%88.9%Claude Opus 5
LiveBench reasoning91.2%80.0%Claude Opus 5
MysteryMechanism (Vals AI)37.4%Not measuredOnly Claude Opus 5 measured
MMMU Pro (Vals AI)89.9%83.9%Claude Opus 5
GPQA Diamond (Artificial Analysis run)93.7%90.5%Claude Opus 5
Humanity's Last Exam (Artificial Analysis run)54.9%33.9%Claude Opus 5
GPQA Diamond (Epoch AI run)93.9%Not measuredOnly Claude Opus 5 measured
ARC-AGI97.5%87.5%Claude Opus 5
ARC-AGI-290.4%42.4%Claude Opus 5
SimpleBench80.6%Not measuredOnly Claude Opus 5 measured
Chess puzzles43.0%Not measuredOnly Claude Opus 5 measured
Mystery game puzzles59.0%Not measuredOnly Claude Opus 5 measured
EBR-bench45.7%Not measuredOnly Claude Opus 5 measured
LMArena Text: hard prompts15271459Claude Opus 5
LMArena Text: expert15541479Claude Opus 5
LMArena Text: hard prompts in English15231461Claude Opus 5
LMArena Vision: diagrams13481285Claude Opus 5
LMArena Vision: homework13381295Claude Opus 5
Neither model has a result on the other 3 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
OTIS Mock AIME98.9%Not measuredOnly Claude Opus 5 measured
FrontierMath, tiers 1 to 385.6%Not measuredOnly Claude Opus 5 measured
FrontierMath, tier 473.2%Not measuredOnly Claude Opus 5 measured
ProofBench99.0%16.0%Claude Opus 5
LMArena Text: math15331455Claude Opus 5
LMArena Text: mathematical work15441458Claude Opus 5
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index90
Knowledge benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
MMLU Pro91.6%84.3%Claude Opus 5
LegalBench (Vals AI)87.0%82.4%Claude Opus 5
CorpFin (Vals AI)73.2%Not measuredOnly Claude Opus 5 measured
TaxEval (Vals AI)75.1%70.8%Claude Opus 5
MortgageTax (Vals AI)72.1%64.9%Claude Opus 5
MedCode (Vals AI)63.6%28.7%Claude Opus 5
SimpleQA Verified59.9%Not measuredOnly Claude Opus 5 measured
LMArena Text: science15311467Claude Opus 5
LMArena Text: medicine and healthcare15251437Claude Opus 5
LMArena Text: legal and government15301447Claude Opus 5
LMArena Text: business and finance15011438Claude Opus 5
Neither model has a result on the other 6 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index10
Web design benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
Design Arena: websites1309Not measuredOnly Claude Opus 5 measured
Design Arena: UI components1348Not measuredOnly Claude Opus 5 measured
Design Arena: game dev1339Not measuredOnly Claude Opus 5 measured
Design Arena: data viz1329Not measuredOnly Claude Opus 5 measured
Design Arena: 3D1335Not measuredOnly Claude Opus 5 measured
Design Arena: all code categories1324Not measuredOnly Claude Opus 5 measured
Design Arena: SVG1310Not measuredOnly Claude Opus 5 measured
Design Arena: ASCII art1352Not measuredOnly Claude Opus 5 measured
LiveBench design83.0%75.9%Claude Opus 5
GeneralLike-for-likePublic boards, shown as published, kept out of the index262
General benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
LiveBench data analysis74.6%76.6%Qwen3.8 27B
Public Benefits Bench (Vals AI)76.9%Not measuredOnly Claude Opus 5 measured
SAGE (Vals AI)49.4%52.4%Qwen3.8 27B
MedScribe (Vals AI)91.0%83.8%Claude Opus 5
Vals Multimodal Index73.9%Not measuredOnly Claude Opus 5 measured
Long context reasoning (AA-LCR)82.0%82.0%Tie
DTBench97.9%88.0%Claude Opus 5
LMCA64.5%41.4%Claude Opus 5
Surface Evolver BenchNot measured45.0%Only Qwen3.8 27B measured
Furniture assembly60.8%Not measuredOnly Claude Opus 5 measured
LMArena Text15091440Claude Opus 5
LMArena Text: instruction following15181436Claude Opus 5
LMArena Text: creative writing14931383Claude Opus 5
LMArena Vision13201269Claude Opus 5
LMArena Text: English15081448Claude Opus 5
LMArena Text: non-English15021428Claude Opus 5
LMArena Text: Chinese15731501Claude Opus 5
LMArena Text: German15271443Claude Opus 5
LMArena Text: Japanese15201387Claude Opus 5
LMArena Text: Korean15171384Claude Opus 5
LMArena Text: French15191465Claude Opus 5
LMArena Text: Spanish15231449Claude Opus 5
LMArena Text: Russian15071415Claude Opus 5
LMArena Text: Polish15221439Claude Opus 5
LMArena Text: multi-turn15001440Claude Opus 5
LMArena Text: longer queries15171448Claude Opus 5
LMArena Text: writing and language14991405Claude Opus 5
LMArena Text: entertainment and media14811393Claude Opus 5
LMArena Vision: English13151267Claude Opus 5
LMArena Vision: Chinese14001326Claude Opus 5
LMArena Vision: reading text13291281Claude Opus 5
LMArena Vision: humor12931235Claude Opus 5
LMArena Vision: creative writing13131237Claude Opus 5
LMArena Document1516Not measuredOnly Claude Opus 5 measured
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Opus 5 and Qwen3.8 27B
BenchmarkClaude Opus 5Qwen3.8 27BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Opus 5$0.018Fits in one request
Qwen3.8 27B$0.0007Fits in one request

Qwen3.8 27B costs less

Repository review

50K input + 3K output tokens

Claude Opus 5$0.325Fits in one request
Qwen3.8 27B$0.0060Fits in one request

Qwen3.8 27B costs less

Agent loop

200K input + 10K output tokens

Claude Opus 5$1.25Fits in one request
Qwen3.8 27B$0.021Fits in one request

Qwen3.8 27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Opus 5 and Qwen3.8 27B
SpecificationAnthropic Claude Opus 5Qwen3.8 27B
MakerAnthropicQwen
WeightsNo public weights listedOpen weights
ReleasedJuly 24, 2026August 14, 2026
Context window1M1M
Input $/Mtok$5.00$0.04
Output $/Mtok$25.00$1.35
Coding index81.873.6
Independent measurements behind it22
Cost per solved task$1.33$1.26
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Opus 5 better than Qwen3.8 27B for coding?

Pick Claude Opus 5 for coding: it scores 81.8 on the Vibe Coding Index against 73.6 for Qwen3.8 27B. Pick Qwen3.8 27B when output tokens cost 18.5x less, or when a solved task costs $1.26 against $1.33.

Which is cheaper, Claude Opus 5 or Qwen3.8 27B?

Claude Opus 5 costs $5.00 per million input tokens and $25.00 per million output tokens; Qwen3.8 27B costs $0.04 and $1.35. Per solved SWE-bench Verified task, Claude Opus 5 costs $1.33 and Qwen3.8 27B $1.26.

Which has the bigger context window, Claude Opus 5 or Qwen3.8 27B?

Neither: both take 1M tokens.

How many benchmarks is the Claude Opus 5 vs Qwen3.8 27B comparison based on?

84 benchmarks have a result for both models as of October 21, 2026. Claude Opus 5's coding index rests on 2 independent benchmarks and Qwen3.8 27B's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/claude-opus-5-vs-qwen3-8-27b" title="Claude Opus 5 vs Qwen3.8 27B, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/claude-opus-5-vs-qwen3-8-27b">LLMBenchmark.ai, Claude Opus 5 vs Qwen3.8 27B</a></p>