LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Opus 4.7 vs Qwen3.8 27B

Updated October 21, 2026. 72 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Opus 4.7Anthropic
Coding
51.1
Overall
40.7
Output $/M
$25.00
63
Qwen3.8 27BQwen
Coding
73.6
Overall
33.7
Output $/M
$1.35
8
vs boards won of 72 shared, 1 tied

Decision reading

Pick Qwen3.8 27B for coding: it scores 73.6 on the Vibe Coding Index against 51.1 for Claude Opus 4.7.

Pick Claude Opus 4.7 when what matters is AA Coding Index or LiveCodeBench (Vals AI), where it leads.

Shared results
72
Claude Opus 4.7 only
29
Qwen3.8 27B only
13
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Opus 4.7 51.1 from 1 benchmark, Qwen3.8 27B 73.6 from 2 benchmarks.
Widest category
Math, 18.0 points apart on average over 3 shared benchmarks.
Widest single gap
ProofBench: Claude Opus 4.7 54.0% against Qwen3.8 27B 16.0%, 38.0 points apart on a 0 to 100 scale.
Output price
Claude Opus 4.7 $25.00 against Qwen3.8 27B $1.35 per million output tokens, 18.5x apart.
Context window
Both take 1M tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Opus 4.7BarsQwen3.8 27BTies
Coding841 tie
Intelligence20
Agentic work42
Reasoning110
Math30
Knowledge90
General262
All shared boards6381 tie
CodingLike-for-likeFour of these boards feed the Vibe Coding Index84
Coding benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
LiveBench codingNot measured86.8%Only Qwen3.8 27B measured
LMArena WebDev15581593Qwen3.8 27B
AA Coding Index73.668.1Claude Opus 4.7
LiveCodeBench (Vals AI)85.1%84.0%Claude Opus 4.7
SWE-bench Verified (Vals AI)82.0%86.0%Qwen3.8 27B
Vibe Code Bench (Vals AI)71.0%64.8%Claude Opus 4.7
Code migration (Vals AI)43.9%14.2%Claude Opus 4.7
ProgramBench (Vals AI)0.0%0.0%Tie
IOI (Vals AI)Not measured39.1%Only Qwen3.8 27B measured
Terminal-Bench 2.1 (Vals AI)68.5%58.4%Claude Opus 4.7
SkillsBench (Vals AI)Not measured38.1%Only Qwen3.8 27B measured
CyberBench (Vals AI)Not measured67.8%Only Qwen3.8 27B measured
SciCodeNot measured46.6%Only Qwen3.8 27B measured
Terminal-Bench Hard (Artificial Analysis run)54.5%Not measuredOnly Claude Opus 4.7 measured
Terminal-Bench80.2%Not measuredOnly Claude Opus 4.7 measured
FrontierCode38.5%Not measuredOnly Claude Opus 4.7 measured
GSO-Bench44.1%Not measuredOnly Claude Opus 4.7 measured
WeirdML76.4%Not measuredOnly Claude Opus 4.7 measured
MirrorCode31.1%Not measuredOnly Claude Opus 4.7 measured
LMArena Text: coding15191483Claude Opus 4.7
LMArena Text: software and IT15161478Claude Opus 4.7
LMArena WebDev: React15601602Qwen3.8 27B
LMArena WebDev: HTML15541570Qwen3.8 27B
LMArena WebDev: from an image15771577Claude Opus 4.7
Neither model has a result on the other 14 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
AA Intelligence Index40.733.7Claude Opus 4.7
Epoch Capabilities Index156.8151.7Claude Opus 4.7
Agentic workLike-for-likePublic boards, shown as published, kept out of the index42
Agentic work benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
AA Agentic Index38.645.8Qwen3.8 27B
LiveBench researchNot measured59.4%Only Qwen3.8 27B measured
LiveBench browserNot measured32.0%Only Qwen3.8 27B measured
LiveBench long agenticNot measured27.9%Only Qwen3.8 27B measured
Finance Agent (Vals AI)51.5%48.5%Claude Opus 4.7
Tax Agent Bench (Vals AI)23.7%30.9%Qwen3.8 27B
Legal Research Bench (Vals AI)38.5%36.1%Claude Opus 4.7
Excel Modeling Benchmark (Vals AI)63.7%59.7%Claude Opus 4.7
Terminal-Bench-Science (Vals AI)Not measured0.0%Only Qwen3.8 27B measured
τ²-Bench Telecom88.6%Not measuredOnly Claude Opus 4.7 measured
APEX-Agents49.2%47.5%Claude Opus 4.7
OSWorld 2.018.2%Not measuredOnly Claude Opus 4.7 measured
PostTrainBench28.6%Not measuredOnly Claude Opus 4.7 measured
Vending-Bench 2$10,937Not measuredOnly Claude Opus 4.7 measured
LMArena Search1230Not measuredOnly Claude Opus 4.7 measured
Neither model has a result on the other 24 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index110
Reasoning benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
GPQA Diamond90.2%88.9%Claude Opus 4.7
LiveBench reasoningNot measured80.0%Only Qwen3.8 27B measured
MMMU Pro (Vals AI)85.5%83.9%Claude Opus 4.7
GPQA Diamond (Artificial Analysis run)91.4%90.5%Claude Opus 4.7
Humanity's Last Exam (Artificial Analysis run)42.3%33.9%Claude Opus 4.7
GPQA Diamond (Epoch AI run)90.2%Not measuredOnly Claude Opus 4.7 measured
ARC-AGI93.5%87.5%Claude Opus 4.7
ARC-AGI-275.8%42.4%Claude Opus 4.7
SimpleBench61.7%Not measuredOnly Claude Opus 4.7 measured
Chess puzzles41.0%Not measuredOnly Claude Opus 4.7 measured
Mystery game puzzles28.0%Not measuredOnly Claude Opus 4.7 measured
EBR-bench19.0%Not measuredOnly Claude Opus 4.7 measured
LMArena Text: hard prompts15061459Claude Opus 4.7
LMArena Text: expert15211479Claude Opus 4.7
LMArena Text: hard prompts in English15081461Claude Opus 4.7
LMArena Vision: diagrams13361285Claude Opus 4.7
LMArena Vision: homework13371295Claude Opus 4.7
Neither model has a result on the other 4 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
AIME96.3%Not measuredOnly Claude Opus 4.7 measured
OTIS Mock AIME97.8%Not measuredOnly Claude Opus 4.7 measured
FrontierMath, tiers 1 to 370.2%Not measuredOnly Claude Opus 4.7 measured
FrontierMath, tier 431.7%Not measuredOnly Claude Opus 4.7 measured
ProofBench54.0%16.0%Claude Opus 4.7
LMArena Text: math14981455Claude Opus 4.7
LMArena Text: mathematical work15091458Claude Opus 4.7
Neither model has a result on the other 6 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index90
Knowledge benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
MMLU Pro89.9%84.3%Claude Opus 4.7
LegalBench (Vals AI)85.3%82.4%Claude Opus 4.7
CaseLaw (Vals AI)68.4%Not measuredOnly Claude Opus 4.7 measured
CorpFin (Vals AI)66.1%Not measuredOnly Claude Opus 4.7 measured
TaxEval (Vals AI)75.3%70.8%Claude Opus 4.7
MortgageTax (Vals AI)70.3%64.9%Claude Opus 4.7
MedCode (Vals AI)54.9%28.7%Claude Opus 4.7
SimpleQA Verified51.7%Not measuredOnly Claude Opus 4.7 measured
LMArena Text: science15081467Claude Opus 4.7
LMArena Text: medicine and healthcare14951437Claude Opus 4.7
LMArena Text: legal and government15041447Claude Opus 4.7
LMArena Text: business and finance14901438Claude Opus 4.7
Neither model has a result on the other 5 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index1 board, none shared
Web design benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
LiveBench designNot measured75.9%Only Qwen3.8 27B measured
Neither model has a result on the other 8 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index262
General benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
LiveBench data analysisNot measured76.6%Only Qwen3.8 27B measured
SAGE (Vals AI)56.1%52.4%Claude Opus 4.7
MedScribe (Vals AI)83.0%83.8%Qwen3.8 27B
Vals Multimodal Index67.4%Not measuredOnly Claude Opus 4.7 measured
IFBench58.6%Not measuredOnly Claude Opus 4.7 measured
Long context reasoning (AA-LCR)78.7%82.0%Qwen3.8 27B
DTBench94.7%88.0%Claude Opus 4.7
LMCA52.2%41.4%Claude Opus 4.7
Surface Evolver BenchNot measured45.0%Only Qwen3.8 27B measured
Furniture assembly33.3%Not measuredOnly Claude Opus 4.7 measured
ExploitBench26.5%Not measuredOnly Claude Opus 4.7 measured
LMArena Text14901440Claude Opus 4.7
LMArena Text: instruction following14981436Claude Opus 4.7
LMArena Text: creative writing14861383Claude Opus 4.7
LMArena Vision13171269Claude Opus 4.7
LMArena Text: English14961448Claude Opus 4.7
LMArena Text: non-English14801428Claude Opus 4.7
LMArena Text: Chinese15311501Claude Opus 4.7
LMArena Text: German14951443Claude Opus 4.7
LMArena Text: Japanese14741387Claude Opus 4.7
LMArena Text: Korean14641384Claude Opus 4.7
LMArena Text: French15031465Claude Opus 4.7
LMArena Text: Spanish14941449Claude Opus 4.7
LMArena Text: Russian14941415Claude Opus 4.7
LMArena Text: Polish14891439Claude Opus 4.7
LMArena Text: multi-turn15051440Claude Opus 4.7
LMArena Text: longer queries15051448Claude Opus 4.7
LMArena Text: writing and language14921405Claude Opus 4.7
LMArena Text: entertainment and media14741393Claude Opus 4.7
LMArena Vision: English13221267Claude Opus 4.7
LMArena Vision: Chinese13711326Claude Opus 4.7
LMArena Vision: reading text13271281Claude Opus 4.7
LMArena Vision: humor13091235Claude Opus 4.7
LMArena Vision: recognizing things1278Not measuredOnly Claude Opus 4.7 measured
LMArena Vision: creative writing13261237Claude Opus 4.7
LMArena Document1495Not measuredOnly Claude Opus 4.7 measured
Neither model has a result on the other 10 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Opus 4.7 and Qwen3.8 27B
BenchmarkClaude Opus 4.7Qwen3.8 27BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Opus 4.7$0.018Fits in one request
Qwen3.8 27B$0.0007Fits in one request

Qwen3.8 27B costs less

Repository review

50K input + 3K output tokens

Claude Opus 4.7$0.325Fits in one request
Qwen3.8 27B$0.0060Fits in one request

Qwen3.8 27B costs less

Agent loop

200K input + 10K output tokens

Claude Opus 4.7$1.25Fits in one request
Qwen3.8 27B$0.021Fits in one request

Qwen3.8 27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Opus 4.7 and Qwen3.8 27B
SpecificationAnthropic Claude Opus 4.7Qwen3.8 27B
MakerAnthropicQwen
WeightsNo public weights listedOpen weights
ReleasedApril 16, 2026August 14, 2026
Context window1M1M
Input $/Mtok$5.00$0.04
Output $/Mtok$25.00$1.35
Coding index51.173.6
Independent measurements behind it12
Cost per solved task$2.95$1.26
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Opus 4.7 better than Qwen3.8 27B for coding?

Pick Qwen3.8 27B for coding: it scores 73.6 on the Vibe Coding Index against 51.1 for Claude Opus 4.7. Pick Claude Opus 4.7 when what matters is AA Coding Index or LiveCodeBench (Vals AI), where it leads.

Which is cheaper, Claude Opus 4.7 or Qwen3.8 27B?

Claude Opus 4.7 costs $5.00 per million input tokens and $25.00 per million output tokens; Qwen3.8 27B costs $0.04 and $1.35. Per solved SWE-bench Verified task, Claude Opus 4.7 costs $2.95 and Qwen3.8 27B $1.26.

Which has the bigger context window, Claude Opus 4.7 or Qwen3.8 27B?

Neither: both take 1M tokens.

How many benchmarks is the Claude Opus 4.7 vs Qwen3.8 27B comparison based on?

72 benchmarks have a result for both models as of October 21, 2026. Claude Opus 4.7's coding index rests on 1 independent benchmark and Qwen3.8 27B's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next