LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Qwen3.5 397B A17B vs Beam 1.0 501B A23B

Updated October 21, 2026. 28 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Qwen3.5 397B A17BQwen
Coding
28.6
Overall
21.4
Output $/M
$2.34
17
R Beam 1.0 501B A23BReflection
Coding
33.8
Overall
No data
Output $/M
$1.00
11
vs boards won of 28 shared

Decision reading

Pick Beam 1.0 501B A23B for coding: it scores 33.8 on the Vibe Coding Index against 28.6 for Qwen3.5 397B A17B.

Pick Qwen3.5 397B A17B when what matters is LMArena Text: software and IT or LMArena Text: hard prompts, where it leads.

Shared results
28
Qwen3.5 397B A17B only
37
Beam 1.0 501B A23B only
0
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Qwen3.5 397B A17B 28.6 from 1 benchmark, Beam 1.0 501B A23B 33.8 from 1 benchmark.
Widest category
Web design, 8.9 points apart on average over 2 shared benchmarks.
Widest single gap
LMArena Text: medicine and healthcare: Qwen3.5 397B A17B 1455 against Beam 1.0 501B A23B 1376, 13.2 points apart on a 0 to 100 scale.
Output price
Qwen3.5 397B A17B $2.34 against Beam 1.0 501B A23B $1.00 per million output tokens, 2.3x apart.
Context window
Qwen3.5 397B A17B takes 262K tokens, Beam 1.0 501B A23B 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryQwen3.5 397B A17BBarsBeam 1.0 501B A23BTies
Coding14
Reasoning21
Math02
Knowledge40
Web design02
General102
All shared boards1711
CodingLike-for-likeFour of these boards feed the Vibe Coding Index14
Coding benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
LMArena WebDev14001437Beam 1.0 501B A23B
SciCode44.8%Not measuredOnly Qwen3.5 397B A17B measured
Terminal-Bench Hard (Artificial Analysis run)40.9%Not measuredOnly Qwen3.5 397B A17B measured
ALE-Bench621.9Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: coding14641473Beam 1.0 501B A23B
LMArena Text: software and IT14631461Qwen3.5 397B A17B
LMArena WebDev: React13881443Beam 1.0 501B A23B
LMArena WebDev: HTML14101436Beam 1.0 501B A23B
Neither model has a result on the other 30 boards here
IntelligenceDirectional onlyPublic boards, shown as published, kept out of the index2 boards, none shared
Intelligence benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
AA Intelligence Index21.4Not measuredOnly Qwen3.5 397B A17B measured
Epoch Capabilities Index146.8Not measuredOnly Qwen3.5 397B A17B measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index2 boards, none shared
Agentic work benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
τ²-Bench Telecom95.6%Not measuredOnly Qwen3.5 397B A17B measured
APEX-Agents24.9%Not measuredOnly Qwen3.5 397B A17B measured
Neither model has a result on the other 37 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index21
Reasoning benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
GPQA Diamond (Artificial Analysis run)89.3%Not measuredOnly Qwen3.5 397B A17B measured
Humanity's Last Exam (Artificial Analysis run)29.0%Not measuredOnly Qwen3.5 397B A17B measured
GPQA Diamond (Epoch AI run)86.4%Not measuredOnly Qwen3.5 397B A17B measured
Mystery game puzzles18.0%Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: hard prompts14481442Qwen3.5 397B A17B
LMArena Text: expert14621447Qwen3.5 397B A17B
LMArena Text: hard prompts in English14501451Beam 1.0 501B A23B
LMArena Vision: diagrams1277Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: homework1292Not measuredOnly Qwen3.5 397B A17B measured
Neither model has a result on the other 12 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
OTIS Mock AIME88.9%Not measuredOnly Qwen3.5 397B A17B measured
FrontierMath, tiers 1 to 331.2%Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: math14531459Beam 1.0 501B A23B
LMArena Text: mathematical work14541475Beam 1.0 501B A23B
Neither model has a result on the other 9 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index40
Knowledge benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
LMArena Text: science14571430Qwen3.5 397B A17B
LMArena Text: medicine and healthcare14551376Qwen3.5 397B A17B
LMArena Text: legal and government14411433Qwen3.5 397B A17B
LMArena Text: business and finance14351430Qwen3.5 397B A17B
Neither model has a result on the other 13 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index02
Web design benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
Design Arena: websites11911253Beam 1.0 501B A23B
Design Arena: UI components1163Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: game dev11411222Beam 1.0 501B A23B
Design Arena: data viz1175Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: 3D1161Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: all code categories1180Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: SVG1139Not measuredOnly Qwen3.5 397B A17B measured
Neither model has a result on the other 2 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index102
General benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
IFBench78.8%Not measuredOnly Qwen3.5 397B A17B measured
Long context reasoning (AA-LCR)77.3%Not measuredOnly Qwen3.5 397B A17B measured
DTBench87.5%Not measuredOnly Qwen3.5 397B A17B measured
LMCA37.9%Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text14371425Qwen3.5 397B A17B
LMArena Text: instruction following14241430Beam 1.0 501B A23B
LMArena Text: creative writing14021390Qwen3.5 397B A17B
LMArena Vision1262Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: English14431436Qwen3.5 397B A17B
LMArena Text: non-English14301413Qwen3.5 397B A17B
LMArena Text: Chinese14981424Qwen3.5 397B A17B
LMArena Text: German1445Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: Japanese1429Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: Korean1384Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: French14621461Qwen3.5 397B A17B
LMArena Text: Spanish1441Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: Russian14301412Qwen3.5 397B A17B
LMArena Text: Polish1447Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: multi-turn14461414Qwen3.5 397B A17B
LMArena Text: longer queries14411429Qwen3.5 397B A17B
LMArena Text: writing and language14151400Qwen3.5 397B A17B
LMArena Text: entertainment and media13991399Beam 1.0 501B A23B
LMArena Vision: English1268Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: Chinese1314Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: reading text1271Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: humor1262Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: captioning1230Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: recognizing things1265Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: creative writing1260Not measuredOnly Qwen3.5 397B A17B measured
Neither model has a result on the other 17 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Qwen3.5 397B A17B and Beam 1.0 501B A23B
BenchmarkQwen3.5 397B A17BBeam 1.0 501B A23BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Qwen3.5 397B A17B$0.0016Fits in one request
Beam 1.0 501B A23B$0.0008Fits in one request

Beam 1.0 501B A23B costs less

Repository review

50K input + 3K output tokens

Qwen3.5 397B A17B$0.027Fits in one request
Beam 1.0 501B A23B$0.018Fits in one request

Beam 1.0 501B A23B costs less

Agent loop

200K input + 10K output tokens

Qwen3.5 397B A17B$0.101Fits in one request
Beam 1.0 501B A23B$0.070Fits in one request

Beam 1.0 501B A23B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Qwen3.5 397B A17B and Beam 1.0 501B A23B
SpecificationQwen3.5 397B A17BReflection Beam 1.0 501B A23B
MakerQwenReflection
WeightsOpen weightsOpen weights
ReleasedFebruary 16, 2026October 16, 2026
Context window262K1.05M
Input $/Mtok$0.39$0.30
Output $/Mtok$2.34$1.00
Coding index28.633.8
Independent measurements behind it11
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Qwen3.5 397B A17B better than Beam 1.0 501B A23B for coding?

Pick Beam 1.0 501B A23B for coding: it scores 33.8 on the Vibe Coding Index against 28.6 for Qwen3.5 397B A17B. Pick Qwen3.5 397B A17B when what matters is LMArena Text: software and IT or LMArena Text: hard prompts, where it leads.

Which is cheaper, Qwen3.5 397B A17B or Beam 1.0 501B A23B?

Qwen3.5 397B A17B costs $0.39 per million input tokens and $2.34 per million output tokens; Beam 1.0 501B A23B costs $0.30 and $1.00. Cost per solved task is known for neither of them.

Which has the bigger context window, Qwen3.5 397B A17B or Beam 1.0 501B A23B?

Beam 1.0 501B A23B, with 1.05M tokens against 262K.

How many benchmarks is the Qwen3.5 397B A17B vs Beam 1.0 501B A23B comparison based on?

28 benchmarks have a result for both models as of October 21, 2026. Qwen3.5 397B A17B's coding index rests on 1 independent benchmark and Beam 1.0 501B A23B's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next