LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Qwen3.5 397B A17B vs Inkling Small

Updated October 21, 2026. 49 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace Qwen3.5 397B A17B Replace Inkling Small
Qwen3.5 397B A17BQwen
Coding
28.6
Overall
21.4
Output $/M
$2.34
38
T Inkling SmallThinking Machines
Coding
29.9
Overall
25.7
Output $/M
$1.20
11
vs boards won of 49 shared

Decision reading

Qwen3.5 397B A17B and Inkling Small are level for coding, 28.6 against 29.9 on the Vibe Coding Index, so price and context decide.

Pick Qwen3.5 397B A17B when what matters is LMArena Text: coding or LMArena Text: software and IT, where it leads. Pick Inkling Small when output tokens cost 1.9x less, or when the context window is larger, 524K against 262K tokens.

Model AQwen3.5 397B A17BQwen28.6/1001 independent benchmarkNo cost per solved taskModel BInkling SmallThinking Machines29.9/1001 independent benchmark$0.16 per solved task
Shared results
49
Qwen3.5 397B A17B only
16
Inkling Small only
35
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Qwen3.5 397B A17B 28.6 from 1 benchmark, Inkling Small 29.9 from 1 benchmark.
Widest category
General, 5.4 points apart on average over 24 shared benchmarks.
Widest single gap
FrontierMath, tiers 1 to 3: Qwen3.5 397B A17B 31.2% against Inkling Small 46.3%, 15.1 points apart on a 0 to 100 scale.
Output price
Qwen3.5 397B A17B $2.34 against Inkling Small $1.20 per million output tokens, 1.9x apart.
Context window
Qwen3.5 397B A17B takes 262K tokens, Inkling Small 524K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryQwen3.5 397B A17BBarsInkling SmallTies
Coding33
Intelligence02
Reasoning63
Math13
Knowledge40
General240
All shared boards3811
CodingLike-for-likeFour of these boards feed the Vibe Coding Index33
Coding benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
LMArena WebDev14001409Inkling Small
AA Coding IndexNot measured52.9Only Inkling Small measured
LiveCodeBench (Vals AI)Not measured85.9%Only Inkling Small measured
SWE-bench Verified (Vals AI)Not measured82.2%Only Inkling Small measured
Terminal-Bench 4 (Vals AI)Not measured0.0%Only Inkling Small measured
Vibe Code Bench (Vals AI)Not measured19.1%Only Inkling Small measured
Code migration (Vals AI)Not measured13.7%Only Inkling Small measured
ProgramBench (Vals AI)Not measured0.5%Only Inkling Small measured
IOI (Vals AI)Not measured9.3%Only Inkling Small measured
Terminal-Bench 2.1 (Vals AI)Not measured55.1%Only Inkling Small measured
SkillsBench (Vals AI)Not measured33.6%Only Inkling Small measured
CyberBench (Vals AI)Not measured64.1%Only Inkling Small measured
SciCode44.8%49.7%Inkling Small
Terminal-Bench Hard (Artificial Analysis run)40.9%Not measuredOnly Qwen3.5 397B A17B measured
ALE-Bench621.9Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text: coding14641450Qwen3.5 397B A17B
LMArena Text: software and IT14631447Qwen3.5 397B A17B
LMArena WebDev: React13881399Inkling Small
LMArena WebDev: HTML14101398Qwen3.5 397B A17B
LMArena WebDev: from an imageNot measured1410Only Inkling Small measured
Neither model has a result on the other 18 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02
Intelligence benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
AA Intelligence Index21.425.7Inkling Small
Epoch Capabilities Index146.8150.3Inkling Small
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Agentic work benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
AA Agentic IndexNot measured23.5Only Inkling Small measured
Finance Agent (Vals AI)Not measured41.3%Only Inkling Small measured
Tax Agent Bench (Vals AI)Not measured15.4%Only Inkling Small measured
Legal Research Bench (Vals AI)Not measured25.5%Only Inkling Small measured
Harvey's Legal Agent Benchmark (Vals AI)Not measured2.9%Only Inkling Small measured
Excel Modeling Benchmark (Vals AI)Not measured31.8%Only Inkling Small measured
τ²-Bench Telecom95.6%Not measuredOnly Qwen3.5 397B A17B measured
APEX-Agents24.9%Not measuredOnly Qwen3.5 397B A17B measured
Neither model has a result on the other 31 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index63
Reasoning benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
GPQA DiamondNot measured83.6%Only Inkling Small measured
GPQA Diamond (Artificial Analysis run)89.3%89.5%Inkling Small
Humanity's Last Exam (Artificial Analysis run)29.0%33.3%Inkling Small
GPQA Diamond (Epoch AI run)86.4%88.5%Inkling Small
ARC-AGINot measured84.0%Only Inkling Small measured
ARC-AGI-2Not measured40.1%Only Inkling Small measured
Mystery game puzzles18.0%6.0%Qwen3.5 397B A17B
LMArena Text: hard prompts14481423Qwen3.5 397B A17B
LMArena Text: expert14621441Qwen3.5 397B A17B
LMArena Text: hard prompts in English14501429Qwen3.5 397B A17B
LMArena Vision: diagrams12771251Qwen3.5 397B A17B
LMArena Vision: homework12921257Qwen3.5 397B A17B
Neither model has a result on the other 9 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index13
Math benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
OTIS Mock AIME88.9%90.0%Inkling Small
FrontierMath, tiers 1 to 331.2%46.3%Inkling Small
FrontierMath, tier 4Not measured17.1%Only Inkling Small measured
ProofBenchNot measured6.0%Only Inkling Small measured
LMArena Text: math14531459Inkling Small
LMArena Text: mathematical work14541441Qwen3.5 397B A17B
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index40
Knowledge benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
MMLU ProNot measured85.6%Only Inkling Small measured
LegalBench (Vals AI)Not measured83.0%Only Inkling Small measured
CorpFin (Vals AI)Not measured69.6%Only Inkling Small measured
TaxEval (Vals AI)Not measured75.5%Only Inkling Small measured
MortgageTax (Vals AI)Not measured62.3%Only Inkling Small measured
MedCode (Vals AI)Not measured37.9%Only Inkling Small measured
SimpleQA VerifiedNot measured19.1%Only Inkling Small measured
LMArena Text: science14571428Qwen3.5 397B A17B
LMArena Text: medicine and healthcare14551413Qwen3.5 397B A17B
LMArena Text: legal and government14411415Qwen3.5 397B A17B
LMArena Text: business and finance14351413Qwen3.5 397B A17B
Neither model has a result on the other 6 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index7 boards, none shared
Web design benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
Design Arena: websites1191Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: UI components1163Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: game dev1141Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: data viz1175Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: 3D1161Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: all code categories1180Not measuredOnly Qwen3.5 397B A17B measured
Design Arena: SVG1139Not measuredOnly Qwen3.5 397B A17B measured
Neither model has a result on the other 2 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index240
General benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
Vals IndexNot measured27.6%Only Inkling Small measured
Public Benefits Bench (Vals AI)Not measured59.4%Only Inkling Small measured
SAGE (Vals AI)Not measured32.7%Only Inkling Small measured
MedScribe (Vals AI)Not measured84.1%Only Inkling Small measured
Vals Multimodal IndexNot measured50.0%Only Inkling Small measured
IFBench78.8%Not measuredOnly Qwen3.5 397B A17B measured
Long context reasoning (AA-LCR)77.3%75.7%Qwen3.5 397B A17B
DTBench87.5%Not measuredOnly Qwen3.5 397B A17B measured
LMCA37.9%Not measuredOnly Qwen3.5 397B A17B measured
LMArena Text14371413Qwen3.5 397B A17B
LMArena Text: instruction following14241399Qwen3.5 397B A17B
LMArena Text: creative writing14021334Qwen3.5 397B A17B
LMArena Vision12621237Qwen3.5 397B A17B
LMArena Text: English14431421Qwen3.5 397B A17B
LMArena Text: non-English14301401Qwen3.5 397B A17B
LMArena Text: Chinese14981464Qwen3.5 397B A17B
LMArena Text: German14451408Qwen3.5 397B A17B
LMArena Text: Japanese14291401Qwen3.5 397B A17B
LMArena Text: Korean13841367Qwen3.5 397B A17B
LMArena Text: French14621435Qwen3.5 397B A17B
LMArena Text: Spanish14411422Qwen3.5 397B A17B
LMArena Text: Russian14301394Qwen3.5 397B A17B
LMArena Text: Polish14471428Qwen3.5 397B A17B
LMArena Text: multi-turn14461416Qwen3.5 397B A17B
LMArena Text: longer queries14411402Qwen3.5 397B A17B
LMArena Text: writing and language14151357Qwen3.5 397B A17B
LMArena Text: entertainment and media13991352Qwen3.5 397B A17B
LMArena Vision: English12681243Qwen3.5 397B A17B
LMArena Vision: Chinese13141292Qwen3.5 397B A17B
LMArena Vision: reading text12711243Qwen3.5 397B A17B
LMArena Vision: humor12621207Qwen3.5 397B A17B
LMArena Vision: captioning1230Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: recognizing things1265Not measuredOnly Qwen3.5 397B A17B measured
LMArena Vision: creative writing12601205Qwen3.5 397B A17B
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Qwen3.5 397B A17B and Inkling Small
BenchmarkQwen3.5 397B A17BInkling SmallLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Qwen3.5 397B A17B$0.0016Fits in one request
Inkling Small$0.0010Fits in one request

Inkling Small costs less

Repository review

50K input + 3K output tokens

Qwen3.5 397B A17B$0.027Fits in one request
Inkling Small$0.026Fits in one request

Inkling Small costs less

Agent loop

200K input + 10K output tokens

Qwen3.5 397B A17B$0.101Fits in one request
Inkling Small$0.102Fits in one request

Qwen3.5 397B A17B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Qwen3.5 397B A17B and Inkling Small
SpecificationQwen3.5 397B A17BThinking Machines Inkling Small
MakerQwenThinking Machines
WeightsOpen weightsOpen weights
ReleasedFebruary 16, 2026July 30, 2026
Context window262K524K
Input $/Mtok$0.39$0.45
Output $/Mtok$2.34$1.20
Coding index28.629.9
Independent measurements behind it11
Cost per solved taskNot computable$0.16
SourceOpenRouter listingOpenRouter listing

Questions

Is Qwen3.5 397B A17B better than Inkling Small for coding?

Qwen3.5 397B A17B and Inkling Small are level for coding, 28.6 against 29.9 on the Vibe Coding Index, so price and context decide. Pick Qwen3.5 397B A17B when what matters is LMArena Text: coding or LMArena Text: software and IT, where it leads. Pick Inkling Small when output tokens cost 1.9x less, or when the context window is larger, 524K against 262K tokens.

Which is cheaper, Qwen3.5 397B A17B or Inkling Small?

Qwen3.5 397B A17B costs $0.39 per million input tokens and $2.34 per million output tokens; Inkling Small costs $0.45 and $1.20. Cost per solved task is known for Inkling Small only.

Which has the bigger context window, Qwen3.5 397B A17B or Inkling Small?

Inkling Small, with 524K tokens against 262K.

How many benchmarks is the Qwen3.5 397B A17B vs Inkling Small comparison based on?

49 benchmarks have a result for both models as of October 21, 2026. Qwen3.5 397B A17B's coding index rests on 1 independent benchmark and Inkling Small's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next