LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Qwen3.5-27B vs Inkling

Updated October 21, 2026. 39 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Qwen3.5-27BQwen
Coding
22.6
Overall
22.9
Output $/M
$2.16
2
T InklingThinking Machines
Coding
49.7
Overall
25.0
Output $/M
$4.05
37
vs boards won of 39 shared

Decision reading

Pick Inkling for coding: it scores 49.7 on the Vibe Coding Index against 22.6 for Qwen3.5-27B.

Pick Qwen3.5-27B when output tokens cost 1.9x less, or when what matters is WeirdML or Long context reasoning (AA-LCR), where it leads.

Shared results
39
Qwen3.5-27B only
14
Inkling only
63
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Qwen3.5-27B 22.6 from 1 benchmark, Inkling 49.7 from 2 benchmarks.
Widest category
Coding, 8.4 points apart on average over 7 shared benchmarks.
Widest single gap
ALE-Bench: Qwen3.5-27B 349.4 against Inkling 946.0, 19.9 points apart on a 0 to 100 scale.
Output price
Qwen3.5-27B $2.16 against Inkling $4.05 per million output tokens, 1.9x apart.
Context window
Qwen3.5-27B takes 262K tokens, Inkling 524K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryQwen3.5-27BBarsInklingTies
Coding16
Intelligence01
Reasoning05
Math02
Knowledge04
General119
All shared boards237
CodingLike-for-likeFour of these boards feed the Vibe Coding Index16
Coding benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
LiveBench codingNot measured64.0%Only Inkling measured
LMArena WebDev13581414Inkling
AA Coding IndexNot measured52.1Only Inkling measured
LiveCodeBench (Vals AI)Not measured85.5%Only Inkling measured
SWE-bench Verified (Vals AI)Not measured77.6%Only Inkling measured
Terminal-Bench 4 (Vals AI)Not measured0.5%Only Inkling measured
Vibe Code Bench (Vals AI)Not measured19.2%Only Inkling measured
Code migration (Vals AI)Not measured11.8%Only Inkling measured
ProgramBench (Vals AI)Not measured0.0%Only Inkling measured
IOI (Vals AI)Not measured14.9%Only Inkling measured
Terminal-Bench 2.1 (Vals AI)Not measured47.6%Only Inkling measured
Vibe Code Bench 1-100 (Vals AI)Not measured7.3%Only Inkling measured
SkillsBench (Vals AI)Not measured26.1%Only Inkling measured
CyberBench (Vals AI)Not measured66.8%Only Inkling measured
SciCodeNot measured47.0%Only Inkling measured
Terminal-Bench Hard (Artificial Analysis run)32.6%Not measuredOnly Qwen3.5-27B measured
FrontierCodeNot measured14.0%Only Inkling measured
FrontierSWENot measured4.1%Only Inkling measured
WeirdML39.5%32.3%Qwen3.5-27B
ALE-Bench349.4946.0Inkling
LMArena Text: coding14271466Inkling
LMArena Text: software and IT14311465Inkling
LMArena WebDev: React13461404Inkling
LMArena WebDev: HTML13861399Inkling
Neither model has a result on the other 14 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
AA Intelligence Index22.925.0Inkling
Epoch Capabilities IndexNot measured148.4Only Inkling measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index14 boards, none shared
Agentic work benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
AA Agentic IndexNot measured22.5Only Inkling measured
Design Arena: agents building web appsNot measured1196Only Inkling measured
LiveBench researchNot measured59.9%Only Inkling measured
LiveBench browserNot measured16.0%Only Inkling measured
LiveBench long agenticNot measured14.1%Only Inkling measured
SREBench (Vals AI)Not measured0.0%Only Inkling measured
Finance Agent (Vals AI)Not measured46.6%Only Inkling measured
Tax Agent Bench (Vals AI)Not measured15.3%Only Inkling measured
Legal Research Bench (Vals AI)Not measured28.4%Only Inkling measured
Harvey's Legal Agent Benchmark (Vals AI)Not measured3.8%Only Inkling measured
Excel Modeling Benchmark (Vals AI)Not measured38.4%Only Inkling measured
τ²-Bench Telecom93.9%Not measuredOnly Qwen3.5-27B measured
APEX-AgentsNot measured33.8%Only Inkling measured
Vending-Bench 2$202Not measuredOnly Qwen3.5-27B measured
Neither model has a result on the other 25 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index05
Reasoning benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
GPQA DiamondNot measured87.1%Only Inkling measured
LiveBench reasoningNot measured78.3%Only Inkling measured
MMMU Pro (Vals AI)Not measured78.5%Only Inkling measured
GPQA Diamond (Artificial Analysis run)85.8%87.2%Inkling
Humanity's Last Exam (Artificial Analysis run)23.9%31.9%Inkling
GPQA Diamond (Epoch AI run)Not measured88.3%Only Inkling measured
ARC-AGINot measured79.5%Only Inkling measured
ARC-AGI-2Not measured36.5%Only Inkling measured
SimpleBenchNot measured50.0%Only Inkling measured
Chess puzzlesNot measured21.0%Only Inkling measured
LMArena Text: hard prompts14151451Inkling
LMArena Text: expert14271466Inkling
LMArena Text: hard prompts in English14291448Inkling
LMArena Vision: diagrams1249Not measuredOnly Qwen3.5-27B measured
LMArena Vision: homework1256Not measuredOnly Qwen3.5-27B measured
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
OTIS Mock AIMENot measured88.9%Only Inkling measured
FrontierMath, tiers 1 to 3Not measured33.3%Only Inkling measured
FrontierMath, tier 4Not measured4.9%Only Inkling measured
ProofBenchNot measured0.0%Only Inkling measured
LMArena Text: math14291479Inkling
LMArena Text: mathematical work14291460Inkling
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index04
Knowledge benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
MMLU ProNot measured86.3%Only Inkling measured
LegalBench (Vals AI)Not measured83.0%Only Inkling measured
CorpFin (Vals AI)Not measured68.6%Only Inkling measured
TaxEval (Vals AI)Not measured75.3%Only Inkling measured
MortgageTax (Vals AI)Not measured64.0%Only Inkling measured
MedCode (Vals AI)Not measured41.2%Only Inkling measured
SimpleQA VerifiedNot measured40.3%Only Inkling measured
LMArena Text: science14371455Inkling
LMArena Text: medicine and healthcare14251447Inkling
LMArena Text: legal and government14051448Inkling
LMArena Text: business and finance13991438Inkling
Neither model has a result on the other 6 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
Design Arena: websitesNot measured1224Only Inkling measured
Design Arena: UI componentsNot measured1200Only Inkling measured
Design Arena: game devNot measured1166Only Inkling measured
Design Arena: data vizNot measured1160Only Inkling measured
Design Arena: 3DNot measured1161Only Inkling measured
Design Arena: all code categoriesNot measured1206Only Inkling measured
Design Arena: SVGNot measured1109Only Inkling measured
Design Arena: ASCII artNot measured1089Only Inkling measured
LiveBench designNot measured58.3%Only Inkling measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index119
General benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
Vals IndexNot measured29.0%Only Inkling measured
LiveBench data analysisNot measured72.8%Only Inkling measured
Public Benefits Bench (Vals AI)Not measured58.5%Only Inkling measured
SAGE (Vals AI)Not measured36.5%Only Inkling measured
MedScribe (Vals AI)Not measured85.4%Only Inkling measured
Vals Multimodal IndexNot measured49.4%Only Inkling measured
IFBench75.6%Not measuredOnly Qwen3.5-27B measured
Long context reasoning (AA-LCR)77.7%77.3%Qwen3.5-27B
DTBench82.4%87.5%Inkling
LMCA34.0%37.6%Inkling
LMArena Text14091442Inkling
LMArena Text: instruction following13931425Inkling
LMArena Text: creative writing13621390Inkling
LMArena Vision1241Not measuredOnly Qwen3.5-27B measured
LMArena Text: English14251442Inkling
LMArena Text: non-English13901434Inkling
LMArena Text: Chinese14781493Inkling
LMArena Text: German13921445Inkling
LMArena Text: Japanese13461429Inkling
LMArena Text: Korean13591403Inkling
LMArena Text: French14101455Inkling
LMArena Text: Spanish14071449Inkling
LMArena Text: Russian13901430Inkling
LMArena Text: Polish13751450Inkling
LMArena Text: multi-turn14101437Inkling
LMArena Text: longer queries14131435Inkling
LMArena Text: writing and language13801404Inkling
LMArena Text: entertainment and media13631394Inkling
LMArena Vision: English1246Not measuredOnly Qwen3.5-27B measured
LMArena Vision: Chinese1301Not measuredOnly Qwen3.5-27B measured
LMArena Vision: reading text1246Not measuredOnly Qwen3.5-27B measured
LMArena Vision: humor1227Not measuredOnly Qwen3.5-27B measured
LMArena Vision: captioning1170Not measuredOnly Qwen3.5-27B measured
LMArena Vision: recognizing things1210Not measuredOnly Qwen3.5-27B measured
LMArena Vision: creative writing1224Not measuredOnly Qwen3.5-27B measured
Neither model has a result on the other 11 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Qwen3.5-27B and Inkling
BenchmarkQwen3.5-27BInklingLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Qwen3.5-27B$0.0014Fits in one request
Inkling$0.0030Fits in one request

Qwen3.5-27B costs less

Repository review

50K input + 3K output tokens

Qwen3.5-27B$0.020Fits in one request
Inkling$0.062Fits in one request

Qwen3.5-27B costs less

Agent loop

200K input + 10K output tokens

Qwen3.5-27B$0.076Fits in one request
Inkling$0.240Fits in one request

Qwen3.5-27B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Qwen3.5-27B and Inkling
SpecificationQwen3.5-27BThinking Machines Inkling
MakerQwenThinking Machines
WeightsOpen weightsOpen weights
ReleasedFebruary 25, 2026July 17, 2026
Context window262K524K
Input $/Mtok$0.27$1.00
Output $/Mtok$2.16$4.05
Coding index22.649.7
Independent measurements behind it12
Cost per solved taskNot computable$0.76
SourceOpenRouter listingOpenRouter listing

Questions

Is Qwen3.5-27B better than Inkling for coding?

Pick Inkling for coding: it scores 49.7 on the Vibe Coding Index against 22.6 for Qwen3.5-27B. Pick Qwen3.5-27B when output tokens cost 1.9x less, or when what matters is WeirdML or Long context reasoning (AA-LCR), where it leads.

Which is cheaper, Qwen3.5-27B or Inkling?

Qwen3.5-27B costs $0.27 per million input tokens and $2.16 per million output tokens; Inkling costs $1.00 and $4.05. Cost per solved task is known for Inkling only.

Which has the bigger context window, Qwen3.5-27B or Inkling?

Inkling, with 524K tokens against 262K.

How many benchmarks is the Qwen3.5-27B vs Inkling comparison based on?

39 benchmarks have a result for both models as of October 21, 2026. Qwen3.5-27B's coding index rests on 1 independent benchmark and Inkling's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next