LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Qwen3.5 397B A17B

As of October 20, 2026, Qwen3.5 397B A17B ranks #94 of 213 models overall with 21.4 on the Artificial Analysis Intelligence Index. Its strongest category is reasoning, where it ranks #64 of 203. Qwen3.5 397B A17B costs $0.39 per million input tokens and $2.34 per million output tokens. It was released on February 16, 2026.

Its output price ranks 208 of 349 priced models, counting from the cheapest.

  • Coding index 28.6 Thin, 1 benchmark
  • Cost per solved task Not computable No published attempt cost
  • Output, per million tokens $2.34 208 of 349 from the cheapest
  • Input, per million tokens $0.39 OpenRouter list price
  • Context window 262K Tokens per request
  • Downloads, 30 days 600.5K Hugging Face

About and specs

The Qwen3.5 series 397B-A17B native vision-language model is built on a hybrid architecture that integrates a linear attention mechanism with a sparse mixture-of-experts model, achieving higher inference efficiency. It delivers...

API model id qwen/qwen3.5-397b-a17b
  • Tool callingListed
  • Structured outputsListed
  • JSON modeListed
  • Reasoning modeListed
  • Web searchNot listed
Takes in
Text, Images, Video
Gives back
Text
Context window
262K tokens
Max output
66K tokens
Knowledge cutoff
Not published
Cached input $/Mtok
No cache price listed
Cache write $/Mtok
No cache write price listed
Reasoning $/Mtok
Not priced apart
Web search, per request
No search price listed
Tokenizer
Qwen3
Requests moderated
No
Withdrawn on
No date announced
Parameters
403.4B, per its Hugging Face weights
Downloads, all time
6.0M on Hugging Face
Training compute
No estimate published
Output speed
55 tokens/s, Non-reasoning effort
Time to first token
1.5 s, Non-reasoning effort
Speed on OpenRouter
54 tokens/s via Alibaba, 30-minute median
First token on OpenRouter
1.5 s via Alibaba, 30-minute median

Benchmarks: 65 of 190 measured

The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.

Coding index

28.6
  • Aider polyglot Not measured
  • SWE-bench Verified Not measured
  • LiveBench coding Not measured
  • LMArena WebDev Elo, scaled from 1200 to 1900 1400 Elo 29 of 100

The index averages only the coding benchmarks that have a result; the others are skipped, never filled in. How it is weighted

Other public boards

All rankings

Coding7 of 34 boards

1 more coding boards

Not measured on SWE-bench Lite, SWE-bench (full test set), SWE-bench Multimodal, SWE-bench Multilingual, AA Coding Index, LiveCodeBench (Vals AI), SWE-bench Verified (Vals AI), Terminal-Bench 4 (Vals AI), Vibe Code Bench (Vals AI), Code migration (Vals AI), ProgramBench (Vals AI), IOI (Vals AI), Terminal-Bench 2.1 (Vals AI), SWE-bench Multimodal (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), CyberBench (Vals AI), LiveCodeBench (Artificial Analysis run), Terminal-Bench, DeepSWE, FrontierCode, FrontierSWE, GSO-Bench, WeirdML, MirrorCode, Cybench, LMArena WebDev: from an image

Intelligence2 of 2 boards

Agentic work2 of 39 boards

Not measured on AA Agentic Index, Design Arena: agents building web apps, Design Arena: agents building full-stack apps, Design Arena: agents building mobile apps, Design Arena: agents building Android apps, Design Arena: agents building Godot games, Design Arena: agents building games, Design Arena: HTML slides, Design Arena: PowerPoint slides, Design Arena: spreadsheets, LiveBench research, LiveBench browser, LiveBench long agentic, SREBench (Vals AI), Finance Agent (Vals AI), Tax Agent Bench (Vals AI), Legal Research Bench (Vals AI), Harvey's Legal Agent Benchmark (Vals AI), Excel Modeling Benchmark (Vals AI), BioMysteryBench (Vals AI), Terminal-Bench-Science (Vals AI), Vals Science Index, Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, BALROG, DeepResearch Bench, PostTrainBench, TheAgentCompany, OSWorld, SpireClimb, Vending-Bench 2, LMArena Search

Reasoning9 of 21 boards

3 more reasoning boards

Not measured on GPQA Diamond, LiveBench reasoning, MysteryMechanism (Vals AI), MMMU Pro (Vals AI), ARC-AGI, ARC-AGI-2, Humanity's Last Exam, SimpleBench, Chess puzzles, EBR-bench, VPCT, BIG-Bench Hard

Math4 of 13 boards

Not measured on AIME, MATH 500 (Vals AI), MGSM (Vals AI), AA Math Index, AIME 2025 (Artificial Analysis run), FrontierMath, tier 4, ProofBench, MATH level 5, GSM8K

Knowledge4 of 17 boards

Not measured on MMLU Pro, LegalBench (Vals AI), CaseLaw (Vals AI), CorpFin (Vals AI), TaxEval (Vals AI), MortgageTax (Vals AI), MedQA (Vals AI), MedCode (Vals AI), MMLU Pro (Artificial Analysis run), SimpleQA Verified, MMLU, GeoBench, AI2 Reasoning Challenge

Web design7 of 9 boards

1 more web design boards

Not measured on Design Arena: ASCII art, LiveBench design

General29 of 46 boards

23 more general boards

Not measured on Vals Index, LiveBench data analysis, Public Benefits Bench (Vals AI), SAGE (Vals AI), MedScribe (Vals AI), Vals Multimodal Index, Fiction.LiveBench, Creative writing (Lech Mazur), CL-bench, Surface Evolver Bench, Furniture assembly, ExploitBench, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Document

Image generation0 of 5 boards

Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit

Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.

All 190 benchmarks as a table
Benchmark results for Qwen3.5 397B A17B
BenchmarkResultIndex weight
Aider polyglotCoding Not measured 35%
SWE-bench VerifiedCoding Not measured 30%
SWE-bench LiteCoding Not measured Not in index
SWE-bench (full test set)Coding Not measured Not in index
SWE-bench MultimodalCoding Not measured Not in index
SWE-bench MultilingualCoding Not measured Not in index
LiveBench codingCoding Not measured 20%
LMArena WebDevCoding 1400 15%
Vals IndexGeneral Not measured Not in index
GPQA DiamondReasoning Not measured Not in index
AIMEMath Not measured Not in index
MMLU ProKnowledge Not measured Not in index
AA Intelligence IndexIntelligence 21.4 Not in index
AA Coding IndexCoding Not measured Not in index
AA Agentic IndexAgentic work Not measured Not in index
Design Arena: websitesWeb design 1191 Not in index
Design Arena: UI componentsWeb design 1164 Not in index
Design Arena: game devWeb design 1140 Not in index
Design Arena: data vizWeb design 1175 Not in index
Design Arena: 3DWeb design 1161 Not in index
Design Arena: all code categoriesWeb design 1180 Not in index
Design Arena: SVGWeb design 1138 Not in index
Design Arena: ASCII artWeb design Not measured Not in index
Design Arena: agents building web appsAgentic work Not measured Not in index
Design Arena: agents building full-stack appsAgentic work Not measured Not in index
Design Arena: agents building mobile appsAgentic work Not measured Not in index
Design Arena: agents building Android appsAgentic work Not measured Not in index
Design Arena: agents building Godot gamesAgentic work Not measured Not in index
Design Arena: agents building gamesAgentic work Not measured Not in index
Design Arena: HTML slidesAgentic work Not measured Not in index
Design Arena: PowerPoint slidesAgentic work Not measured Not in index
Design Arena: spreadsheetsAgentic work Not measured Not in index
Design Arena: imagesImage generation Not measured Not in index
Design Arena: graphic designImage generation Not measured Not in index
Design Arena: logosImage generation Not measured Not in index
LiveBench reasoningReasoning Not measured Not in index
LiveBench data analysisGeneral Not measured Not in index
LiveBench researchAgentic work Not measured Not in index
LiveBench browserAgentic work Not measured Not in index
LiveBench long agenticAgentic work Not measured Not in index
LiveBench designWeb design Not measured Not in index
LiveCodeBench (Vals AI)Coding Not measured Not in index
SWE-bench Verified (Vals AI)Coding Not measured Not in index
Terminal-Bench 4 (Vals AI)Coding Not measured Not in index
Vibe Code Bench (Vals AI)Coding Not measured Not in index
Code migration (Vals AI)Coding Not measured Not in index
ProgramBench (Vals AI)Coding Not measured Not in index
SREBench (Vals AI)Agentic work Not measured Not in index
IOI (Vals AI)Coding Not measured Not in index
Terminal-Bench 2.1 (Vals AI)Coding Not measured Not in index
SWE-bench Multimodal (Vals AI)Coding Not measured Not in index
Vibe Code Bench 1-100 (Vals AI)Coding Not measured Not in index
SkillsBench (Vals AI)Coding Not measured Not in index
CyberBench (Vals AI)Coding Not measured Not in index
Finance Agent (Vals AI)Agentic work Not measured Not in index
Tax Agent Bench (Vals AI)Agentic work Not measured Not in index
Legal Research Bench (Vals AI)Agentic work Not measured Not in index
Harvey's Legal Agent Benchmark (Vals AI)Agentic work Not measured Not in index
Excel Modeling Benchmark (Vals AI)Agentic work Not measured Not in index
BioMysteryBench (Vals AI)Agentic work Not measured Not in index
Terminal-Bench-Science (Vals AI)Agentic work Not measured Not in index
Vals Science IndexAgentic work Not measured Not in index
Time Horizon Index (Vals AI)Agentic work Not measured Not in index
CUA-bench (Vals AI)Agentic work Not measured Not in index
Robo-bench (Vals AI)Agentic work Not measured Not in index
Public Benefits Bench (Vals AI)General Not measured Not in index
MysteryMechanism (Vals AI)Reasoning Not measured Not in index
MMMU Pro (Vals AI)Reasoning Not measured Not in index
MATH 500 (Vals AI)Math Not measured Not in index
MGSM (Vals AI)Math Not measured Not in index
SAGE (Vals AI)General Not measured Not in index
LegalBench (Vals AI)Knowledge Not measured Not in index
CaseLaw (Vals AI)Knowledge Not measured Not in index
CorpFin (Vals AI)Knowledge Not measured Not in index
TaxEval (Vals AI)Knowledge Not measured Not in index
MortgageTax (Vals AI)Knowledge Not measured Not in index
MedQA (Vals AI)Knowledge Not measured Not in index
MedCode (Vals AI)Knowledge Not measured Not in index
MedScribe (Vals AI)General Not measured Not in index
Vals Multimodal IndexGeneral Not measured Not in index
AA Math IndexMath Not measured Not in index
GPQA Diamond (Artificial Analysis run)Reasoning 89.3% Not in index
Humanity's Last Exam (Artificial Analysis run)Reasoning 29.0% Not in index
MMLU Pro (Artificial Analysis run)Knowledge Not measured Not in index
LiveCodeBench (Artificial Analysis run)Coding Not measured Not in index
SciCodeCoding 44.8% Not in index
Terminal-Bench Hard (Artificial Analysis run)Coding 40.9% Not in index
IFBenchGeneral 78.8% Not in index
Long context reasoning (AA-LCR)General 77.3% Not in index
τ²-Bench TelecomAgentic work 95.6% Not in index
AIME 2025 (Artificial Analysis run)Math Not measured Not in index
Terminal-BenchCoding Not measured Not in index
DeepSWECoding Not measured Not in index
FrontierCodeCoding Not measured Not in index
FrontierSWECoding Not measured Not in index
GSO-BenchCoding Not measured Not in index
WeirdMLCoding Not measured Not in index
MirrorCodeCoding Not measured Not in index
APEX-AgentsAgentic work 24.9% Not in index
METR time horizonsAgentic work Not measured Not in index
Remote Labor IndexAgentic work Not measured Not in index
GDPvalAgentic work Not measured Not in index
OSWorld 2.0Agentic work Not measured Not in index
BALROGAgentic work Not measured Not in index
DeepResearch BenchAgentic work Not measured Not in index
PostTrainBenchAgentic work Not measured Not in index
GPQA Diamond (Epoch AI run)Reasoning 86.4% Not in index
ARC-AGIReasoning Not measured Not in index
ARC-AGI-2Reasoning Not measured Not in index
Humanity's Last ExamReasoning Not measured Not in index
SimpleBenchReasoning Not measured Not in index
Chess puzzlesReasoning Not measured Not in index
Mystery game puzzlesReasoning 18.0% Not in index
EBR-benchReasoning Not measured Not in index
OTIS Mock AIMEMath 88.9% Not in index
FrontierMath, tiers 1 to 3Math 31.2% Not in index
FrontierMath, tier 4Math Not measured Not in index
ProofBenchMath Not measured Not in index
MATH level 5Math Not measured Not in index
GSM8KMath Not measured Not in index
SimpleQA VerifiedKnowledge Not measured Not in index
MMLUKnowledge Not measured Not in index
GeoBenchKnowledge Not measured Not in index
DTBenchGeneral 87.5% Not in index
LMCAGeneral 37.9% Not in index
Fiction.LiveBenchGeneral Not measured Not in index
Creative writing (Lech Mazur)General Not measured Not in index
CL-benchGeneral Not measured Not in index
Surface Evolver BenchGeneral Not measured Not in index
Furniture assemblyGeneral Not measured Not in index
ExploitBenchGeneral Not measured Not in index
CybenchCoding Not measured Not in index
TheAgentCompanyAgentic work Not measured Not in index
OSWorldAgentic work Not measured Not in index
SpireClimbAgentic work Not measured Not in index
VPCTReasoning Not measured Not in index
BIG-Bench HardReasoning Not measured Not in index
AI2 Reasoning ChallengeKnowledge Not measured Not in index
HellaSwagGeneral Not measured Not in index
WinoGrandeGeneral Not measured Not in index
PIQAGeneral Not measured Not in index
CL-bench LifeGeneral Not measured Not in index
ALE-BenchCoding 621.9 Not in index
Vending-Bench 2Agentic work Not measured Not in index
Epoch Capabilities IndexIntelligence 146.7 Not in index
LMArena TextGeneral 1438 Not in index
LMArena Text: codingCoding 1464 Not in index
LMArena Text: hard promptsReasoning 1448 Not in index
LMArena Text: mathMath 1454 Not in index
LMArena Text: instruction followingGeneral 1423 Not in index
LMArena Text: creative writingGeneral 1402 Not in index
LMArena VisionGeneral 1262 Not in index
LMArena Text: EnglishGeneral 1443 Not in index
LMArena Text: non-EnglishGeneral 1430 Not in index
LMArena Text: ChineseGeneral 1499 Not in index
LMArena Text: GermanGeneral 1446 Not in index
LMArena Text: JapaneseGeneral 1429 Not in index
LMArena Text: KoreanGeneral 1383 Not in index
LMArena Text: FrenchGeneral 1461 Not in index
LMArena Text: SpanishGeneral 1441 Not in index
LMArena Text: RussianGeneral 1429 Not in index
LMArena Text: PolishGeneral 1449 Not in index
LMArena Text: multi-turnGeneral 1446 Not in index
LMArena Text: longer queriesGeneral 1442 Not in index
LMArena Text: expertReasoning 1461 Not in index
LMArena Text: hard prompts in EnglishReasoning 1450 Not in index
LMArena Text: software and ITCoding 1463 Not in index
LMArena Text: mathematical workMath 1453 Not in index
LMArena Text: scienceKnowledge 1457 Not in index
LMArena Text: medicine and healthcareKnowledge 1454 Not in index
LMArena Text: legal and governmentKnowledge 1440 Not in index
LMArena Text: business and financeKnowledge 1434 Not in index
LMArena Text: writing and languageGeneral 1415 Not in index
LMArena Text: entertainment and mediaGeneral 1398 Not in index
LMArena WebDev: ReactCoding 1388 Not in index
LMArena WebDev: HTMLCoding 1410 Not in index
LMArena WebDev: from an imageCoding Not measured Not in index
LMArena Vision: EnglishGeneral 1268 Not in index
LMArena Vision: ChineseGeneral 1314 Not in index
LMArena Vision: reading textGeneral 1271 Not in index
LMArena Vision: diagramsReasoning 1277 Not in index
LMArena Vision: homeworkReasoning 1292 Not in index
LMArena Vision: humorGeneral 1262 Not in index
LMArena Vision: captioningGeneral 1230 Not in index
LMArena Vision: recognizing thingsGeneral 1265 Not in index
LMArena Vision: creative writingGeneral 1260 Not in index
LMArena SearchAgentic work Not measured Not in index
LMArena DocumentGeneral Not measured Not in index
LMArena Text to ImageImage generation Not measured Not in index
LMArena Image EditImage generation Not measured Not in index

What it costs

A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.

Output price against the market

Qwen3.5 397B A17B pricing
$0.0112Dashed line: median $1.80, log scale$600.00
$2.34 per million output tokens is cheaper than 41% of the 344 paid models in the catalog.

Cost per solved task

How it is computed

Neither board that publishes what a SWE-bench Verified attempt costs, Vals AI and swebench.com, has run this model. We leave the number out rather than estimate it.

Nearly as good as Qwen3.5 397B A17B, for less

What the boards say about its runs

Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.

What each board publishes about the runs behind Qwen: Qwen3.5 397B A17B's results
BoardResultWhat the run costAlso published
ALE-Bench 621.9 $0.0398 per problem Tokens per problem 13,771
LMArena WebDev 1400 Elo Not published Votes 21,156 · Interval (±) ±5.1
Design Arena: websites 1191 Elo Not published Battles 5,253
Design Arena: UI components 1164 Elo Not published Battles 488
Design Arena: game dev 1140 Elo Not published Battles 1,162
Design Arena: data viz 1175 Elo Not published Battles 267
Design Arena: 3D 1161 Elo Not published Battles 960
Design Arena: all code categories 1180 Elo Not published Battles 8,130
Design Arena: SVG 1138 Elo Not published Battles 969
APEX-Agents 24.9% Not published Mean score 40.3%
LMArena Text 1438 Elo Not published Votes 93,567 · Interval (±) ±3.1
LMArena Text: coding 1464 Elo Not published Votes 26,519 · Interval (±) ±4.8
38 more boards
What each board publishes about the runs behind Qwen: Qwen3.5 397B A17B's results, continued
LMArena Text: hard prompts 1448 Elo Not published Votes 61,654 · Interval (±) ±3.7
LMArena Text: math 1454 Elo Not published Votes 5,146 · Interval (±) ±8.6
LMArena Text: instruction following 1423 Elo Not published Votes 31,992 · Interval (±) ±4.4
LMArena Text: creative writing 1402 Elo Not published Votes 16,543 · Interval (±) ±5.6
LMArena Vision 1262 Elo Not published Votes 32,657 · Interval (±) ±5.3
LMArena Text: English 1443 Elo Not published Votes 41,306 · Interval (±) ±4.0
LMArena Text: non-English 1430 Elo Not published Votes 52,251 · Interval (±) ±3.7
LMArena Text: Chinese 1499 Elo Not published Votes 6,487 · Interval (±) ±7.9
LMArena Text: German 1446 Elo Not published Votes 1,455 · Interval (±) ±16.5
LMArena Text: Japanese 1429 Elo Not published Votes 1,136 · Interval (±) ±19.4
LMArena Text: Korean 1383 Elo Not published Votes 1,570 · Interval (±) ±16.3
LMArena Text: French 1461 Elo Not published Votes 3,026 · Interval (±) ±12.5
LMArena Text: Spanish 1441 Elo Not published Votes 2,935 · Interval (±) ±11.9
LMArena Text: Russian 1429 Elo Not published Votes 10,715 · Interval (±) ±6.3
LMArena Text: Polish 1449 Elo Not published Votes 1,665 · Interval (±) ±14.5
LMArena Text: multi-turn 1446 Elo Not published Votes 15,114 · Interval (±) ±5.7
LMArena Text: longer queries 1442 Elo Not published Votes 41,250 · Interval (±) ±4.3
LMArena Text: expert 1461 Elo Not published Votes 10,076 · Interval (±) ±6.7
LMArena Text: hard prompts in English 1450 Elo Not published Votes 27,732 · Interval (±) ±4.7
LMArena Text: software and IT 1463 Elo Not published Votes 37,377 · Interval (±) ±4.2
LMArena Text: mathematical work 1453 Elo Not published Votes 5,472 · Interval (±) ±8.6
LMArena Text: science 1457 Elo Not published Votes 15,315 · Interval (±) ±5.5
LMArena Text: medicine and healthcare 1454 Elo Not published Votes 6,965 · Interval (±) ±7.8
LMArena Text: legal and government 1440 Elo Not published Votes 7,182 · Interval (±) ±7.5
LMArena Text: business and finance 1434 Elo Not published Votes 18,675 · Interval (±) ±5.2
LMArena Text: writing and language 1415 Elo Not published Votes 23,093 · Interval (±) ±4.9
LMArena Text: entertainment and media 1398 Elo Not published Votes 21,199 · Interval (±) ±5.1
LMArena WebDev: React 1388 Elo Not published Votes 16,758 · Interval (±) ±5.7
LMArena WebDev: HTML 1410 Elo Not published Votes 2,604 · Interval (±) ±12.1
LMArena Vision: English 1268 Elo Not published Votes 12,659 · Interval (±) ±7.5
LMArena Vision: Chinese 1314 Elo Not published Votes 2,045 · Interval (±) ±15.3
LMArena Vision: reading text 1271 Elo Not published Votes 22,696 · Interval (±) ±5.2
LMArena Vision: diagrams 1277 Elo Not published Votes 8,623 · Interval (±) ±7.3
LMArena Vision: homework 1292 Elo Not published Votes 4,001 · Interval (±) ±9.7
LMArena Vision: humor 1262 Elo Not published Votes 1,223 · Interval (±) ±17.2
LMArena Vision: captioning 1230 Elo Not published Votes 78 · Interval (±) ±56.7
LMArena Vision: recognizing things 1265 Elo Not published Votes 222 · Interval (±) ±36.7
LMArena Vision: creative writing 1260 Elo Not published Votes 2,304 · Interval (±) ±12.9

On these lists

Compare with models of a similar score

All 135 comparisons for Qwen3.5 397B A17B