LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

GPT-5.1 vs Qwen3.6 Plus

Updated October 21, 2026. 73 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

GPT-5.1OpenAI
Coding
53.3
Overall
24.7
Output $/M
$10.00
41
Qwen3.6 PlusQwen
Coding
37.4
Overall
27.0
Output $/M
$1.95
32
vs boards won of 73 shared

Decision reading

Pick GPT-5.1 for coding: it scores 53.3 on the Vibe Coding Index against 37.4 for Qwen3.6 Plus.

Pick Qwen3.6 Plus when output tokens cost 5.1x less, or when the context window is larger, 1M against 400K tokens.

Shared results
73
GPT-5.1 only
27
Qwen3.6 Plus only
10
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-5.1 53.3 from 2 benchmarks, Qwen3.6 Plus 37.4 from 1 benchmark.
Widest category
Agentic work, 19.3 points apart on average over 2 shared benchmarks.
Widest single gap
Chess puzzles: GPT-5.1 42.0% against Qwen3.6 Plus 14.0%, 28.0 points apart on a 0 to 100 scale.
Output price
GPT-5.1 $10.00 against Qwen3.6 Plus $1.95 per million output tokens, 5.1x apart.
Context window
GPT-5.1 takes 400K tokens, Qwen3.6 Plus 1M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-5.1BarsQwen3.6 PlusTies
Coding29
Intelligence11
Agentic work02
Reasoning64
Math13
Knowledge102
Web design17
General204
All shared boards4132
CodingLike-for-likeFour of these boards feed the Vibe Coding Index29
Coding benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
SWE-bench Verified66.0%Not measuredOnly GPT-5.1 measured
LMArena WebDev13961461Qwen3.6 Plus
AA Coding Index49.454.5Qwen3.6 Plus
LiveCodeBench (Vals AI)86.5%86.0%GPT-5.1
SWE-bench Verified (Vals AI)69.8%73.4%Qwen3.6 Plus
Vibe Code Bench (Vals AI)24.6%25.6%Qwen3.6 Plus
Code migration (Vals AI)Not measured11.1%Only Qwen3.6 Plus measured
ProgramBench (Vals AI)Not measured0.0%Only Qwen3.6 Plus measured
Terminal-Bench 2.1 (Vals AI)Not measured53.2%Only Qwen3.6 Plus measured
LiveCodeBench (Artificial Analysis run)86.8%Not measuredOnly GPT-5.1 measured
Terminal-Bench Hard (Artificial Analysis run)45.5%43.9%GPT-5.1
Terminal-Bench47.6%Not measuredOnly GPT-5.1 measured
GSO-Bench13.7%Not measuredOnly GPT-5.1 measured
WeirdML60.8%Not measuredOnly GPT-5.1 measured
ALE-BenchNot measured670.1Only Qwen3.6 Plus measured
LMArena Text: coding14531467Qwen3.6 Plus
LMArena Text: software and IT14541462Qwen3.6 Plus
LMArena WebDev: React13071454Qwen3.6 Plus
LMArena WebDev: HTML14051463Qwen3.6 Plus
LMArena WebDev: from an image14211472Qwen3.6 Plus
Neither model has a result on the other 18 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index11
Intelligence benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
AA Intelligence Index24.727.0Qwen3.6 Plus
Epoch Capabilities Index149.8147.3GPT-5.1
Agentic workLike-for-likePublic boards, shown as published, kept out of the index02
Agentic work benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
Finance Agent (Vals AI)Not measured40.9%Only Qwen3.6 Plus measured
Tax Agent Bench (Vals AI)Not measured7.7%Only Qwen3.6 Plus measured
Legal Research Bench (Vals AI)Not measured14.9%Only Qwen3.6 Plus measured
Excel Modeling Benchmark (Vals AI)Not measured32.9%Only Qwen3.6 Plus measured
τ²-Bench Telecom81.9%97.7%Qwen3.6 Plus
DeepResearch Bench42.8%Not measuredOnly GPT-5.1 measured
Vending-Bench 2$1,473$5,115Qwen3.6 Plus
Neither model has a result on the other 32 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index64
Reasoning benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
GPQA Diamond86.6%87.4%Qwen3.6 Plus
MMMU Pro (Vals AI)83.2%84.2%Qwen3.6 Plus
GPQA Diamond (Artificial Analysis run)87.3%88.2%Qwen3.6 Plus
Humanity's Last Exam (Artificial Analysis run)28.5%27.8%GPT-5.1
GPQA Diamond (Epoch AI run)87.6%88.4%Qwen3.6 Plus
ARC-AGI72.8%Not measuredOnly GPT-5.1 measured
ARC-AGI-217.6%Not measuredOnly GPT-5.1 measured
SimpleBench53.2%Not measuredOnly GPT-5.1 measured
Chess puzzles42.0%14.0%GPT-5.1
Mystery game puzzles19.0%12.0%GPT-5.1
VPCT58.7%Not measuredOnly GPT-5.1 measured
LMArena Text: hard prompts14571448GPT-5.1
LMArena Text: expert14701454GPT-5.1
LMArena Text: hard prompts in English14621455GPT-5.1
LMArena Vision: diagrams1264Not measuredOnly GPT-5.1 measured
LMArena Vision: homework1272Not measuredOnly GPT-5.1 measured
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index13
Math benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
AIME93.3%94.6%Qwen3.6 Plus
MGSM (Vals AI)93.0%Not measuredOnly GPT-5.1 measured
AA Math Index94.0Not measuredOnly GPT-5.1 measured
AIME 2025 (Artificial Analysis run)94.0%Not measuredOnly GPT-5.1 measured
OTIS Mock AIME88.6%93.3%Qwen3.6 Plus
FrontierMath, tiers 1 to 3Not measured38.2%Only Qwen3.6 Plus measured
LMArena Text: math14461449Qwen3.6 Plus
LMArena Text: mathematical work14491448GPT-5.1
Neither model has a result on the other 5 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index102
Knowledge benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
MMLU Pro86.4%87.7%Qwen3.6 Plus
LegalBench (Vals AI)85.7%84.2%GPT-5.1
CaseLaw (Vals AI)73.4%51.5%GPT-5.1
CorpFin (Vals AI)63.8%61.9%GPT-5.1
TaxEval (Vals AI)74.9%74.7%GPT-5.1
MortgageTax (Vals AI)61.4%68.0%Qwen3.6 Plus
MedQA (Vals AI)96.4%Not measuredOnly GPT-5.1 measured
MedCode (Vals AI)52.7%36.9%GPT-5.1
MMLU Pro (Artificial Analysis run)87.0%Not measuredOnly GPT-5.1 measured
SimpleQA Verified48.0%44.1%GPT-5.1
LMArena Text: science14591439GPT-5.1
LMArena Text: medicine and healthcare14561442GPT-5.1
LMArena Text: legal and government14591437GPT-5.1
LMArena Text: business and finance14311430GPT-5.1
Neither model has a result on the other 3 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index17
Web design benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
Design Arena: websites11871243Qwen3.6 Plus
Design Arena: UI components11661233Qwen3.6 Plus
Design Arena: game dev11791211Qwen3.6 Plus
Design Arena: data viz12041228Qwen3.6 Plus
Design Arena: 3D10611202Qwen3.6 Plus
Design Arena: all code categories11711236Qwen3.6 Plus
Design Arena: SVG11491160Qwen3.6 Plus
Design Arena: ASCII art11181115GPT-5.1
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index204
General benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
SAGE (Vals AI)43.2%44.9%Qwen3.6 Plus
MedScribe (Vals AI)88.1%77.0%GPT-5.1
Vals Multimodal IndexNot measured51.5%Only Qwen3.6 Plus measured
IFBench72.9%75.2%Qwen3.6 Plus
Long context reasoning (AA-LCR)80.0%78.3%GPT-5.1
DTBench90.1%81.9%GPT-5.1
LMCA43.9%33.1%GPT-5.1
CL-bench23.7%20.3%GPT-5.1
CL-bench Life17.3%Not measuredOnly GPT-5.1 measured
LMArena Text14431436GPT-5.1
LMArena Text: instruction following14431424GPT-5.1
LMArena Text: creative writing14271404GPT-5.1
LMArena Vision1250Not measuredOnly GPT-5.1 measured
LMArena Text: English14511445GPT-5.1
LMArena Text: non-English14311424GPT-5.1
LMArena Text: Chinese14951477GPT-5.1
LMArena Text: German14381451Qwen3.6 Plus
LMArena Text: Japanese14531390GPT-5.1
LMArena Text: Korean14011379GPT-5.1
LMArena Text: French14501455Qwen3.6 Plus
LMArena Text: Spanish14331432GPT-5.1
LMArena Text: Russian14351434GPT-5.1
LMArena Text: Polish14401433GPT-5.1
LMArena Text: multi-turn14501438GPT-5.1
LMArena Text: longer queries14481439GPT-5.1
LMArena Text: writing and language14281418GPT-5.1
LMArena Text: entertainment and media14151402GPT-5.1
LMArena Vision: English1252Not measuredOnly GPT-5.1 measured
LMArena Vision: Chinese1270Not measuredOnly GPT-5.1 measured
LMArena Vision: reading text1255Not measuredOnly GPT-5.1 measured
LMArena Vision: humor1263Not measuredOnly GPT-5.1 measured
LMArena Vision: captioning1252Not measuredOnly GPT-5.1 measured
LMArena Vision: recognizing things1232Not measuredOnly GPT-5.1 measured
LMArena Vision: creative writing1266Not measuredOnly GPT-5.1 measured
LMArena Document1403Not measuredOnly GPT-5.1 measured
Neither model has a result on the other 11 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-5.1 and Qwen3.6 Plus
BenchmarkGPT-5.1Qwen3.6 PlusLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-5.1$0.0063Fits in one request
Qwen3.6 Plus$0.0013Fits in one request

Qwen3.6 Plus costs less

Repository review

50K input + 3K output tokens

GPT-5.1$0.092Fits in one request
Qwen3.6 Plus$0.022Fits in one request

Qwen3.6 Plus costs less

Agent loop

200K input + 10K output tokens

GPT-5.1$0.350Fits in one request
Qwen3.6 Plus$0.085Fits in one request

Qwen3.6 Plus costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-5.1 and Qwen3.6 Plus
SpecificationOpenAI GPT-5.1Qwen3.6 Plus
MakerOpenAIQwen
WeightsNo public weights listedNo public weights listed
ReleasedNovember 13, 2025April 2, 2026
Context window400K1M
Input $/Mtok$1.25$0.325
Output $/Mtok$10.00$1.95
Coding index53.337.4
Independent measurements behind it21
Cost per solved task$1.02$1.19
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-5.1 better than Qwen3.6 Plus for coding?

Pick GPT-5.1 for coding: it scores 53.3 on the Vibe Coding Index against 37.4 for Qwen3.6 Plus. Pick Qwen3.6 Plus when output tokens cost 5.1x less, or when the context window is larger, 1M against 400K tokens.

Which is cheaper, GPT-5.1 or Qwen3.6 Plus?

GPT-5.1 costs $1.25 per million input tokens and $10.00 per million output tokens; Qwen3.6 Plus costs $0.325 and $1.95. Per solved SWE-bench Verified task, GPT-5.1 costs $1.02 and Qwen3.6 Plus $1.19.

Which has the bigger context window, GPT-5.1 or Qwen3.6 Plus?

Qwen3.6 Plus, with 1M tokens against 400K.

How many benchmarks is the GPT-5.1 vs Qwen3.6 Plus comparison based on?

73 benchmarks have a result for both models as of October 21, 2026. GPT-5.1's coding index rests on 2 independent benchmarks and Qwen3.6 Plus's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next