LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

GPT-4o (2024-08-06) vs Qwen3.6 Plus

Updated October 21, 2026. 46 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

GPT-4o (2024-08-06)OpenAI
Coding
23.1
Overall
7.7
Output $/M
$10.00
0
Qwen3.6 PlusQwen
Coding
37.4
Overall
27.0
Output $/M
$1.95
46
vs boards won of 46 shared

Decision reading

Pick Qwen3.6 Plus for coding: it scores 37.4 on the Vibe Coding Index against 23.1 for GPT-4o (2024-08-06).

GPT-4o (2024-08-06) is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Shared results
46
GPT-4o (2024-08-06) only
12
Qwen3.6 Plus only
37
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-4o (2024-08-06) 23.1 from 1 benchmark, Qwen3.6 Plus 37.4 from 1 benchmark.
Widest category
Agentic work, 68.7 points apart on average over 1 shared benchmark.
Widest single gap
OTIS Mock AIME: GPT-4o (2024-08-06) 6.4% against Qwen3.6 Plus 93.3%, 86.9 points apart on a 0 to 100 scale.
Output price
GPT-4o (2024-08-06) $10.00 against Qwen3.6 Plus $1.95 per million output tokens, 5.1x apart.
Context window
GPT-4o (2024-08-06) takes 128K tokens, Qwen3.6 Plus 1M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-4o (2024-08-06)BarsQwen3.6 PlusTies
Coding03
Intelligence01
Agentic work01
Reasoning08
Math05
Knowledge010
General018
All shared boards046
CodingLike-for-likeFour of these boards feed the Vibe Coding Index03
Coding benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
Aider polyglot23.1%Not measuredOnly GPT-4o (2024-08-06) measured
SWE-bench Lite21.7%Not measuredOnly GPT-4o (2024-08-06) measured
LMArena WebDevNot measured1461Only Qwen3.6 Plus measured
AA Coding IndexNot measured54.5Only Qwen3.6 Plus measured
LiveCodeBench (Vals AI)Not measured86.0%Only Qwen3.6 Plus measured
SWE-bench Verified (Vals AI)Not measured73.4%Only Qwen3.6 Plus measured
Vibe Code Bench (Vals AI)Not measured25.6%Only Qwen3.6 Plus measured
Code migration (Vals AI)Not measured11.1%Only Qwen3.6 Plus measured
ProgramBench (Vals AI)Not measured0.0%Only Qwen3.6 Plus measured
Terminal-Bench 2.1 (Vals AI)Not measured53.2%Only Qwen3.6 Plus measured
LiveCodeBench (Artificial Analysis run)31.7%Not measuredOnly GPT-4o (2024-08-06) measured
Terminal-Bench Hard (Artificial Analysis run)8.3%43.9%Qwen3.6 Plus
ALE-BenchNot measured670.1Only Qwen3.6 Plus measured
LMArena Text: coding12831467Qwen3.6 Plus
LMArena Text: software and IT12781462Qwen3.6 Plus
LMArena WebDev: ReactNot measured1454Only Qwen3.6 Plus measured
LMArena WebDev: HTMLNot measured1463Only Qwen3.6 Plus measured
LMArena WebDev: from an imageNot measured1472Only Qwen3.6 Plus measured
Neither model has a result on the other 20 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
AA Intelligence Index7.727.0Qwen3.6 Plus
Epoch Capabilities IndexNot measured147.3Only Qwen3.6 Plus measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index01
Agentic work benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
Finance Agent (Vals AI)Not measured40.9%Only Qwen3.6 Plus measured
Tax Agent Bench (Vals AI)Not measured7.7%Only Qwen3.6 Plus measured
Legal Research Bench (Vals AI)Not measured14.9%Only Qwen3.6 Plus measured
Excel Modeling Benchmark (Vals AI)Not measured32.9%Only Qwen3.6 Plus measured
τ²-Bench Telecom28.9%97.7%Qwen3.6 Plus
Vending-Bench 2Not measured$5,115Only Qwen3.6 Plus measured
Neither model has a result on the other 33 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index08
Reasoning benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
GPQA DiamondNot measured87.4%Only Qwen3.6 Plus measured
MMMU Pro (Vals AI)64.0%84.2%Qwen3.6 Plus
GPQA Diamond (Artificial Analysis run)52.1%88.2%Qwen3.6 Plus
Humanity's Last Exam (Artificial Analysis run)2.3%27.8%Qwen3.6 Plus
GPQA Diamond (Epoch AI run)49.2%88.4%Qwen3.6 Plus
SimpleBench17.8%Not measuredOnly GPT-4o (2024-08-06) measured
Chess puzzles6.0%14.0%Qwen3.6 Plus
Mystery game puzzlesNot measured12.0%Only Qwen3.6 Plus measured
LMArena Text: hard prompts12641448Qwen3.6 Plus
LMArena Text: expert12411454Qwen3.6 Plus
LMArena Text: hard prompts in English12771455Qwen3.6 Plus
Neither model has a result on the other 10 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index05
Math benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
AIME14.0%94.6%Qwen3.6 Plus
MATH 500 (Vals AI)75.2%Not measuredOnly GPT-4o (2024-08-06) measured
MGSM (Vals AI)90.7%Not measuredOnly GPT-4o (2024-08-06) measured
OTIS Mock AIME6.4%93.3%Qwen3.6 Plus
FrontierMath, tiers 1 to 30.4%38.2%Qwen3.6 Plus
MATH level 553.3%Not measuredOnly GPT-4o (2024-08-06) measured
LMArena Text: math12851449Qwen3.6 Plus
LMArena Text: mathematical work12831448Qwen3.6 Plus
Neither model has a result on the other 5 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index010
Knowledge benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
MMLU Pro74.1%87.7%Qwen3.6 Plus
LegalBench (Vals AI)80.1%84.2%Qwen3.6 Plus
CaseLaw (Vals AI)Not measured51.5%Only Qwen3.6 Plus measured
CorpFin (Vals AI)39.4%61.9%Qwen3.6 Plus
TaxEval (Vals AI)71.1%74.7%Qwen3.6 Plus
MortgageTax (Vals AI)61.0%68.0%Qwen3.6 Plus
MedQA (Vals AI)88.2%Not measuredOnly GPT-4o (2024-08-06) measured
MedCode (Vals AI)Not measured36.9%Only Qwen3.6 Plus measured
SimpleQA Verified26.0%44.1%Qwen3.6 Plus
MMLU84.3%Not measuredOnly GPT-4o (2024-08-06) measured
LMArena Text: science12741439Qwen3.6 Plus
LMArena Text: medicine and healthcare12521442Qwen3.6 Plus
LMArena Text: legal and government12751437Qwen3.6 Plus
LMArena Text: business and finance12321430Qwen3.6 Plus
Neither model has a result on the other 3 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
Design Arena: websitesNot measured1243Only Qwen3.6 Plus measured
Design Arena: UI componentsNot measured1233Only Qwen3.6 Plus measured
Design Arena: game devNot measured1211Only Qwen3.6 Plus measured
Design Arena: data vizNot measured1228Only Qwen3.6 Plus measured
Design Arena: 3DNot measured1202Only Qwen3.6 Plus measured
Design Arena: all code categoriesNot measured1236Only Qwen3.6 Plus measured
Design Arena: SVGNot measured1160Only Qwen3.6 Plus measured
Design Arena: ASCII artNot measured1115Only Qwen3.6 Plus measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index018
General benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
SAGE (Vals AI)Not measured44.9%Only Qwen3.6 Plus measured
MedScribe (Vals AI)Not measured77.0%Only Qwen3.6 Plus measured
Vals Multimodal IndexNot measured51.5%Only Qwen3.6 Plus measured
IFBench36.0%75.2%Qwen3.6 Plus
Long context reasoning (AA-LCR)41.0%78.3%Qwen3.6 Plus
DTBenchNot measured81.9%Only Qwen3.6 Plus measured
LMCANot measured33.1%Only Qwen3.6 Plus measured
CL-benchNot measured20.3%Only Qwen3.6 Plus measured
LMArena Text12831436Qwen3.6 Plus
LMArena Text: instruction following12671424Qwen3.6 Plus
LMArena Text: creative writing12741404Qwen3.6 Plus
LMArena Vision1065Not measuredOnly GPT-4o (2024-08-06) measured
LMArena Text: English12971445Qwen3.6 Plus
LMArena Text: non-English12621424Qwen3.6 Plus
LMArena Text: Chinese12541477Qwen3.6 Plus
LMArena Text: German12571451Qwen3.6 Plus
LMArena Text: Japanese12341390Qwen3.6 Plus
LMArena Text: Korean12181379Qwen3.6 Plus
LMArena Text: French12631455Qwen3.6 Plus
LMArena Text: Spanish12691432Qwen3.6 Plus
LMArena Text: Russian12721434Qwen3.6 Plus
LMArena Text: PolishNot measured1433Only Qwen3.6 Plus measured
LMArena Text: multi-turn12791438Qwen3.6 Plus
LMArena Text: longer queries12831439Qwen3.6 Plus
LMArena Text: writing and language12901418Qwen3.6 Plus
LMArena Text: entertainment and media12671402Qwen3.6 Plus
LMArena Vision: English1072Not measuredOnly GPT-4o (2024-08-06) measured
LMArena Vision: Chinese1009Not measuredOnly GPT-4o (2024-08-06) measured
Neither model has a result on the other 18 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-4o (2024-08-06) and Qwen3.6 Plus
BenchmarkGPT-4o (2024-08-06)Qwen3.6 PlusLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-4o (2024-08-06)$0.0075Fits in one request
Qwen3.6 Plus$0.0013Fits in one request

Qwen3.6 Plus costs less

Repository review

50K input + 3K output tokens

GPT-4o (2024-08-06)$0.155Fits in one request
Qwen3.6 Plus$0.022Fits in one request

Qwen3.6 Plus costs less

Agent loop

200K input + 10K output tokens

GPT-4o (2024-08-06)$0.600Exceeds the context window
Qwen3.6 Plus$0.085Fits in one request

Qwen3.6 Plus costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-4o (2024-08-06) and Qwen3.6 Plus
SpecificationOpenAI GPT-4o (2024-08-06)Qwen3.6 Plus
MakerOpenAIQwen
WeightsNo public weights listedNo public weights listed
ReleasedAugust 6, 2024April 2, 2026
Context window128K1M
Input $/Mtok$2.50$0.325
Output $/Mtok$10.00$1.95
Coding index23.137.4
Independent measurements behind it11
Cost per solved taskNot computable$1.19
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-4o (2024-08-06) better than Qwen3.6 Plus for coding?

Pick Qwen3.6 Plus for coding: it scores 37.4 on the Vibe Coding Index against 23.1 for GPT-4o (2024-08-06). GPT-4o (2024-08-06) is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Which is cheaper, GPT-4o (2024-08-06) or Qwen3.6 Plus?

GPT-4o (2024-08-06) costs $2.50 per million input tokens and $10.00 per million output tokens; Qwen3.6 Plus costs $0.325 and $1.95. Cost per solved task is known for Qwen3.6 Plus only.

Which has the bigger context window, GPT-4o (2024-08-06) or Qwen3.6 Plus?

Qwen3.6 Plus, with 1M tokens against 128K.

How many benchmarks is the GPT-4o (2024-08-06) vs Qwen3.6 Plus comparison based on?

46 benchmarks have a result for both models as of October 21, 2026. GPT-4o (2024-08-06)'s coding index rests on 1 independent benchmark and Qwen3.6 Plus's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next