LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

GPT-6 Sol vs Qwen2.5 Coder 32B Instruct

Updated October 21, 2026. 25 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

GPT-6 SolOpenAI
Coding
82.8
Overall
47.6
Output $/M
$10.00
25
Qwen2.5 Coder 32B InstructQwen
Coding
30.5
Overall
6.7
Output $/M
$1.00
0
vs boards won of 25 shared

Decision reading

Pick GPT-6 Sol for coding: it scores 82.8 on the Vibe Coding Index against 30.5 for Qwen2.5 Coder 32B Instruct.

Pick Qwen2.5 Coder 32B Instruct when output tokens cost 10.0x less.

Shared results
25
GPT-6 Sol only
75
Qwen2.5 Coder 32B Instruct only
10
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-6 Sol 82.8 from 2 benchmarks, Qwen2.5 Coder 32B Instruct 30.5 from 2 benchmarks.
Widest category
Intelligence, 48.1 points apart on average over 2 shared benchmarks.
Widest single gap
Epoch Capabilities Index: GPT-6 Sol 163.7 against Qwen2.5 Coder 32B Instruct 119.5, 55.3 points apart on a 0 to 100 scale.
Output price
GPT-6 Sol $10.00 against Qwen2.5 Coder 32B Instruct $1.00 per million output tokens, 10.0x apart.
Context window
GPT-6 Sol takes 1.05M tokens, Qwen2.5 Coder 32B Instruct 33K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-6 SolBarsQwen2.5 Coder 32B InstructTies
Coding20
Intelligence20
Reasoning40
Math20
Knowledge40
General110
All shared boards250
CodingLike-for-likeFour of these boards feed the Vibe Coding Index20
Coding benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
Aider polyglotNot measured16.4%Only Qwen2.5 Coder 32B Instruct measured
SWE-bench VerifiedNot measured47.0%Only Qwen2.5 Coder 32B Instruct measured
LiveBench coding93.1%Not measuredOnly GPT-6 Sol measured
LMArena WebDev1683Not measuredOnly GPT-6 Sol measured
Terminal-Bench 4 (Vals AI)44.4%Not measuredOnly GPT-6 Sol measured
Vibe Code Bench (Vals AI)87.8%Not measuredOnly GPT-6 Sol measured
Code migration (Vals AI)57.2%Not measuredOnly GPT-6 Sol measured
ProgramBench (Vals AI)2.0%Not measuredOnly GPT-6 Sol measured
IOI (Vals AI)82.6%Not measuredOnly GPT-6 Sol measured
Terminal-Bench 2.1 (Vals AI)83.2%Not measuredOnly GPT-6 Sol measured
CyberBench (Vals AI)78.0%Not measuredOnly GPT-6 Sol measured
LiveCodeBench (Artificial Analysis run)Not measured29.5%Only Qwen2.5 Coder 32B Instruct measured
SciCode57.6%Not measuredOnly GPT-6 Sol measured
FrontierCode49.3%Not measuredOnly GPT-6 Sol measured
ALE-Bench2462.0Not measuredOnly GPT-6 Sol measured
LMArena Text: coding14481276GPT-6 Sol
LMArena Text: software and IT14331261GPT-6 Sol
LMArena WebDev: React1685Not measuredOnly GPT-6 Sol measured
LMArena WebDev: HTML1685Not measuredOnly GPT-6 Sol measured
LMArena WebDev: from an image1660Not measuredOnly GPT-6 Sol measured
Neither model has a result on the other 18 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
AA Intelligence Index47.66.7GPT-6 Sol
Epoch Capabilities Index163.7119.5GPT-6 Sol
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index17 boards, none shared
Agentic work benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
Design Arena: agents building web apps1232Not measuredOnly GPT-6 Sol measured
Design Arena: agents building full-stack apps1238Not measuredOnly GPT-6 Sol measured
Design Arena: agents building mobile apps1216Not measuredOnly GPT-6 Sol measured
LiveBench research69.3%Not measuredOnly GPT-6 Sol measured
LiveBench browser92.0%Not measuredOnly GPT-6 Sol measured
LiveBench long agentic66.9%Not measuredOnly GPT-6 Sol measured
SREBench (Vals AI)30.5%Not measuredOnly GPT-6 Sol measured
Finance Agent (Vals AI)49.0%Not measuredOnly GPT-6 Sol measured
Tax Agent Bench (Vals AI)15.0%Not measuredOnly GPT-6 Sol measured
Legal Research Bench (Vals AI)28.9%Not measuredOnly GPT-6 Sol measured
Excel Modeling Benchmark (Vals AI)71.5%Not measuredOnly GPT-6 Sol measured
BioMysteryBench (Vals AI)74.8%Not measuredOnly GPT-6 Sol measured
Terminal-Bench-Science (Vals AI)30.0%Not measuredOnly GPT-6 Sol measured
Vals Science Index45.0%Not measuredOnly GPT-6 Sol measured
APEX-Agents54.3%Not measuredOnly GPT-6 Sol measured
SpireClimb7.5%Not measuredOnly GPT-6 Sol measured
Vending-Bench 2$14,428Not measuredOnly GPT-6 Sol measured
Neither model has a result on the other 22 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index40
Reasoning benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
LiveBench reasoning88.7%Not measuredOnly GPT-6 Sol measured
MysteryMechanism (Vals AI)30.2%Not measuredOnly GPT-6 Sol measured
GPQA Diamond (Artificial Analysis run)Not measured41.7%Only Qwen2.5 Coder 32B Instruct measured
Humanity's Last Exam (Artificial Analysis run)47.9%3.5%GPT-6 Sol
GPQA Diamond (Epoch AI run)94.3%Not measuredOnly GPT-6 Sol measured
ARC-AGI95.5%Not measuredOnly GPT-6 Sol measured
ARC-AGI-289.6%Not measuredOnly GPT-6 Sol measured
Chess puzzles56.0%Not measuredOnly GPT-6 Sol measured
Mystery game puzzles56.0%Not measuredOnly GPT-6 Sol measured
EBR-bench53.3%Not measuredOnly GPT-6 Sol measured
LMArena Text: hard prompts14221251GPT-6 Sol
LMArena Text: expert14371221GPT-6 Sol
LMArena Text: hard prompts in English14201269GPT-6 Sol
LMArena Vision: diagrams1270Not measuredOnly GPT-6 Sol measured
LMArena Vision: homework1286Not measuredOnly GPT-6 Sol measured
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index20
Math benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
OTIS Mock AIME100.0%Not measuredOnly GPT-6 Sol measured
FrontierMath, tiers 1 to 389.8%Not measuredOnly GPT-6 Sol measured
FrontierMath, tier 490.0%Not measuredOnly GPT-6 Sol measured
ProofBench83.0%Not measuredOnly GPT-6 Sol measured
GSM8KNot measured93.0%Only Qwen2.5 Coder 32B Instruct measured
LMArena Text: math14071251GPT-6 Sol
LMArena Text: mathematical work14241243GPT-6 Sol
Neither model has a result on the other 6 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index40
Knowledge benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
MedCode (Vals AI)47.1%Not measuredOnly GPT-6 Sol measured
MMLU Pro (Artificial Analysis run)Not measured63.5%Only Qwen2.5 Coder 32B Instruct measured
SimpleQA Verified60.7%Not measuredOnly GPT-6 Sol measured
MMLUNot measured79.1%Only Qwen2.5 Coder 32B Instruct measured
AI2 Reasoning ChallengeNot measured70.5%Only Qwen2.5 Coder 32B Instruct measured
LMArena Text: science13891221GPT-6 Sol
LMArena Text: medicine and healthcare13661187GPT-6 Sol
LMArena Text: legal and government13961257GPT-6 Sol
LMArena Text: business and finance13801224GPT-6 Sol
Neither model has a result on the other 8 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
Design Arena: websites1292Not measuredOnly GPT-6 Sol measured
Design Arena: UI components1292Not measuredOnly GPT-6 Sol measured
Design Arena: game dev1313Not measuredOnly GPT-6 Sol measured
Design Arena: data viz1269Not measuredOnly GPT-6 Sol measured
Design Arena: 3D1322Not measuredOnly GPT-6 Sol measured
Design Arena: all code categories1301Not measuredOnly GPT-6 Sol measured
Design Arena: SVG1318Not measuredOnly GPT-6 Sol measured
Design Arena: ASCII art1226Not measuredOnly GPT-6 Sol measured
LiveBench design82.2%Not measuredOnly GPT-6 Sol measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index110
General benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
LiveBench data analysis81.2%Not measuredOnly GPT-6 Sol measured
Public Benefits Bench (Vals AI)56.6%Not measuredOnly GPT-6 Sol measured
SAGE (Vals AI)44.8%Not measuredOnly GPT-6 Sol measured
MedScribe (Vals AI)82.0%Not measuredOnly GPT-6 Sol measured
Long context reasoning (AA-LCR)83.7%Not measuredOnly GPT-6 Sol measured
DTBench97.3%Not measuredOnly GPT-6 Sol measured
LMCA59.1%Not measuredOnly GPT-6 Sol measured
Furniture assembly58.3%Not measuredOnly GPT-6 Sol measured
HellaSwagNot measured83.0%Only Qwen2.5 Coder 32B Instruct measured
WinoGrandeNot measured80.8%Only Qwen2.5 Coder 32B Instruct measured
LMArena Text13981230GPT-6 Sol
LMArena Text: instruction following14131223GPT-6 Sol
LMArena Text: creative writing13781174GPT-6 Sol
LMArena Vision1240Not measuredOnly GPT-6 Sol measured
LMArena Text: English13961248GPT-6 Sol
LMArena Text: non-English13881205GPT-6 Sol
LMArena Text: Chinese14121222GPT-6 Sol
LMArena Text: German1379Not measuredOnly GPT-6 Sol measured
LMArena Text: Japanese1377Not measuredOnly GPT-6 Sol measured
LMArena Text: Korean1336Not measuredOnly GPT-6 Sol measured
LMArena Text: French1399Not measuredOnly GPT-6 Sol measured
LMArena Text: Spanish1387Not measuredOnly GPT-6 Sol measured
LMArena Text: Russian14021228GPT-6 Sol
LMArena Text: Polish1372Not measuredOnly GPT-6 Sol measured
LMArena Text: multi-turn14141222GPT-6 Sol
LMArena Text: longer queries14161251GPT-6 Sol
LMArena Text: writing and language13891191GPT-6 Sol
LMArena Text: entertainment and media13731150GPT-6 Sol
LMArena Vision: English1229Not measuredOnly GPT-6 Sol measured
LMArena Vision: reading text1258Not measuredOnly GPT-6 Sol measured
LMArena Vision: creative writing1219Not measuredOnly GPT-6 Sol measured
Neither model has a result on the other 15 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-6 Sol and Qwen2.5 Coder 32B Instruct
BenchmarkGPT-6 SolQwen2.5 Coder 32B InstructLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-6 Sol$0.0070Fits in one request
Qwen2.5 Coder 32B Instruct$0.0012Fits in one request

Qwen2.5 Coder 32B Instruct costs less

Repository review

50K input + 3K output tokens

GPT-6 Sol$0.130Fits in one request
Qwen2.5 Coder 32B Instruct$0.036Exceeds the context window

Qwen2.5 Coder 32B Instruct costs less

Agent loop

200K input + 10K output tokens

GPT-6 Sol$0.500Fits in one request
Qwen2.5 Coder 32B Instruct$0.142Exceeds the context window

Qwen2.5 Coder 32B Instruct costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-6 Sol and Qwen2.5 Coder 32B Instruct
SpecificationOpenAI GPT-6 SolQwen2.5 Coder 32B Instruct
MakerOpenAIQwen
WeightsNo public weights listedOpen weights
ReleasedSeptember 22, 2026November 11, 2024
Context window1.05M33K
Input $/Mtok$2.00$0.66
Output $/Mtok$10.00$1.00
Coding index82.830.5
Independent measurements behind it22
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-6 Sol better than Qwen2.5 Coder 32B Instruct for coding?

Pick GPT-6 Sol for coding: it scores 82.8 on the Vibe Coding Index against 30.5 for Qwen2.5 Coder 32B Instruct. Pick Qwen2.5 Coder 32B Instruct when output tokens cost 10.0x less.

Which is cheaper, GPT-6 Sol or Qwen2.5 Coder 32B Instruct?

GPT-6 Sol costs $2.00 per million input tokens and $10.00 per million output tokens; Qwen2.5 Coder 32B Instruct costs $0.66 and $1.00. Cost per solved task is known for neither of them.

Which has the bigger context window, GPT-6 Sol or Qwen2.5 Coder 32B Instruct?

GPT-6 Sol, with 1.05M tokens against 33K.

How many benchmarks is the GPT-6 Sol vs Qwen2.5 Coder 32B Instruct comparison based on?

25 benchmarks have a result for both models as of October 21, 2026. GPT-6 Sol's coding index rests on 2 independent benchmarks and Qwen2.5 Coder 32B Instruct's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/gpt-6-sol-vs-qwen-2-5-coder-32b-instruct" title="GPT-6 Sol vs Qwen2.5 Coder 32B Instruct, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/gpt-6-sol-vs-qwen-2-5-coder-32b-instruct">LLMBenchmark.ai, GPT-6 Sol vs Qwen2.5 Coder 32B Instruct</a></p>