LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

GPT-6 Astra vs Qwen3.5-Flash

Updated October 21, 2026. 44 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

GPT-6 AstraOpenAI
Coding
88.7
Overall
52.7
Output $/M
$50.00
44
Qwen3.5-FlashQwen
Coding
6.2
Overall
No data
Output $/M
$0.26
0
vs boards won of 44 shared

Decision reading

Pick GPT-6 Astra for coding: it scores 88.7 on the Vibe Coding Index against 6.2 for Qwen3.5-Flash.

Pick Qwen3.5-Flash when output tokens cost 192.3x less.

Shared results
44
GPT-6 Astra only
75
Qwen3.5-Flash only
11
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-6 Astra 88.7 from 2 benchmarks, Qwen3.5-Flash 6.2 from 1 benchmark.
Widest category
Coding, 50.2 points apart on average over 6 shared benchmarks.
Widest single gap
ALE-Bench: GPT-6 Astra 2951.3 against Qwen3.5-Flash 265.9, 89.5 points apart on a 0 to 100 scale.
Output price
GPT-6 Astra $50.00 against Qwen3.5-Flash $0.26 per million output tokens, 192.3x apart.
Context window
GPT-6 Astra takes 1.05M tokens, Qwen3.5-Flash 1M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-6 AstraBarsQwen3.5-FlashTies
Coding60
Intelligence10
Reasoning60
Math40
Knowledge60
General210
All shared boards440
CodingLike-for-likeFour of these boards feed the Vibe Coding Index60
Coding benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
LiveBench coding93.7%Not measuredOnly GPT-6 Astra measured
LMArena WebDev17741244GPT-6 Astra
AA Coding Index76.9Not measuredOnly GPT-6 Astra measured
LiveCodeBench (Vals AI)Not measured83.3%Only Qwen3.5-Flash measured
SWE-bench Verified (Vals AI)Not measured64.4%Only Qwen3.5-Flash measured
Terminal-Bench 4 (Vals AI)59.6%Not measuredOnly GPT-6 Astra measured
Vibe Code Bench (Vals AI)89.6%Not measuredOnly GPT-6 Astra measured
Code migration (Vals AI)67.7%Not measuredOnly GPT-6 Astra measured
ProgramBench (Vals AI)5.5%Not measuredOnly GPT-6 Astra measured
IOI (Vals AI)100.0%Not measuredOnly GPT-6 Astra measured
Terminal-Bench 2.1 (Vals AI)87.3%Not measuredOnly GPT-6 Astra measured
SWE-bench Multimodal (Vals AI)43.3%Not measuredOnly GPT-6 Astra measured
Vibe Code Bench 1-100 (Vals AI)27.6%Not measuredOnly GPT-6 Astra measured
CyberBench (Vals AI)41.1%Not measuredOnly GPT-6 Astra measured
SciCode56.5%Not measuredOnly GPT-6 Astra measured
FrontierCode53.3%Not measuredOnly GPT-6 Astra measured
FrontierSWE65.5%Not measuredOnly GPT-6 Astra measured
GSO-Bench79.4%Not measuredOnly GPT-6 Astra measured
WeirdML93.3%Not measuredOnly GPT-6 Astra measured
MirrorCode46.7%Not measuredOnly GPT-6 Astra measured
ALE-Bench2951.3265.9GPT-6 Astra
LMArena Text: coding14891412GPT-6 Astra
LMArena Text: software and IT14741416GPT-6 Astra
LMArena WebDev: React17981229GPT-6 Astra
LMArena WebDev: HTML17751291GPT-6 Astra
LMArena WebDev: from an image1726Not measuredOnly GPT-6 Astra measured
Neither model has a result on the other 12 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
AA Intelligence Index52.7Not measuredOnly GPT-6 Astra measured
Epoch Capabilities Index168.8143.5GPT-6 Astra
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index27 boards, none shared
Agentic work benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
AA Agentic Index51.0Not measuredOnly GPT-6 Astra measured
Design Arena: agents building web apps1372Not measuredOnly GPT-6 Astra measured
Design Arena: agents building full-stack apps1357Not measuredOnly GPT-6 Astra measured
Design Arena: agents building mobile apps1312Not measuredOnly GPT-6 Astra measured
Design Arena: agents building Godot games1348Not measuredOnly GPT-6 Astra measured
Design Arena: PowerPoint slides1245Not measuredOnly GPT-6 Astra measured
Design Arena: spreadsheets1380Not measuredOnly GPT-6 Astra measured
LiveBench research85.2%Not measuredOnly GPT-6 Astra measured
LiveBench browser84.0%Not measuredOnly GPT-6 Astra measured
LiveBench long agentic82.4%Not measuredOnly GPT-6 Astra measured
SREBench (Vals AI)56.9%Not measuredOnly GPT-6 Astra measured
Finance Agent (Vals AI)53.5%Not measuredOnly GPT-6 Astra measured
Tax Agent Bench (Vals AI)20.7%Not measuredOnly GPT-6 Astra measured
Legal Research Bench (Vals AI)39.4%Not measuredOnly GPT-6 Astra measured
Harvey's Legal Agent Benchmark (Vals AI)7.1%Not measuredOnly GPT-6 Astra measured
Excel Modeling Benchmark (Vals AI)71.7%Not measuredOnly GPT-6 Astra measured
BioMysteryBench (Vals AI)79.3%Not measuredOnly GPT-6 Astra measured
Terminal-Bench-Science (Vals AI)62.9%Not measuredOnly GPT-6 Astra measured
Vals Science Index65.1%Not measuredOnly GPT-6 Astra measured
Time Horizon Index (Vals AI)90.5%Not measuredOnly GPT-6 Astra measured
CUA-bench (Vals AI)19.2%Not measuredOnly GPT-6 Astra measured
Robo-bench (Vals AI)23.3%Not measuredOnly GPT-6 Astra measured
APEX-Agents64.7%Not measuredOnly GPT-6 Astra measured
Remote Labor Index20.8%Not measuredOnly GPT-6 Astra measured
BALROG68.3%Not measuredOnly GPT-6 Astra measured
SpireClimb25.7%Not measuredOnly GPT-6 Astra measured
Vending-Bench 2$15,515Not measuredOnly GPT-6 Astra measured
Neither model has a result on the other 12 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index60
Reasoning benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
GPQA DiamondNot measured82.8%Only Qwen3.5-Flash measured
LiveBench reasoning92.7%Not measuredOnly GPT-6 Astra measured
MysteryMechanism (Vals AI)53.1%Not measuredOnly GPT-6 Astra measured
MMMU Pro (Vals AI)Not measured81.9%Only Qwen3.5-Flash measured
GPQA Diamond (Artificial Analysis run)96.3%Not measuredOnly GPT-6 Astra measured
Humanity's Last Exam (Artificial Analysis run)54.7%Not measuredOnly GPT-6 Astra measured
GPQA Diamond (Epoch AI run)95.8%82.3%GPT-6 Astra
ARC-AGI98.5%Not measuredOnly GPT-6 Astra measured
ARC-AGI-295.0%Not measuredOnly GPT-6 Astra measured
Chess puzzles74.0%14.0%GPT-6 Astra
Mystery game puzzles84.0%20.0%GPT-6 Astra
EBR-bench76.2%Not measuredOnly GPT-6 Astra measured
LMArena Text: hard prompts14631403GPT-6 Astra
LMArena Text: expert14891407GPT-6 Astra
LMArena Text: hard prompts in English14641409GPT-6 Astra
LMArena Vision: diagrams1297Not measuredOnly GPT-6 Astra measured
LMArena Vision: homework1337Not measuredOnly GPT-6 Astra measured
Neither model has a result on the other 4 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index40
Math benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
AIMENot measured92.5%Only Qwen3.5-Flash measured
OTIS Mock AIME100.0%84.4%GPT-6 Astra
FrontierMath, tiers 1 to 393.7%18.2%GPT-6 Astra
FrontierMath, tier 497.6%Not measuredOnly GPT-6 Astra measured
ProofBench99.0%Not measuredOnly GPT-6 Astra measured
LMArena Text: math14651407GPT-6 Astra
LMArena Text: mathematical work14841413GPT-6 Astra
Neither model has a result on the other 6 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index60
Knowledge benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
MMLU ProNot measured84.1%Only Qwen3.5-Flash measured
LegalBench (Vals AI)Not measured84.3%Only Qwen3.5-Flash measured
CaseLaw (Vals AI)Not measured56.0%Only Qwen3.5-Flash measured
CorpFin (Vals AI)Not measured63.6%Only Qwen3.5-Flash measured
TaxEval (Vals AI)Not measured72.2%Only Qwen3.5-Flash measured
MortgageTax (Vals AI)Not measured67.4%Only Qwen3.5-Flash measured
MedCode (Vals AI)48.5%33.0%GPT-6 Astra
SimpleQA Verified75.6%20.3%GPT-6 Astra
LMArena Text: science14511415GPT-6 Astra
LMArena Text: medicine and healthcare14251407GPT-6 Astra
LMArena Text: legal and government14621398GPT-6 Astra
LMArena Text: business and finance14391394GPT-6 Astra
Neither model has a result on the other 5 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
Design Arena: websites1337Not measuredOnly GPT-6 Astra measured
Design Arena: UI components1394Not measuredOnly GPT-6 Astra measured
Design Arena: game dev1474Not measuredOnly GPT-6 Astra measured
Design Arena: data viz1335Not measuredOnly GPT-6 Astra measured
Design Arena: 3D1501Not measuredOnly GPT-6 Astra measured
Design Arena: all code categories1379Not measuredOnly GPT-6 Astra measured
Design Arena: SVG1431Not measuredOnly GPT-6 Astra measured
Design Arena: ASCII art1359Not measuredOnly GPT-6 Astra measured
LiveBench design82.0%Not measuredOnly GPT-6 Astra measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index210
General benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
Vals Index65.0%Not measuredOnly GPT-6 Astra measured
LiveBench data analysis83.0%Not measuredOnly GPT-6 Astra measured
SAGE (Vals AI)46.4%42.5%GPT-6 Astra
MedScribe (Vals AI)87.9%70.6%GPT-6 Astra
Long context reasoning (AA-LCR)80.7%Not measuredOnly GPT-6 Astra measured
DTBench97.3%82.9%GPT-6 Astra
LMCA64.4%29.1%GPT-6 Astra
Furniture assembly80.0%Not measuredOnly GPT-6 Astra measured
LMArena Text14411397GPT-6 Astra
LMArena Text: instruction following14551374GPT-6 Astra
LMArena Text: creative writing14201343GPT-6 Astra
LMArena Vision1280Not measuredOnly GPT-6 Astra measured
LMArena Text: English14471404GPT-6 Astra
LMArena Text: non-English14321385GPT-6 Astra
LMArena Text: Chinese14891445GPT-6 Astra
LMArena Text: German14591390GPT-6 Astra
LMArena Text: Japanese14051369GPT-6 Astra
LMArena Text: Korean14281344GPT-6 Astra
LMArena Text: French14321413GPT-6 Astra
LMArena Text: Spanish14221400GPT-6 Astra
LMArena Text: Russian14381380GPT-6 Astra
LMArena Text: Polish14221376GPT-6 Astra
LMArena Text: multi-turn14471393GPT-6 Astra
LMArena Text: longer queries14601392GPT-6 Astra
LMArena Text: writing and language14371369GPT-6 Astra
LMArena Text: entertainment and media14271347GPT-6 Astra
LMArena Vision: English1280Not measuredOnly GPT-6 Astra measured
LMArena Vision: Chinese1361Not measuredOnly GPT-6 Astra measured
LMArena Vision: reading text1292Not measuredOnly GPT-6 Astra measured
LMArena Vision: creative writing1286Not measuredOnly GPT-6 Astra measured
Neither model has a result on the other 16 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-6 Astra and Qwen3.5-Flash
BenchmarkGPT-6 AstraQwen3.5-FlashLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-6 Astra$0.035Fits in one request
Qwen3.5-Flash$0.0002Fits in one request

Qwen3.5-Flash costs less

Repository review

50K input + 3K output tokens

GPT-6 Astra$0.650Fits in one request
Qwen3.5-Flash$0.0040Fits in one request

Qwen3.5-Flash costs less

Agent loop

200K input + 10K output tokens

GPT-6 Astra$2.50Fits in one request
Qwen3.5-Flash$0.016Fits in one request

Qwen3.5-Flash costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-6 Astra and Qwen3.5-Flash
SpecificationOpenAI GPT-6 AstraQwen3.5-Flash
MakerOpenAIQwen
WeightsNo public weights listedNo public weights listed
ReleasedSeptember 4, 2026February 25, 2026
Context window1.05M1M
Input $/Mtok$10.00$0.065
Output $/Mtok$50.00$0.26
Coding index88.76.2
Independent measurements behind it21
Cost per solved taskNot computable$0.40
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-6 Astra better than Qwen3.5-Flash for coding?

Pick GPT-6 Astra for coding: it scores 88.7 on the Vibe Coding Index against 6.2 for Qwen3.5-Flash. Pick Qwen3.5-Flash when output tokens cost 192.3x less.

Which is cheaper, GPT-6 Astra or Qwen3.5-Flash?

GPT-6 Astra costs $10.00 per million input tokens and $50.00 per million output tokens; Qwen3.5-Flash costs $0.065 and $0.26. Cost per solved task is known for Qwen3.5-Flash only.

Which has the bigger context window, GPT-6 Astra or Qwen3.5-Flash?

GPT-6 Astra, with 1.05M tokens against 1M.

How many benchmarks is the GPT-6 Astra vs Qwen3.5-Flash comparison based on?

44 benchmarks have a result for both models as of October 21, 2026. GPT-6 Astra's coding index rests on 2 independent benchmarks and Qwen3.5-Flash's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next