LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

o3 vs Qwen3.5-35B-A3B

Updated October 21, 2026. 41 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

o3OpenAI
Coding
70.7
Overall
20.2
Output $/M
$8.00
29
Qwen3.5-35B-A3BQwen
Coding
7.7
Overall
19.3
Output $/M
$1.00
12
vs boards won of 41 shared

Decision reading

Pick o3 for coding: it scores 70.7 on the Vibe Coding Index against 7.7 for Qwen3.5-35B-A3B.

Pick Qwen3.5-35B-A3B when output tokens cost 8.0x less, or when the context window is larger, 262K against 200K tokens.

Shared results
41
o3 only
56
Qwen3.5-35B-A3B only
4
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
o3 70.7 from 2 benchmarks, Qwen3.5-35B-A3B 7.7 from 1 benchmark.
Widest category
Coding, 8.7 points apart on average over 4 shared benchmarks.
Widest single gap
ALE-Bench: o3 933.5 against Qwen3.5-35B-A3B 221.8, 23.7 points apart on a 0 to 100 scale.
Output price
o3 $8.00 against Qwen3.5-35B-A3B $1.00 per million output tokens, 8.0x apart.
Context window
o3 takes 200K tokens, Qwen3.5-35B-A3B 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Categoryo3BarsQwen3.5-35B-A3BTies
Coding22
Intelligence20
Agentic work01
Reasoning24
Math30
Knowledge31
General174
All shared boards2912
CodingLike-for-likeFour of these boards feed the Vibe Coding Index22
Coding benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
Aider polyglot81.3%Not measuredOnly o3 measured
SWE-bench Verified58.4%Not measuredOnly o3 measured
SWE-bench Multimodal36.0%Not measuredOnly o3 measured
LMArena WebDevNot measured1254Only Qwen3.5-35B-A3B measured
LiveCodeBench (Vals AI)83.9%Not measuredOnly o3 measured
LiveCodeBench (Artificial Analysis run)80.8%Not measuredOnly o3 measured
Terminal-Bench Hard (Artificial Analysis run)37.1%26.5%o3
GSO-Bench8.8%Not measuredOnly o3 measured
WeirdML52.4%Not measuredOnly o3 measured
ALE-Bench933.5221.8o3
LMArena Text: coding14071410Qwen3.5-35B-A3B
LMArena Text: software and IT14151415Qwen3.5-35B-A3B
LMArena WebDev: ReactNot measured1238Only Qwen3.5-35B-A3B measured
LMArena WebDev: HTMLNot measured1301Only Qwen3.5-35B-A3B measured
Neither model has a result on the other 24 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
AA Intelligence Index20.219.3o3
Epoch Capabilities Index146.7142.5o3
Agentic workLike-for-likePublic boards, shown as published, kept out of the index01
Agentic work benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
τ²-Bench Telecom80.7%89.2%Qwen3.5-35B-A3B
METR time horizons65.4%Not measuredOnly o3 measured
GDPval30.8%Not measuredOnly o3 measured
DeepResearch Bench45.2%Not measuredOnly o3 measured
OSWorld23.0%Not measuredOnly o3 measured
Vending-Bench 2Not measured$463Only Qwen3.5-35B-A3B measured
Neither model has a result on the other 33 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index24
Reasoning benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
GPQA Diamond84.1%Not measuredOnly o3 measured
MMMU Pro (Vals AI)80.4%Not measuredOnly o3 measured
GPQA Diamond (Artificial Analysis run)82.7%84.5%Qwen3.5-35B-A3B
Humanity's Last Exam (Artificial Analysis run)20.1%21.0%Qwen3.5-35B-A3B
GPQA Diamond (Epoch AI run)81.8%83.5%Qwen3.5-35B-A3B
ARC-AGI60.8%Not measuredOnly o3 measured
ARC-AGI-26.5%Not measuredOnly o3 measured
SimpleBench53.1%Not measuredOnly o3 measured
Chess puzzles37.0%Not measuredOnly o3 measured
Mystery game puzzles29.0%Not measuredOnly o3 measured
VPCT52.0%Not measuredOnly o3 measured
LMArena Text: hard prompts14021400o3
LMArena Text: expert14021408Qwen3.5-35B-A3B
LMArena Text: hard prompts in English14111411o3
LMArena Vision: diagrams1220Not measuredOnly o3 measured
LMArena Vision: homework1234Not measuredOnly o3 measured
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
AIME85.3%Not measuredOnly o3 measured
MATH 500 (Vals AI)94.6%Not measuredOnly o3 measured
MGSM (Vals AI)91.8%Not measuredOnly o3 measured
AA Math Index88.3Not measuredOnly o3 measured
AIME 2025 (Artificial Analysis run)88.3%Not measuredOnly o3 measured
OTIS Mock AIME84.4%70.0%o3
FrontierMath, tiers 1 to 333.3%Not measuredOnly o3 measured
MATH level 597.8%Not measuredOnly o3 measured
LMArena Text: math14261404o3
LMArena Text: mathematical work14231410o3
Neither model has a result on the other 3 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index31
Knowledge benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
MMLU Pro85.6%Not measuredOnly o3 measured
LegalBench (Vals AI)83.8%Not measuredOnly o3 measured
CorpFin (Vals AI)59.7%Not measuredOnly o3 measured
TaxEval (Vals AI)74.6%Not measuredOnly o3 measured
MortgageTax (Vals AI)65.7%Not measuredOnly o3 measured
MedQA (Vals AI)96.1%Not measuredOnly o3 measured
MedCode (Vals AI)47.3%Not measuredOnly o3 measured
MMLU Pro (Artificial Analysis run)85.3%Not measuredOnly o3 measured
SimpleQA Verified49.4%Not measuredOnly o3 measured
GeoBench74.0%Not measuredOnly o3 measured
LMArena Text: science14291413o3
LMArena Text: medicine and healthcare14481421o3
LMArena Text: legal and government14281399o3
LMArena Text: business and finance13931394Qwen3.5-35B-A3B
Neither model has a result on the other 3 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index5 boards, none shared
Web design benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
Design Arena: websites1036Not measuredOnly o3 measured
Design Arena: UI components1016Not measuredOnly o3 measured
Design Arena: game dev1034Not measuredOnly o3 measured
Design Arena: data viz1200Not measuredOnly o3 measured
Design Arena: all code categories1021Not measuredOnly o3 measured
Neither model has a result on the other 4 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index174
General benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
SAGE (Vals AI)41.8%Not measuredOnly o3 measured
MedScribe (Vals AI)76.7%Not measuredOnly o3 measured
IFBench71.4%72.5%Qwen3.5-35B-A3B
Long context reasoning (AA-LCR)74.7%72.0%o3
DTBench84.8%80.0%o3
LMCA39.7%29.5%o3
Fiction.LiveBench88.9%Not measuredOnly o3 measured
Creative writing (Lech Mazur)83.9%Not measuredOnly o3 measured
CL-bench17.8%Not measuredOnly o3 measured
LMArena Text14101395o3
LMArena Text: instruction following13681379Qwen3.5-35B-A3B
LMArena Text: creative writing13591347o3
LMArena Vision1214Not measuredOnly o3 measured
LMArena Text: English14171407o3
LMArena Text: non-English14011378o3
LMArena Text: Chinese14371457Qwen3.5-35B-A3B
LMArena Text: German14201367o3
LMArena Text: Japanese14031326o3
LMArena Text: Korean13701355o3
LMArena Text: French14301412o3
LMArena Text: Spanish13951390o3
LMArena Text: Russian14061376o3
LMArena Text: Polish14381385o3
LMArena Text: multi-turn14051390o3
LMArena Text: longer queries13721389Qwen3.5-35B-A3B
LMArena Text: writing and language13721365o3
LMArena Text: entertainment and media13731347o3
LMArena Vision: English1221Not measuredOnly o3 measured
LMArena Vision: Chinese1237Not measuredOnly o3 measured
LMArena Vision: reading text1218Not measuredOnly o3 measured
LMArena Vision: humor1222Not measuredOnly o3 measured
LMArena Vision: captioning1210Not measuredOnly o3 measured
LMArena Vision: recognizing things1234Not measuredOnly o3 measured
LMArena Vision: creative writing1201Not measuredOnly o3 measured
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for o3 and Qwen3.5-35B-A3B
Benchmarko3Qwen3.5-35B-A3BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

o3$0.0060Fits in one request
Qwen3.5-35B-A3B$0.0006Fits in one request

Qwen3.5-35B-A3B costs less

Repository review

50K input + 3K output tokens

o3$0.124Fits in one request
Qwen3.5-35B-A3B$0.010Fits in one request

Qwen3.5-35B-A3B costs less

Agent loop

200K input + 10K output tokens

o3$0.480Exceeds the context window
Qwen3.5-35B-A3B$0.038Fits in one request

Qwen3.5-35B-A3B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of o3 and Qwen3.5-35B-A3B
SpecificationOpenAI o3Qwen3.5-35B-A3B
MakerOpenAIQwen
WeightsNo public weights listedOpen weights
ReleasedApril 16, 2025February 25, 2026
Context window200K262K
Input $/Mtok$2.00$0.14
Output $/Mtok$8.00$1.00
Coding index70.77.7
Independent measurements behind it21
Cost per solved task$0.571Not computable
SourceOpenRouter listingOpenRouter listing

Questions

Is o3 better than Qwen3.5-35B-A3B for coding?

Pick o3 for coding: it scores 70.7 on the Vibe Coding Index against 7.7 for Qwen3.5-35B-A3B. Pick Qwen3.5-35B-A3B when output tokens cost 8.0x less, or when the context window is larger, 262K against 200K tokens.

Which is cheaper, o3 or Qwen3.5-35B-A3B?

o3 costs $2.00 per million input tokens and $8.00 per million output tokens; Qwen3.5-35B-A3B costs $0.14 and $1.00. Cost per solved task is known for o3 only.

Which has the bigger context window, o3 or Qwen3.5-35B-A3B?

Qwen3.5-35B-A3B, with 262K tokens against 200K.

How many benchmarks is the o3 vs Qwen3.5-35B-A3B comparison based on?

41 benchmarks have a result for both models as of October 21, 2026. o3's coding index rests on 2 independent benchmarks and Qwen3.5-35B-A3B's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next