LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Sonnet 4.6 vs GPT-5 Nano

Updated October 21, 2026. 71 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Sonnet 4.6Anthropic
Coding
57.8
Overall
30.1
Output $/M
$15.00
69
GPT-5 NanoOpenAI
Coding
34.8
Overall
13.0
Output $/M
$0.40
2
vs boards won of 71 shared

Decision reading

Pick Claude Sonnet 4.6 for coding: it scores 57.8 on the Vibe Coding Index against 34.8 for GPT-5 Nano.

Pick GPT-5 Nano when output tokens cost 37.5x less, or when a solved task costs $0.109 against $1.68.

Shared results
71
Claude Sonnet 4.6 only
46
GPT-5 Nano only
14
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Sonnet 4.6 57.8 from 2 benchmarks, GPT-5 Nano 34.8 from 1 benchmark.
Widest category
Agentic work, 43.0 points apart on average over 1 shared benchmark.
Widest single gap
ARC-AGI: Claude Sonnet 4.6 86.5% against GPT-5 Nano 20.7%, 65.8 points apart on a 0 to 100 scale.
Output price
Claude Sonnet 4.6 $15.00 against GPT-5 Nano $0.40 per million output tokens, 37.5x apart.
Context window
Claude Sonnet 4.6 takes 1M tokens, GPT-5 Nano 400K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Sonnet 4.6BarsGPT-5 NanoTies
Coding60
Intelligence20
Agentic work10
Reasoning140
Math50
Knowledge101
Web design60
General251
All shared boards692
CodingLike-for-likeFour of these boards feed the Vibe Coding Index60
Coding benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
SWE-bench VerifiedNot measured34.8%Only GPT-5 Nano measured
LiveBench coding66.6%Not measuredOnly Claude Sonnet 4.6 measured
LMArena WebDev1523Not measuredOnly Claude Sonnet 4.6 measured
AA Coding Index63.0Not measuredOnly Claude Sonnet 4.6 measured
LiveCodeBench (Vals AI)82.1%70.2%Claude Sonnet 4.6
SWE-bench Verified (Vals AI)77.4%Not measuredOnly Claude Sonnet 4.6 measured
Vibe Code Bench (Vals AI)55.8%Not measuredOnly Claude Sonnet 4.6 measured
Code migration (Vals AI)39.9%Not measuredOnly Claude Sonnet 4.6 measured
ProgramBench (Vals AI)0.5%Not measuredOnly Claude Sonnet 4.6 measured
Terminal-Bench 2.1 (Vals AI)57.3%Not measuredOnly Claude Sonnet 4.6 measured
SkillsBench (Vals AI)49.0%Not measuredOnly Claude Sonnet 4.6 measured
LiveCodeBench (Artificial Analysis run)Not measured78.9%Only GPT-5 Nano measured
SciCode50.1%Not measuredOnly Claude Sonnet 4.6 measured
Terminal-Bench Hard (Artificial Analysis run)53.0%17.4%Claude Sonnet 4.6
Terminal-Bench53.4%21.8%Claude Sonnet 4.6
FrontierCode24.3%Not measuredOnly Claude Sonnet 4.6 measured
WeirdML66.1%38.1%Claude Sonnet 4.6
LMArena Text: coding15031351Claude Sonnet 4.6
LMArena Text: software and IT14911345Claude Sonnet 4.6
LMArena WebDev: React1512Not measuredOnly Claude Sonnet 4.6 measured
LMArena WebDev: HTML1527Not measuredOnly Claude Sonnet 4.6 measured
LMArena WebDev: from an image1529Not measuredOnly Claude Sonnet 4.6 measured
Neither model has a result on the other 16 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
AA Intelligence Index30.113.0Claude Sonnet 4.6
Epoch Capabilities Index152.8139.2Claude Sonnet 4.6
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
AA Agentic Index31.8Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building web apps1190Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building full-stack apps1213Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building mobile apps1212Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building Android apps1202Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building Godot games1226Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: agents building games1177Not measuredOnly Claude Sonnet 4.6 measured
LiveBench research63.6%Not measuredOnly Claude Sonnet 4.6 measured
LiveBench browser68.0%Not measuredOnly Claude Sonnet 4.6 measured
LiveBench long agentic23.1%Not measuredOnly Claude Sonnet 4.6 measured
Finance Agent (Vals AI)51.0%Not measuredOnly Claude Sonnet 4.6 measured
Tax Agent Bench (Vals AI)25.8%Not measuredOnly Claude Sonnet 4.6 measured
Legal Research Bench (Vals AI)38.5%Not measuredOnly Claude Sonnet 4.6 measured
Excel Modeling Benchmark (Vals AI)60.2%Not measuredOnly Claude Sonnet 4.6 measured
τ²-Bench Telecom79.5%36.5%Claude Sonnet 4.6
APEX-Agents43.0%Not measuredOnly Claude Sonnet 4.6 measured
OSWorld 2.09.3%Not measuredOnly Claude Sonnet 4.6 measured
DeepResearch Bench54.9%Not measuredOnly Claude Sonnet 4.6 measured
OSWorld72.1%Not measuredOnly Claude Sonnet 4.6 measured
Vending-Bench 2$7,204Not measuredOnly Claude Sonnet 4.6 measured
Neither model has a result on the other 19 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index140
Reasoning benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
GPQA Diamond85.6%63.4%Claude Sonnet 4.6
LiveBench reasoning86.4%Not measuredOnly Claude Sonnet 4.6 measured
MMMU Pro (Vals AI)83.6%70.9%Claude Sonnet 4.6
GPQA Diamond (Artificial Analysis run)87.5%67.6%Claude Sonnet 4.6
Humanity's Last Exam (Artificial Analysis run)33.6%9.5%Claude Sonnet 4.6
GPQA Diamond (Epoch AI run)87.4%69.4%Claude Sonnet 4.6
ARC-AGI86.5%20.7%Claude Sonnet 4.6
ARC-AGI-260.4%2.6%Claude Sonnet 4.6
Chess puzzles23.0%22.0%Claude Sonnet 4.6
Mystery game puzzles16.0%9.0%Claude Sonnet 4.6
VPCTNot measured37.2%Only GPT-5 Nano measured
LMArena Text: hard prompts14851328Claude Sonnet 4.6
LMArena Text: expert15001321Claude Sonnet 4.6
LMArena Text: hard prompts in English14931338Claude Sonnet 4.6
LMArena Vision: diagrams13061141Claude Sonnet 4.6
LMArena Vision: homework13111157Claude Sonnet 4.6
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index50
Math benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
AIME92.3%81.2%Claude Sonnet 4.6
MATH 500 (Vals AI)Not measured93.8%Only GPT-5 Nano measured
MGSM (Vals AI)Not measured89.3%Only GPT-5 Nano measured
AA Math IndexNot measured83.7Only GPT-5 Nano measured
AIME 2025 (Artificial Analysis run)Not measured83.7%Only GPT-5 Nano measured
OTIS Mock AIME85.8%81.1%Claude Sonnet 4.6
FrontierMath, tiers 1 to 3Not measured20.0%Only GPT-5 Nano measured
FrontierMath, tier 4Not measured2.4%Only GPT-5 Nano measured
ProofBench45.0%12.0%Claude Sonnet 4.6
MATH level 5Not measured95.2%Only GPT-5 Nano measured
LMArena Text: math14621317Claude Sonnet 4.6
LMArena Text: mathematical work14831326Claude Sonnet 4.6
Neither model has a result on the other 1 board here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index101
Knowledge benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
MMLU Pro87.3%76.1%Claude Sonnet 4.6
LegalBench (Vals AI)82.1%50.1%Claude Sonnet 4.6
CaseLaw (Vals AI)64.0%52.6%Claude Sonnet 4.6
CorpFin (Vals AI)65.3%Not measuredOnly Claude Sonnet 4.6 measured
TaxEval (Vals AI)77.1%67.4%Claude Sonnet 4.6
MortgageTax (Vals AI)67.7%53.6%Claude Sonnet 4.6
MedQA (Vals AI)92.1%93.3%GPT-5 Nano
MedCode (Vals AI)Not measured30.4%Only GPT-5 Nano measured
MMLU Pro (Artificial Analysis run)Not measured78.0%Only GPT-5 Nano measured
SimpleQA Verified35.5%11.7%Claude Sonnet 4.6
LMArena Text: science14741318Claude Sonnet 4.6
LMArena Text: medicine and healthcare14511335Claude Sonnet 4.6
LMArena Text: legal and government14701298Claude Sonnet 4.6
LMArena Text: business and finance14641311Claude Sonnet 4.6
Neither model has a result on the other 3 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index60
Web design benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
Design Arena: websites12851101Claude Sonnet 4.6
Design Arena: UI components12711066Claude Sonnet 4.6
Design Arena: game dev12591045Claude Sonnet 4.6
Design Arena: data viz12781056Claude Sonnet 4.6
Design Arena: 3D1234966Claude Sonnet 4.6
Design Arena: all code categories12761084Claude Sonnet 4.6
Design Arena: SVG1196Not measuredOnly Claude Sonnet 4.6 measured
Design Arena: ASCII art1235Not measuredOnly Claude Sonnet 4.6 measured
LiveBench design71.8%Not measuredOnly Claude Sonnet 4.6 measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index251
General benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
LiveBench data analysis76.1%Not measuredOnly Claude Sonnet 4.6 measured
Public Benefits Bench (Vals AI)62.5%Not measuredOnly Claude Sonnet 4.6 measured
SAGE (Vals AI)46.6%30.4%Claude Sonnet 4.6
MedScribe (Vals AI)Not measured72.9%Only GPT-5 Nano measured
Vals Multimodal Index60.6%Not measuredOnly Claude Sonnet 4.6 measured
IFBench56.6%67.6%GPT-5 Nano
Long context reasoning (AA-LCR)80.0%45.0%Claude Sonnet 4.6
DTBench89.9%62.7%Claude Sonnet 4.6
LMCA46.5%7.9%Claude Sonnet 4.6
Fiction.LiveBenchNot measured44.4%Only GPT-5 Nano measured
ExploitBench23.6%Not measuredOnly Claude Sonnet 4.6 measured
LMArena Text14581320Claude Sonnet 4.6
LMArena Text: instruction following14761306Claude Sonnet 4.6
LMArena Text: creative writing14351249Claude Sonnet 4.6
LMArena Vision12831159Claude Sonnet 4.6
LMArena Text: English14721321Claude Sonnet 4.6
LMArena Text: non-English14401313Claude Sonnet 4.6
LMArena Text: Chinese14911356Claude Sonnet 4.6
LMArena Text: German14281327Claude Sonnet 4.6
LMArena Text: Japanese14201227Claude Sonnet 4.6
LMArena Text: Korean14101269Claude Sonnet 4.6
LMArena Text: French1465Not measuredOnly Claude Sonnet 4.6 measured
LMArena Text: Spanish14641360Claude Sonnet 4.6
LMArena Text: Russian14401296Claude Sonnet 4.6
LMArena Text: Polish14431314Claude Sonnet 4.6
LMArena Text: multi-turn14641311Claude Sonnet 4.6
LMArena Text: longer queries14791312Claude Sonnet 4.6
LMArena Text: writing and language14441283Claude Sonnet 4.6
LMArena Text: entertainment and media14311268Claude Sonnet 4.6
LMArena Vision: English12981170Claude Sonnet 4.6
LMArena Vision: Chinese13071176Claude Sonnet 4.6
LMArena Vision: reading text12961152Claude Sonnet 4.6
LMArena Vision: humor12481110Claude Sonnet 4.6
LMArena Vision: recognizing things1195Not measuredOnly Claude Sonnet 4.6 measured
LMArena Vision: creative writing1272Not measuredOnly Claude Sonnet 4.6 measured
LMArena Document1482Not measuredOnly Claude Sonnet 4.6 measured
Neither model has a result on the other 10 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Sonnet 4.6 and GPT-5 Nano
BenchmarkClaude Sonnet 4.6GPT-5 NanoLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Sonnet 4.6$0.011Fits in one request
GPT-5 Nano$0.0003Fits in one request

GPT-5 Nano costs less

Repository review

50K input + 3K output tokens

Claude Sonnet 4.6$0.195Fits in one request
GPT-5 Nano$0.0037Fits in one request

GPT-5 Nano costs less

Agent loop

200K input + 10K output tokens

Claude Sonnet 4.6$0.750Fits in one request
GPT-5 Nano$0.014Fits in one request

GPT-5 Nano costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Sonnet 4.6 and GPT-5 Nano
SpecificationAnthropic Claude Sonnet 4.6OpenAI GPT-5 Nano
MakerAnthropicOpenAI
WeightsNo public weights listedNo public weights listed
ReleasedFebruary 17, 2026August 7, 2025
Context window1M400K
Input $/Mtok$3.00$0.05
Output $/Mtok$15.00$0.40
Coding index57.834.8
Independent measurements behind it21
Cost per solved task$1.68$0.109
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Sonnet 4.6 better than GPT-5 Nano for coding?

Pick Claude Sonnet 4.6 for coding: it scores 57.8 on the Vibe Coding Index against 34.8 for GPT-5 Nano. Pick GPT-5 Nano when output tokens cost 37.5x less, or when a solved task costs $0.109 against $1.68.

Which is cheaper, Claude Sonnet 4.6 or GPT-5 Nano?

Claude Sonnet 4.6 costs $3.00 per million input tokens and $15.00 per million output tokens; GPT-5 Nano costs $0.05 and $0.40. Per solved SWE-bench Verified task, Claude Sonnet 4.6 costs $1.68 and GPT-5 Nano $0.109.

Which has the bigger context window, Claude Sonnet 4.6 or GPT-5 Nano?

Claude Sonnet 4.6, with 1M tokens against 400K.

How many benchmarks is the Claude Sonnet 4.6 vs GPT-5 Nano comparison based on?

71 benchmarks have a result for both models as of October 21, 2026. Claude Sonnet 4.6's coding index rests on 2 independent benchmarks and GPT-5 Nano's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next