LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Sonnet 5 vs GPT-4o (2024-11-20)

Updated October 21, 2026. 13 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Sonnet 5Anthropic
Coding
63.5
Overall
38.2
Output $/M
$10.00
13
GPT-4o (2024-11-20)OpenAI
Coding
18.2
Overall
8.4
Output $/M
$10.00
0
vs boards won of 13 shared

Decision reading

Pick Claude Sonnet 5 for coding: it scores 63.5 on the Vibe Coding Index against 18.2 for GPT-4o (2024-11-20).

GPT-4o (2024-11-20) is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Shared results
13
Claude Sonnet 5 only
107
GPT-4o (2024-11-20) only
11
Like-for-like categories
5 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Sonnet 5 63.5 from 2 benchmarks, GPT-4o (2024-11-20) 18.2 from 1 benchmark.
Widest category
Math, 88.5 points apart on average over 1 shared benchmark.
Widest single gap
OTIS Mock AIME: Claude Sonnet 5 94.7% against GPT-4o (2024-11-20) 6.3%, 88.5 points apart on a 0 to 100 scale.
Output price
Both cost $10.00 per million output tokens.
Context window
Claude Sonnet 5 takes 1M tokens, GPT-4o (2024-11-20) 128K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Sonnet 5BarsGPT-4o (2024-11-20)Ties
Coding30
Intelligence10
Reasoning30
Math10
Knowledge50
All shared boards130
CodingLike-for-likeFour of these boards feed the Vibe Coding Index30
Coding benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
Aider polyglotNot measured18.2%Only GPT-4o (2024-11-20) measured
LiveBench coding74.7%Not measuredOnly Claude Sonnet 5 measured
LMArena WebDev1540Not measuredOnly Claude Sonnet 5 measured
AA Coding Index71.5Not measuredOnly Claude Sonnet 5 measured
LiveCodeBench (Vals AI)82.4%43.4%Claude Sonnet 5
SWE-bench Verified (Vals AI)79.6%Not measuredOnly Claude Sonnet 5 measured
Terminal-Bench 4 (Vals AI)10.6%Not measuredOnly Claude Sonnet 5 measured
Vibe Code Bench (Vals AI)81.3%Not measuredOnly Claude Sonnet 5 measured
Code migration (Vals AI)44.4%Not measuredOnly Claude Sonnet 5 measured
ProgramBench (Vals AI)0.0%Not measuredOnly Claude Sonnet 5 measured
IOI (Vals AI)45.0%Not measuredOnly Claude Sonnet 5 measured
Terminal-Bench 2.1 (Vals AI)74.5%Not measuredOnly Claude Sonnet 5 measured
Vibe Code Bench 1-100 (Vals AI)13.8%Not measuredOnly Claude Sonnet 5 measured
SkillsBench (Vals AI)46.5%Not measuredOnly Claude Sonnet 5 measured
CyberBench (Vals AI)70.3%Not measuredOnly Claude Sonnet 5 measured
SciCode54.3%Not measuredOnly Claude Sonnet 5 measured
FrontierCode42.7%Not measuredOnly Claude Sonnet 5 measured
GSO-Bench37.3%0.0%Claude Sonnet 5
WeirdML68.8%25.1%Claude Sonnet 5
CybenchNot measured12.5%Only GPT-4o (2024-11-20) measured
ALE-Bench1463.1Not measuredOnly Claude Sonnet 5 measured
LMArena Text: coding1483Not measuredOnly Claude Sonnet 5 measured
LMArena Text: software and IT1474Not measuredOnly Claude Sonnet 5 measured
LMArena WebDev: React1541Not measuredOnly Claude Sonnet 5 measured
LMArena WebDev: HTML1527Not measuredOnly Claude Sonnet 5 measured
LMArena WebDev: from an image1540Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 12 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
AA Intelligence Index38.28.4Claude Sonnet 5
Epoch Capabilities Index156.9Not measuredOnly Claude Sonnet 5 measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index22 boards, none shared
Agentic work benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
AA Agentic Index43.6Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building web apps1245Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building full-stack apps1249Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building mobile apps1215Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building Android apps1231Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building Godot games1225Not measuredOnly Claude Sonnet 5 measured
Design Arena: agents building games1227Not measuredOnly Claude Sonnet 5 measured
Design Arena: HTML slides1218Not measuredOnly Claude Sonnet 5 measured
Design Arena: PowerPoint slides1216Not measuredOnly Claude Sonnet 5 measured
Design Arena: spreadsheets1004Not measuredOnly Claude Sonnet 5 measured
LiveBench research82.8%Not measuredOnly Claude Sonnet 5 measured
LiveBench browser72.0%Not measuredOnly Claude Sonnet 5 measured
LiveBench long agentic39.0%Not measuredOnly Claude Sonnet 5 measured
SREBench (Vals AI)0.4%Not measuredOnly Claude Sonnet 5 measured
Finance Agent (Vals AI)53.9%Not measuredOnly Claude Sonnet 5 measured
Tax Agent Bench (Vals AI)29.4%Not measuredOnly Claude Sonnet 5 measured
Legal Research Bench (Vals AI)41.8%Not measuredOnly Claude Sonnet 5 measured
Excel Modeling Benchmark (Vals AI)66.3%Not measuredOnly Claude Sonnet 5 measured
Terminal-Bench-Science (Vals AI)5.7%Not measuredOnly Claude Sonnet 5 measured
APEX-Agents54.5%Not measuredOnly Claude Sonnet 5 measured
TheAgentCompanyNot measured8.6%Only GPT-4o (2024-11-20) measured
Vending-Bench 2$6,378Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 17 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index30
Reasoning benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
GPQA Diamond88.9%53.8%Claude Sonnet 5
LiveBench reasoning88.7%Not measuredOnly Claude Sonnet 5 measured
MMMU Pro (Vals AI)83.0%62.2%Claude Sonnet 5
GPQA Diamond (Artificial Analysis run)91.1%Not measuredOnly Claude Sonnet 5 measured
Humanity's Last Exam (Artificial Analysis run)41.3%Not measuredOnly Claude Sonnet 5 measured
GPQA Diamond (Epoch AI run)90.5%47.9%Claude Sonnet 5
SimpleBench60.6%Not measuredOnly Claude Sonnet 5 measured
Chess puzzles45.0%Not measuredOnly Claude Sonnet 5 measured
Mystery game puzzles35.0%Not measuredOnly Claude Sonnet 5 measured
VPCTNot measured40.0%Only GPT-4o (2024-11-20) measured
LMArena Text: hard prompts1461Not measuredOnly Claude Sonnet 5 measured
LMArena Text: expert1489Not measuredOnly Claude Sonnet 5 measured
LMArena Text: hard prompts in English1464Not measuredOnly Claude Sonnet 5 measured
LMArena Vision: diagrams1293Not measuredOnly Claude Sonnet 5 measured
LMArena Vision: homework1311Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index10
Math benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
AIMENot measured11.9%Only GPT-4o (2024-11-20) measured
MATH 500 (Vals AI)Not measured74.0%Only GPT-4o (2024-11-20) measured
MGSM (Vals AI)Not measured90.4%Only GPT-4o (2024-11-20) measured
OTIS Mock AIME94.7%6.3%Claude Sonnet 5
FrontierMath, tiers 1 to 365.6%Not measuredOnly Claude Sonnet 5 measured
FrontierMath, tier 429.3%Not measuredOnly Claude Sonnet 5 measured
ProofBench77.0%Not measuredOnly Claude Sonnet 5 measured
MATH level 5Not measured49.8%Only GPT-4o (2024-11-20) measured
LMArena Text: math1467Not measuredOnly Claude Sonnet 5 measured
LMArena Text: mathematical work1481Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 3 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index50
Knowledge benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
MMLU Pro87.5%72.6%Claude Sonnet 5
LegalBench (Vals AI)83.9%82.2%Claude Sonnet 5
CaseLaw (Vals AI)Not measured59.7%Only GPT-4o (2024-11-20) measured
CorpFin (Vals AI)67.0%45.9%Claude Sonnet 5
TaxEval (Vals AI)75.6%74.5%Claude Sonnet 5
MortgageTax (Vals AI)70.0%57.4%Claude Sonnet 5
MedCode (Vals AI)47.5%Not measuredOnly Claude Sonnet 5 measured
SimpleQA Verified33.7%Not measuredOnly Claude Sonnet 5 measured
GeoBenchNot measured71.0%Only GPT-4o (2024-11-20) measured
LMArena Text: science1460Not measuredOnly Claude Sonnet 5 measured
LMArena Text: medicine and healthcare1442Not measuredOnly Claude Sonnet 5 measured
LMArena Text: legal and government1454Not measuredOnly Claude Sonnet 5 measured
LMArena Text: business and finance1436Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 4 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
Design Arena: websites1274Not measuredOnly Claude Sonnet 5 measured
Design Arena: UI components1279Not measuredOnly Claude Sonnet 5 measured
Design Arena: game dev1278Not measuredOnly Claude Sonnet 5 measured
Design Arena: data viz1251Not measuredOnly Claude Sonnet 5 measured
Design Arena: 3D1261Not measuredOnly Claude Sonnet 5 measured
Design Arena: all code categories1276Not measuredOnly Claude Sonnet 5 measured
Design Arena: SVG1193Not measuredOnly Claude Sonnet 5 measured
Design Arena: ASCII art1207Not measuredOnly Claude Sonnet 5 measured
LiveBench design82.0%Not measuredOnly Claude Sonnet 5 measured
GeneralDirectional onlyPublic boards, shown as published, kept out of the index34 boards, none shared
General benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
LiveBench data analysis71.7%Not measuredOnly Claude Sonnet 5 measured
Public Benefits Bench (Vals AI)66.0%Not measuredOnly Claude Sonnet 5 measured
SAGE (Vals AI)48.9%Not measuredOnly Claude Sonnet 5 measured
MedScribe (Vals AI)76.0%Not measuredOnly Claude Sonnet 5 measured
Vals Multimodal Index68.8%Not measuredOnly Claude Sonnet 5 measured
Long context reasoning (AA-LCR)82.0%Not measuredOnly Claude Sonnet 5 measured
DTBench92.5%Not measuredOnly Claude Sonnet 5 measured
LMCA50.0%Not measuredOnly Claude Sonnet 5 measured
Creative writing (Lech Mazur)Not measured81.8%Only GPT-4o (2024-11-20) measured
Surface Evolver Bench60.0%Not measuredOnly Claude Sonnet 5 measured
LMArena Text1442Not measuredOnly Claude Sonnet 5 measured
LMArena Text: instruction following1452Not measuredOnly Claude Sonnet 5 measured
LMArena Text: creative writing1416Not measuredOnly Claude Sonnet 5 measured
LMArena Vision1273Not measuredOnly Claude Sonnet 5 measured
LMArena Text: English1450Not measuredOnly Claude Sonnet 5 measured
LMArena Text: non-English1431Not measuredOnly Claude Sonnet 5 measured
LMArena Text: Chinese1478Not measuredOnly Claude Sonnet 5 measured
LMArena Text: German1442Not measuredOnly Claude Sonnet 5 measured
LMArena Text: Japanese1422Not measuredOnly Claude Sonnet 5 measured
LMArena Text: Korean1412Not measuredOnly Claude Sonnet 5 measured
LMArena Text: French1463Not measuredOnly Claude Sonnet 5 measured
LMArena Text: Spanish1438Not measuredOnly Claude Sonnet 5 measured
LMArena Text: Russian1450Not measuredOnly Claude Sonnet 5 measured
LMArena Text: Polish1425Not measuredOnly Claude Sonnet 5 measured
LMArena Text: multi-turn1453Not measuredOnly Claude Sonnet 5 measured
LMArena Text: longer queries1462Not measuredOnly Claude Sonnet 5 measured
LMArena Text: writing and language1436Not measuredOnly Claude Sonnet 5 measured
LMArena Text: entertainment and media1411Not measuredOnly Claude Sonnet 5 measured
LMArena Vision: English1275Not measuredOnly Claude Sonnet 5 measured
LMArena Vision: Chinese1331Not measuredOnly Claude Sonnet 5 measured
LMArena Vision: reading text1288Not measuredOnly Claude Sonnet 5 measured
LMArena Vision: humor1261Not measuredOnly Claude Sonnet 5 measured
LMArena Vision: creative writing1246Not measuredOnly Claude Sonnet 5 measured
LMArena Document1466Not measuredOnly Claude Sonnet 5 measured
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Sonnet 5 and GPT-4o (2024-11-20)
BenchmarkClaude Sonnet 5GPT-4o (2024-11-20)Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Sonnet 5$0.0070Fits in one request
GPT-4o (2024-11-20)$0.0075Fits in one request

Claude Sonnet 5 costs less

Repository review

50K input + 3K output tokens

Claude Sonnet 5$0.130Fits in one request
GPT-4o (2024-11-20)$0.155Fits in one request

Claude Sonnet 5 costs less

Agent loop

200K input + 10K output tokens

Claude Sonnet 5$0.500Fits in one request
GPT-4o (2024-11-20)$0.600Exceeds the context window

Claude Sonnet 5 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Sonnet 5 and GPT-4o (2024-11-20)
SpecificationAnthropic Claude Sonnet 5OpenAI GPT-4o (2024-11-20)
MakerAnthropicOpenAI
WeightsNo public weights listedNo public weights listed
ReleasedJune 30, 2026November 20, 2024
Context window1M128K
Input $/Mtok$2.00$2.50
Output $/Mtok$10.00$10.00
Coding index63.518.2
Independent measurements behind it21
Cost per solved task$1.87Not computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Sonnet 5 better than GPT-4o (2024-11-20) for coding?

Pick Claude Sonnet 5 for coding: it scores 63.5 on the Vibe Coding Index against 18.2 for GPT-4o (2024-11-20). GPT-4o (2024-11-20) is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Which is cheaper, Claude Sonnet 5 or GPT-4o (2024-11-20)?

Claude Sonnet 5 costs $2.00 per million input tokens and $10.00 per million output tokens; GPT-4o (2024-11-20) costs $2.50 and $10.00. Cost per solved task is known for Claude Sonnet 5 only.

Which has the bigger context window, Claude Sonnet 5 or GPT-4o (2024-11-20)?

Claude Sonnet 5, with 1M tokens against 128K.

How many benchmarks is the Claude Sonnet 5 vs GPT-4o (2024-11-20) comparison based on?

13 benchmarks have a result for both models as of October 21, 2026. Claude Sonnet 5's coding index rests on 2 independent benchmarks and GPT-4o (2024-11-20)'s on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next