LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Opus 4.6 vs GPT-4o-mini (2024-07-18)

Updated October 21, 2026. 39 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Opus 4.6Anthropic
Coding
66.9
Overall
31.9
Output $/M
$25.00
39
GPT-4o-mini (2024-07-18)OpenAI
Coding
3.6
Overall
No data
Output $/M
$0.60
0
vs boards won of 39 shared

Decision reading

Pick Claude Opus 4.6 for coding: it scores 66.9 on the Vibe Coding Index against 3.6 for GPT-4o-mini (2024-07-18).

Pick GPT-4o-mini (2024-07-18) when output tokens cost 41.7x less.

Shared results
39
Claude Opus 4.6 only
69
GPT-4o-mini (2024-07-18) only
7
Like-for-like categories
5 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Opus 4.6 66.9 from 2 benchmarks, GPT-4o-mini (2024-07-18) 3.6 from 1 benchmark.
Widest category
Math, 59.2 points apart on average over 4 shared benchmarks.
Widest single gap
OTIS Mock AIME: Claude Opus 4.6 94.4% against GPT-4o-mini (2024-07-18) 6.9%, 87.5 points apart on a 0 to 100 scale.
Output price
Claude Opus 4.6 $25.00 against GPT-4o-mini (2024-07-18) $0.60 per million output tokens, 41.7x apart.
Context window
Claude Opus 4.6 takes 1M tokens, GPT-4o-mini (2024-07-18) 128K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Opus 4.6BarsGPT-4o-mini (2024-07-18)Ties
Coding30
Reasoning70
Math40
Knowledge50
General200
All shared boards390
CodingLike-for-likeFour of these boards feed the Vibe Coding Index30
Coding benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
Aider polyglotNot measured3.6%Only GPT-4o-mini (2024-07-18) measured
SWE-bench Verified75.6%Not measuredOnly Claude Opus 4.6 measured
SWE-bench Multilingual72.0%Not measuredOnly Claude Opus 4.6 measured
LMArena WebDev1547Not measuredOnly Claude Opus 4.6 measured
LiveCodeBench (Vals AI)84.7%Not measuredOnly Claude Opus 4.6 measured
SWE-bench Verified (Vals AI)78.2%Not measuredOnly Claude Opus 4.6 measured
Vibe Code Bench (Vals AI)57.6%Not measuredOnly Claude Opus 4.6 measured
Terminal-Bench Hard (Artificial Analysis run)48.5%Not measuredOnly Claude Opus 4.6 measured
Terminal-Bench79.8%Not measuredOnly Claude Opus 4.6 measured
FrontierCode26.6%Not measuredOnly Claude Opus 4.6 measured
GSO-Bench41.2%Not measuredOnly Claude Opus 4.6 measured
WeirdML78.0%11.8%Claude Opus 4.6
Cybench93.0%Not measuredOnly Claude Opus 4.6 measured
LMArena Text: coding15341290Claude Opus 4.6
LMArena Text: software and IT15271291Claude Opus 4.6
LMArena WebDev: React1539Not measuredOnly Claude Opus 4.6 measured
LMArena WebDev: HTML1559Not measuredOnly Claude Opus 4.6 measured
LMArena WebDev: from an image1543Not measuredOnly Claude Opus 4.6 measured
Neither model has a result on the other 20 boards here
IntelligenceDirectional onlyPublic boards, shown as published, kept out of the index2 boards, none shared
Intelligence benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
AA Intelligence Index31.9Not measuredOnly Claude Opus 4.6 measured
Epoch Capabilities Index155.7Not measuredOnly Claude Opus 4.6 measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index12 boards, none shared
Agentic work benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
Design Arena: agents building web apps1206Not measuredOnly Claude Opus 4.6 measured
Design Arena: agents building full-stack apps1220Not measuredOnly Claude Opus 4.6 measured
Design Arena: agents building mobile apps1207Not measuredOnly Claude Opus 4.6 measured
Design Arena: agents building Android apps1204Not measuredOnly Claude Opus 4.6 measured
Design Arena: agents building games1214Not measuredOnly Claude Opus 4.6 measured
τ²-Bench Telecom92.1%Not measuredOnly Claude Opus 4.6 measured
APEX-Agents46.3%Not measuredOnly Claude Opus 4.6 measured
METR time horizons78.9%Not measuredOnly Claude Opus 4.6 measured
Remote Labor Index4.2%Not measuredOnly Claude Opus 4.6 measured
BALROGNot measured17.4%Only GPT-4o-mini (2024-07-18) measured
DeepResearch Bench55.3%Not measuredOnly Claude Opus 4.6 measured
Vending-Bench 2$8,018Not measuredOnly Claude Opus 4.6 measured
Neither model has a result on the other 27 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index70
Reasoning benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
GPQA Diamond89.7%Not measuredOnly Claude Opus 4.6 measured
MMMU Pro (Vals AI)83.9%Not measuredOnly Claude Opus 4.6 measured
GPQA Diamond (Artificial Analysis run)89.6%Not measuredOnly Claude Opus 4.6 measured
Humanity's Last Exam (Artificial Analysis run)39.9%Not measuredOnly Claude Opus 4.6 measured
GPQA Diamond (Epoch AI run)90.5%37.7%Claude Opus 4.6
ARC-AGI94.0%Not measuredOnly Claude Opus 4.6 measured
ARC-AGI-269.2%Not measuredOnly Claude Opus 4.6 measured
SimpleBench67.6%10.7%Claude Opus 4.6
Chess puzzles21.0%3.0%Claude Opus 4.6
Mystery game puzzles25.0%12.0%Claude Opus 4.6
EBR-bench12.7%Not measuredOnly Claude Opus 4.6 measured
VPCTNot measured34.0%Only GPT-4o-mini (2024-07-18) measured
LMArena Text: hard prompts15251267Claude Opus 4.6
LMArena Text: expert15441234Claude Opus 4.6
LMArena Text: hard prompts in English15301278Claude Opus 4.6
LMArena Vision: diagrams1340Not measuredOnly Claude Opus 4.6 measured
LMArena Vision: homework1337Not measuredOnly Claude Opus 4.6 measured
Neither model has a result on the other 4 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index40
Math benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
AIME95.6%Not measuredOnly Claude Opus 4.6 measured
OTIS Mock AIME94.4%6.9%Claude Opus 4.6
FrontierMath, tiers 1 to 366.0%0.7%Claude Opus 4.6
FrontierMath, tier 426.8%Not measuredOnly Claude Opus 4.6 measured
ProofBench50.0%Not measuredOnly Claude Opus 4.6 measured
MATH level 5Not measured52.6%Only GPT-4o-mini (2024-07-18) measured
LMArena Text: math15181267Claude Opus 4.6
LMArena Text: mathematical work15251271Claude Opus 4.6
Neither model has a result on the other 5 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index50
Knowledge benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
MMLU Pro89.1%Not measuredOnly Claude Opus 4.6 measured
LegalBench (Vals AI)85.3%Not measuredOnly Claude Opus 4.6 measured
CaseLaw (Vals AI)62.1%Not measuredOnly Claude Opus 4.6 measured
CorpFin (Vals AI)67.0%Not measuredOnly Claude Opus 4.6 measured
TaxEval (Vals AI)76.0%Not measuredOnly Claude Opus 4.6 measured
MortgageTax (Vals AI)68.5%Not measuredOnly Claude Opus 4.6 measured
MedQA (Vals AI)95.4%Not measuredOnly Claude Opus 4.6 measured
MedCode (Vals AI)49.1%Not measuredOnly Claude Opus 4.6 measured
SimpleQA Verified47.0%8.3%Claude Opus 4.6
MMLUNot measured76.7%Only GPT-4o-mini (2024-07-18) measured
GeoBenchNot measured64.0%Only GPT-4o-mini (2024-07-18) measured
LMArena Text: science15191286Claude Opus 4.6
LMArena Text: medicine and healthcare15041282Claude Opus 4.6
LMArena Text: legal and government15121305Claude Opus 4.6
LMArena Text: business and finance14971265Claude Opus 4.6
Neither model has a result on the other 2 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
Design Arena: websites1291Not measuredOnly Claude Opus 4.6 measured
Design Arena: UI components1284Not measuredOnly Claude Opus 4.6 measured
Design Arena: game dev1278Not measuredOnly Claude Opus 4.6 measured
Design Arena: data viz1279Not measuredOnly Claude Opus 4.6 measured
Design Arena: 3D1274Not measuredOnly Claude Opus 4.6 measured
Design Arena: all code categories1289Not measuredOnly Claude Opus 4.6 measured
Design Arena: SVG1227Not measuredOnly Claude Opus 4.6 measured
Design Arena: ASCII art1254Not measuredOnly Claude Opus 4.6 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index200
General benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
SAGE (Vals AI)51.6%Not measuredOnly Claude Opus 4.6 measured
MedScribe (Vals AI)86.7%Not measuredOnly Claude Opus 4.6 measured
IFBench53.1%Not measuredOnly Claude Opus 4.6 measured
Long context reasoning (AA-LCR)78.0%Not measuredOnly Claude Opus 4.6 measured
DTBench91.2%Not measuredOnly Claude Opus 4.6 measured
LMCA55.8%Not measuredOnly Claude Opus 4.6 measured
Creative writing (Lech Mazur)Not measured67.2%Only GPT-4o-mini (2024-07-18) measured
CL-bench20.7%Not measuredOnly Claude Opus 4.6 measured
Furniture assembly28.3%Not measuredOnly Claude Opus 4.6 measured
CL-bench Life17.0%Not measuredOnly Claude Opus 4.6 measured
LMArena Text15011286Claude Opus 4.6
LMArena Text: instruction following15211258Claude Opus 4.6
LMArena Text: creative writing15051268Claude Opus 4.6
LMArena Vision13161066Claude Opus 4.6
LMArena Text: English15111301Claude Opus 4.6
LMArena Text: non-English14881266Claude Opus 4.6
LMArena Text: Chinese15511265Claude Opus 4.6
LMArena Text: German15001272Claude Opus 4.6
LMArena Text: Japanese14881216Claude Opus 4.6
LMArena Text: Korean14641195Claude Opus 4.6
LMArena Text: French15121297Claude Opus 4.6
LMArena Text: Spanish15101276Claude Opus 4.6
LMArena Text: Russian14971275Claude Opus 4.6
LMArena Text: Polish14991244Claude Opus 4.6
LMArena Text: multi-turn15111285Claude Opus 4.6
LMArena Text: longer queries15181289Claude Opus 4.6
LMArena Text: writing and language15021282Claude Opus 4.6
LMArena Text: entertainment and media14921253Claude Opus 4.6
LMArena Vision: English13241072Claude Opus 4.6
LMArena Vision: Chinese13701033Claude Opus 4.6
LMArena Vision: reading text1326Not measuredOnly Claude Opus 4.6 measured
LMArena Vision: humor1314Not measuredOnly Claude Opus 4.6 measured
LMArena Vision: recognizing things1274Not measuredOnly Claude Opus 4.6 measured
LMArena Vision: creative writing1331Not measuredOnly Claude Opus 4.6 measured
LMArena Document1507Not measuredOnly Claude Opus 4.6 measured
Neither model has a result on the other 11 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
BenchmarkClaude Opus 4.6GPT-4o-mini (2024-07-18)Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Opus 4.6$0.018Fits in one request
GPT-4o-mini (2024-07-18)$0.0004Fits in one request

GPT-4o-mini (2024-07-18) costs less

Repository review

50K input + 3K output tokens

Claude Opus 4.6$0.325Fits in one request
GPT-4o-mini (2024-07-18)$0.0093Fits in one request

GPT-4o-mini (2024-07-18) costs less

Agent loop

200K input + 10K output tokens

Claude Opus 4.6$1.25Fits in one request
GPT-4o-mini (2024-07-18)$0.036Exceeds the context window

GPT-4o-mini (2024-07-18) costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Opus 4.6 and GPT-4o-mini (2024-07-18)
SpecificationAnthropic Claude Opus 4.6OpenAI GPT-4o-mini (2024-07-18)
MakerAnthropicOpenAI
WeightsNo public weights listedNo public weights listed
ReleasedFebruary 4, 2026July 18, 2024
Context window1M128K
Input $/Mtok$5.00$0.15
Output $/Mtok$25.00$0.60
Coding index66.93.6
Independent measurements behind it21
Cost per solved task$1.56Not computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Opus 4.6 better than GPT-4o-mini (2024-07-18) for coding?

Pick Claude Opus 4.6 for coding: it scores 66.9 on the Vibe Coding Index against 3.6 for GPT-4o-mini (2024-07-18). Pick GPT-4o-mini (2024-07-18) when output tokens cost 41.7x less.

Which is cheaper, Claude Opus 4.6 or GPT-4o-mini (2024-07-18)?

Claude Opus 4.6 costs $5.00 per million input tokens and $25.00 per million output tokens; GPT-4o-mini (2024-07-18) costs $0.15 and $0.60. Cost per solved task is known for Claude Opus 4.6 only.

Which has the bigger context window, Claude Opus 4.6 or GPT-4o-mini (2024-07-18)?

Claude Opus 4.6, with 1M tokens against 128K.

How many benchmarks is the Claude Opus 4.6 vs GPT-4o-mini (2024-07-18) comparison based on?

39 benchmarks have a result for both models as of October 21, 2026. Claude Opus 4.6's coding index rests on 2 independent benchmarks and GPT-4o-mini (2024-07-18)'s on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next