LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

o3 Pro vs Inkling

Updated October 21, 2026. 8 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

o3 ProOpenAI
Coding
84.9
Overall
21.9
Output $/M
$80.00
2
T InklingThinking Machines
Coding
49.7
Overall
25.0
Output $/M
$4.05
6
vs boards won of 8 shared

Decision reading

Pick o3 Pro for coding: it scores 84.9 on the Vibe Coding Index against 49.7 for Inkling, though on 1 benchmark against 2.

Pick Inkling when output tokens cost 19.8x less, or when the context window is larger, 524K against 200K tokens.

Shared results
8
o3 Pro only
3
Inkling only
94
Like-for-like categories
4 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
o3 Pro 84.9 from 1 benchmark, Inkling 49.7 from 2 benchmarks.
Widest category
Coding, 25.9 points apart on average over 1 shared benchmark.
Widest single gap
ARC-AGI-2: o3 Pro 4.9% against Inkling 36.5%, 31.7 points apart on a 0 to 100 scale.
Output price
o3 Pro $80.00 against Inkling $4.05 per million output tokens, 19.8x apart.
Context window
o3 Pro takes 200K tokens, Inkling 524K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Categoryo3 ProBarsInklingTies
Coding10
Intelligence02
Reasoning03
General11
All shared boards26
CodingLike-for-likeFour of these boards feed the Vibe Coding Index10
Coding benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
Aider polyglot84.9%Not measuredOnly o3 Pro measured
LiveBench codingNot measured64.0%Only Inkling measured
LMArena WebDevNot measured1414Only Inkling measured
AA Coding IndexNot measured52.1Only Inkling measured
LiveCodeBench (Vals AI)Not measured85.5%Only Inkling measured
SWE-bench Verified (Vals AI)Not measured77.6%Only Inkling measured
Terminal-Bench 4 (Vals AI)Not measured0.5%Only Inkling measured
Vibe Code Bench (Vals AI)Not measured19.2%Only Inkling measured
Code migration (Vals AI)Not measured11.8%Only Inkling measured
ProgramBench (Vals AI)Not measured0.0%Only Inkling measured
IOI (Vals AI)Not measured14.9%Only Inkling measured
Terminal-Bench 2.1 (Vals AI)Not measured47.6%Only Inkling measured
Vibe Code Bench 1-100 (Vals AI)Not measured7.3%Only Inkling measured
SkillsBench (Vals AI)Not measured26.1%Only Inkling measured
CyberBench (Vals AI)Not measured66.8%Only Inkling measured
SciCodeNot measured47.0%Only Inkling measured
FrontierCodeNot measured14.0%Only Inkling measured
FrontierSWENot measured4.1%Only Inkling measured
WeirdML58.2%32.3%o3 Pro
ALE-BenchNot measured946.0Only Inkling measured
LMArena Text: codingNot measured1466Only Inkling measured
LMArena Text: software and ITNot measured1465Only Inkling measured
LMArena WebDev: ReactNot measured1404Only Inkling measured
LMArena WebDev: HTMLNot measured1399Only Inkling measured
Neither model has a result on the other 14 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02
Intelligence benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
AA Intelligence Index21.925.0Inkling
Epoch Capabilities Index147.3148.4Inkling
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index12 boards, none shared
Agentic work benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
AA Agentic IndexNot measured22.5Only Inkling measured
Design Arena: agents building web appsNot measured1196Only Inkling measured
LiveBench researchNot measured59.9%Only Inkling measured
LiveBench browserNot measured16.0%Only Inkling measured
LiveBench long agenticNot measured14.1%Only Inkling measured
SREBench (Vals AI)Not measured0.0%Only Inkling measured
Finance Agent (Vals AI)Not measured46.6%Only Inkling measured
Tax Agent Bench (Vals AI)Not measured15.3%Only Inkling measured
Legal Research Bench (Vals AI)Not measured28.4%Only Inkling measured
Harvey's Legal Agent Benchmark (Vals AI)Not measured3.8%Only Inkling measured
Excel Modeling Benchmark (Vals AI)Not measured38.4%Only Inkling measured
APEX-AgentsNot measured33.8%Only Inkling measured
Neither model has a result on the other 27 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index03
Reasoning benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
GPQA DiamondNot measured87.1%Only Inkling measured
LiveBench reasoningNot measured78.3%Only Inkling measured
MMMU Pro (Vals AI)Not measured78.5%Only Inkling measured
GPQA Diamond (Artificial Analysis run)84.5%87.2%Inkling
Humanity's Last Exam (Artificial Analysis run)Not measured31.9%Only Inkling measured
GPQA Diamond (Epoch AI run)Not measured88.3%Only Inkling measured
ARC-AGI59.3%79.5%Inkling
ARC-AGI-24.9%36.5%Inkling
SimpleBenchNot measured50.0%Only Inkling measured
Chess puzzlesNot measured21.0%Only Inkling measured
LMArena Text: hard promptsNot measured1451Only Inkling measured
LMArena Text: expertNot measured1466Only Inkling measured
LMArena Text: hard prompts in EnglishNot measured1448Only Inkling measured
Neither model has a result on the other 8 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index6 boards, none shared
Math benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
OTIS Mock AIMENot measured88.9%Only Inkling measured
FrontierMath, tiers 1 to 3Not measured33.3%Only Inkling measured
FrontierMath, tier 4Not measured4.9%Only Inkling measured
ProofBenchNot measured0.0%Only Inkling measured
LMArena Text: mathNot measured1479Only Inkling measured
LMArena Text: mathematical workNot measured1460Only Inkling measured
Neither model has a result on the other 7 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index11 boards, none shared
Knowledge benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
MMLU ProNot measured86.3%Only Inkling measured
LegalBench (Vals AI)Not measured83.0%Only Inkling measured
CorpFin (Vals AI)Not measured68.6%Only Inkling measured
TaxEval (Vals AI)Not measured75.3%Only Inkling measured
MortgageTax (Vals AI)Not measured64.0%Only Inkling measured
MedCode (Vals AI)Not measured41.2%Only Inkling measured
SimpleQA VerifiedNot measured40.3%Only Inkling measured
LMArena Text: scienceNot measured1455Only Inkling measured
LMArena Text: medicine and healthcareNot measured1447Only Inkling measured
LMArena Text: legal and governmentNot measured1448Only Inkling measured
LMArena Text: business and financeNot measured1438Only Inkling measured
Neither model has a result on the other 6 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
Design Arena: websitesNot measured1224Only Inkling measured
Design Arena: UI componentsNot measured1200Only Inkling measured
Design Arena: game devNot measured1166Only Inkling measured
Design Arena: data vizNot measured1160Only Inkling measured
Design Arena: 3DNot measured1161Only Inkling measured
Design Arena: all code categoriesNot measured1206Only Inkling measured
Design Arena: SVGNot measured1109Only Inkling measured
Design Arena: ASCII artNot measured1089Only Inkling measured
LiveBench designNot measured58.3%Only Inkling measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index11
General benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
Vals IndexNot measured29.0%Only Inkling measured
LiveBench data analysisNot measured72.8%Only Inkling measured
Public Benefits Bench (Vals AI)Not measured58.5%Only Inkling measured
SAGE (Vals AI)Not measured36.5%Only Inkling measured
MedScribe (Vals AI)Not measured85.4%Only Inkling measured
Vals Multimodal IndexNot measured49.4%Only Inkling measured
Long context reasoning (AA-LCR)Not measured77.3%Only Inkling measured
DTBench86.9%87.5%Inkling
LMCA38.5%37.6%o3 Pro
Fiction.LiveBench97.2%Not measuredOnly o3 Pro measured
Creative writing (Lech Mazur)84.4%Not measuredOnly o3 Pro measured
LMArena TextNot measured1442Only Inkling measured
LMArena Text: instruction followingNot measured1425Only Inkling measured
LMArena Text: creative writingNot measured1390Only Inkling measured
LMArena Text: EnglishNot measured1442Only Inkling measured
LMArena Text: non-EnglishNot measured1434Only Inkling measured
LMArena Text: ChineseNot measured1493Only Inkling measured
LMArena Text: GermanNot measured1445Only Inkling measured
LMArena Text: JapaneseNot measured1429Only Inkling measured
LMArena Text: KoreanNot measured1403Only Inkling measured
LMArena Text: FrenchNot measured1455Only Inkling measured
LMArena Text: SpanishNot measured1449Only Inkling measured
LMArena Text: RussianNot measured1430Only Inkling measured
LMArena Text: PolishNot measured1450Only Inkling measured
LMArena Text: multi-turnNot measured1437Only Inkling measured
LMArena Text: longer queriesNot measured1435Only Inkling measured
LMArena Text: writing and languageNot measured1404Only Inkling measured
LMArena Text: entertainment and mediaNot measured1394Only Inkling measured
Neither model has a result on the other 18 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for o3 Pro and Inkling
Benchmarko3 ProInklingLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

o3 Pro$0.060Fits in one request
Inkling$0.0030Fits in one request

Inkling costs less

Repository review

50K input + 3K output tokens

o3 Pro$1.24Fits in one request
Inkling$0.062Fits in one request

Inkling costs less

Agent loop

200K input + 10K output tokens

o3 Pro$4.80Exceeds the context window
Inkling$0.240Fits in one request

Inkling costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of o3 Pro and Inkling
SpecificationOpenAI o3 ProThinking Machines Inkling
MakerOpenAIThinking Machines
WeightsNo public weights listedOpen weights
ReleasedJune 10, 2025July 17, 2026
Context window200K524K
Input $/Mtok$20.00$1.00
Output $/Mtok$80.00$4.05
Coding index84.949.7
Independent measurements behind it12
Cost per solved taskNot computable$0.76
SourceOpenRouter listingOpenRouter listing

Questions

Is o3 Pro better than Inkling for coding?

Pick o3 Pro for coding: it scores 84.9 on the Vibe Coding Index against 49.7 for Inkling, though on 1 benchmark against 2. Pick Inkling when output tokens cost 19.8x less, or when the context window is larger, 524K against 200K tokens.

Which is cheaper, o3 Pro or Inkling?

o3 Pro costs $20.00 per million input tokens and $80.00 per million output tokens; Inkling costs $1.00 and $4.05. Cost per solved task is known for Inkling only.

Which has the bigger context window, o3 Pro or Inkling?

Inkling, with 524K tokens against 200K.

How many benchmarks is the o3 Pro vs Inkling comparison based on?

8 benchmarks have a result for both models as of October 21, 2026. o3 Pro's coding index rests on 1 independent benchmark and Inkling's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next