LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

GPT-5 Mini vs Inkling

Updated October 21, 2026. 67 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

GPT-5 MiniOpenAI
Coding
59.8
Overall
20.6
Output $/M
$2.00
11
T InklingThinking Machines
Coding
49.7
Overall
25.0
Output $/M
$4.05
56
vs boards won of 67 shared

Decision reading

Pick GPT-5 Mini for coding: it scores 59.8 on the Vibe Coding Index against 49.7 for Inkling, though on 1 benchmark against 2.

Pick Inkling when the context window is larger, 524K against 400K tokens, or when what matters is SWE-bench Verified (Vals AI) or Vibe Code Bench (Vals AI), where it leads.

Shared results
67
GPT-5 Mini only
31
Inkling only
35
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-5 Mini 59.8 from 1 benchmark, Inkling 49.7 from 2 benchmarks.
Widest category
Reasoning, 12.1 points apart on average over 11 shared benchmarks.
Widest single gap
ARC-AGI-2: GPT-5 Mini 4.4% against Inkling 36.5%, 32.1 points apart on a 0 to 100 scale.
Output price
GPT-5 Mini $2.00 against Inkling $4.05 per million output tokens, 2.0x apart.
Context window
GPT-5 Mini takes 400K tokens, Inkling 524K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-5 MiniBarsInklingTies
Coding25
Intelligence02
Reasoning29
Math33
Knowledge29
Web design17
General121
All shared boards1156
CodingLike-for-likeFour of these boards feed the Vibe Coding Index25
Coding benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
SWE-bench Verified59.8%Not measuredOnly GPT-5 Mini measured
SWE-bench Multilingual39.7%Not measuredOnly GPT-5 Mini measured
LiveBench codingNot measured64.0%Only Inkling measured
LMArena WebDevNot measured1414Only Inkling measured
AA Coding IndexNot measured52.1Only Inkling measured
LiveCodeBench (Vals AI)86.6%85.5%GPT-5 Mini
SWE-bench Verified (Vals AI)60.8%77.6%Inkling
Terminal-Bench 4 (Vals AI)Not measured0.5%Only Inkling measured
Vibe Code Bench (Vals AI)14.2%19.2%Inkling
Code migration (Vals AI)Not measured11.8%Only Inkling measured
ProgramBench (Vals AI)Not measured0.0%Only Inkling measured
IOI (Vals AI)Not measured14.9%Only Inkling measured
Terminal-Bench 2.1 (Vals AI)Not measured47.6%Only Inkling measured
Vibe Code Bench 1-100 (Vals AI)Not measured7.3%Only Inkling measured
SkillsBench (Vals AI)Not measured26.1%Only Inkling measured
CyberBench (Vals AI)Not measured66.8%Only Inkling measured
LiveCodeBench (Artificial Analysis run)83.8%Not measuredOnly GPT-5 Mini measured
SciCode39.0%47.0%Inkling
Terminal-Bench Hard (Artificial Analysis run)33.3%Not measuredOnly GPT-5 Mini measured
Terminal-Bench34.8%Not measuredOnly GPT-5 Mini measured
FrontierCodeNot measured14.0%Only Inkling measured
FrontierSWENot measured4.1%Only Inkling measured
WeirdML52.7%32.3%GPT-5 Mini
ALE-BenchNot measured946.0Only Inkling measured
LMArena Text: coding14061466Inkling
LMArena Text: software and IT13941465Inkling
LMArena WebDev: ReactNot measured1404Only Inkling measured
LMArena WebDev: HTMLNot measured1399Only Inkling measured
Neither model has a result on the other 10 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02
Intelligence benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
AA Intelligence Index20.625.0Inkling
Epoch Capabilities Index145.3148.4Inkling
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index14 boards, none shared
Agentic work benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
AA Agentic IndexNot measured22.5Only Inkling measured
Design Arena: agents building web appsNot measured1196Only Inkling measured
LiveBench researchNot measured59.9%Only Inkling measured
LiveBench browserNot measured16.0%Only Inkling measured
LiveBench long agenticNot measured14.1%Only Inkling measured
SREBench (Vals AI)Not measured0.0%Only Inkling measured
Finance Agent (Vals AI)Not measured46.6%Only Inkling measured
Tax Agent Bench (Vals AI)Not measured15.3%Only Inkling measured
Legal Research Bench (Vals AI)Not measured28.4%Only Inkling measured
Harvey's Legal Agent Benchmark (Vals AI)Not measured3.8%Only Inkling measured
Excel Modeling Benchmark (Vals AI)Not measured38.4%Only Inkling measured
τ²-Bench Telecom71.1%Not measuredOnly GPT-5 Mini measured
APEX-AgentsNot measured33.8%Only Inkling measured
Vending-Bench 2-$31Not measuredOnly GPT-5 Mini measured
Neither model has a result on the other 25 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index29
Reasoning benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
GPQA Diamond80.3%87.1%Inkling
LiveBench reasoningNot measured78.3%Only Inkling measured
MMMU Pro (Vals AI)78.9%78.5%GPT-5 Mini
GPQA Diamond (Artificial Analysis run)82.8%87.2%Inkling
Humanity's Last Exam (Artificial Analysis run)21.5%31.9%Inkling
GPQA Diamond (Epoch AI run)75.0%88.3%Inkling
ARC-AGI54.3%79.5%Inkling
ARC-AGI-24.4%36.5%Inkling
SimpleBenchNot measured50.0%Only Inkling measured
Chess puzzles24.0%21.0%GPT-5 Mini
Mystery game puzzles10.0%Not measuredOnly GPT-5 Mini measured
VPCT40.2%Not measuredOnly GPT-5 Mini measured
LMArena Text: hard prompts13801451Inkling
LMArena Text: expert13791466Inkling
LMArena Text: hard prompts in English13831448Inkling
LMArena Vision: diagrams1202Not measuredOnly GPT-5 Mini measured
LMArena Vision: homework1210Not measuredOnly GPT-5 Mini measured
Neither model has a result on the other 4 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index33
Math benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
AIME91.5%Not measuredOnly GPT-5 Mini measured
MATH 500 (Vals AI)94.8%Not measuredOnly GPT-5 Mini measured
MGSM (Vals AI)92.6%Not measuredOnly GPT-5 Mini measured
AA Math Index90.7Not measuredOnly GPT-5 Mini measured
AIME 2025 (Artificial Analysis run)90.7%Not measuredOnly GPT-5 Mini measured
OTIS Mock AIME86.7%88.9%Inkling
FrontierMath, tiers 1 to 346.7%33.3%GPT-5 Mini
FrontierMath, tier 412.2%4.9%GPT-5 Mini
ProofBench9.0%0.0%GPT-5 Mini
MATH level 597.8%Not measuredOnly GPT-5 Mini measured
LMArena Text: math13781479Inkling
LMArena Text: mathematical work13801460Inkling
Neither model has a result on the other 1 board here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index29
Knowledge benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
MMLU Pro82.2%86.3%Inkling
LegalBench (Vals AI)81.8%83.0%Inkling
CaseLaw (Vals AI)68.5%Not measuredOnly GPT-5 Mini measured
CorpFin (Vals AI)60.2%68.6%Inkling
TaxEval (Vals AI)75.2%75.3%Inkling
MortgageTax (Vals AI)66.9%64.0%GPT-5 Mini
MedQA (Vals AI)96.1%Not measuredOnly GPT-5 Mini measured
MedCode (Vals AI)43.0%41.2%GPT-5 Mini
MMLU Pro (Artificial Analysis run)83.7%Not measuredOnly GPT-5 Mini measured
SimpleQA Verified21.6%40.3%Inkling
LMArena Text: science13711455Inkling
LMArena Text: medicine and healthcare13801447Inkling
LMArena Text: legal and government13751448Inkling
LMArena Text: business and finance13581438Inkling
Neither model has a result on the other 3 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index17
Web design benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
Design Arena: websites11251224Inkling
Design Arena: UI components11061200Inkling
Design Arena: game dev11301166Inkling
Design Arena: data viz11311160Inkling
Design Arena: 3D10371161Inkling
Design Arena: all code categories11151206Inkling
Design Arena: SVG10911109Inkling
Design Arena: ASCII art11241089GPT-5 Mini
LiveBench designNot measured58.3%Only Inkling measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index121
General benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
Vals IndexNot measured29.0%Only Inkling measured
LiveBench data analysisNot measured72.8%Only Inkling measured
Public Benefits Bench (Vals AI)Not measured58.5%Only Inkling measured
SAGE (Vals AI)43.0%36.5%GPT-5 Mini
MedScribe (Vals AI)80.6%85.4%Inkling
Vals Multimodal IndexNot measured49.4%Only Inkling measured
IFBench75.4%Not measuredOnly GPT-5 Mini measured
Long context reasoning (AA-LCR)72.3%77.3%Inkling
DTBench80.5%87.5%Inkling
LMCA34.2%37.6%Inkling
Fiction.LiveBench69.4%Not measuredOnly GPT-5 Mini measured
Creative writing (Lech Mazur)83.1%Not measuredOnly GPT-5 Mini measured
LMArena Text13731442Inkling
LMArena Text: instruction following13571425Inkling
LMArena Text: creative writing13251390Inkling
LMArena Vision1202Not measuredOnly GPT-5 Mini measured
LMArena Text: English13791442Inkling
LMArena Text: non-English13631434Inkling
LMArena Text: Chinese13861493Inkling
LMArena Text: German13661445Inkling
LMArena Text: Japanese13411429Inkling
LMArena Text: Korean13081403Inkling
LMArena Text: French13861455Inkling
LMArena Text: Spanish13541449Inkling
LMArena Text: Russian13621430Inkling
LMArena Text: Polish13781450Inkling
LMArena Text: multi-turn13631437Inkling
LMArena Text: longer queries13551435Inkling
LMArena Text: writing and language13441404Inkling
LMArena Text: entertainment and media13401394Inkling
LMArena Vision: English1216Not measuredOnly GPT-5 Mini measured
LMArena Vision: Chinese1214Not measuredOnly GPT-5 Mini measured
LMArena Vision: reading text1199Not measuredOnly GPT-5 Mini measured
LMArena Vision: humor1205Not measuredOnly GPT-5 Mini measured
LMArena Vision: captioning1217Not measuredOnly GPT-5 Mini measured
LMArena Vision: recognizing things1226Not measuredOnly GPT-5 Mini measured
LMArena Vision: creative writing1181Not measuredOnly GPT-5 Mini measured
Neither model has a result on the other 9 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-5 Mini and Inkling
BenchmarkGPT-5 MiniInklingLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-5 Mini$0.0013Fits in one request
Inkling$0.0030Fits in one request

GPT-5 Mini costs less

Repository review

50K input + 3K output tokens

GPT-5 Mini$0.018Fits in one request
Inkling$0.062Fits in one request

GPT-5 Mini costs less

Agent loop

200K input + 10K output tokens

GPT-5 Mini$0.070Fits in one request
Inkling$0.240Fits in one request

GPT-5 Mini costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-5 Mini and Inkling
SpecificationOpenAI GPT-5 MiniThinking Machines Inkling
MakerOpenAIThinking Machines
WeightsNo public weights listedOpen weights
ReleasedAugust 7, 2025July 17, 2026
Context window400K524K
Input $/Mtok$0.25$1.00
Output $/Mtok$2.00$4.05
Coding index59.849.7
Independent measurements behind it12
Cost per solved task$0.08$0.76
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-5 Mini better than Inkling for coding?

Pick GPT-5 Mini for coding: it scores 59.8 on the Vibe Coding Index against 49.7 for Inkling, though on 1 benchmark against 2. Pick Inkling when the context window is larger, 524K against 400K tokens, or when what matters is SWE-bench Verified (Vals AI) or Vibe Code Bench (Vals AI), where it leads.

Which is cheaper, GPT-5 Mini or Inkling?

GPT-5 Mini costs $0.25 per million input tokens and $2.00 per million output tokens; Inkling costs $1.00 and $4.05. Per solved SWE-bench Verified task, GPT-5 Mini costs $0.08 and Inkling $0.76.

Which has the bigger context window, GPT-5 Mini or Inkling?

Inkling, with 524K tokens against 400K.

How many benchmarks is the GPT-5 Mini vs Inkling comparison based on?

67 benchmarks have a result for both models as of October 21, 2026. GPT-5 Mini's coding index rests on 1 independent benchmark and Inkling's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next