Enter opens the highlighted result. Esc closes.

T

Thinking Machines Inkling 2 Small

As of November 14, 2026, Thinking Machines Inkling 2 Small ranks #63 of 118 models overall with 56.9 ±9.3 on the LLMBenchmark Index. Inkling 2 Small ranks #49 of 122 in reasoning, its strongest category. Thinking Machines Inkling 2 Small costs $0.30 per million input tokens and $1.00 per million output tokens. Inkling 2 Small was released on November 9, 2026.

Inkling 2 Small's output price ranks 125 of 343 priced models, counting from the cheapest.

  • Coding index 48.9 Verified, 3 benchmarks
  • Cost per solved task Not computable No published attempt cost
  • Output, per million tokens $1.00 125 of 343 from the cheapest Median of 6 providers on OpenRouter, from $0.50 at the cheapest of 6 providers
  • Input, per million tokens $0.30 Median of 6 providers on OpenRouter
  • Context window 1.05M Tokens per request
  • Downloads, 30 days 1,064 Hugging Face
New model

Inkling 2 Small launch tracker

Listed on OpenRouter November 9, 2026, 5 days before our data. Results so far on 51 of 222 public boards; this page updates every day as boards publish.

About and specs

Inkling 2 Small is an open-weight multimodal mixture-of-experts reasoning model from Thinking Machines Lab, with 17B active parameters out of 594B total. It is the first model in the second...

API model id thinkingmachines/inkling-2-small
  • Tool callingListed
  • Structured outputsListed
  • JSON modeListed
  • Reasoning modeListed
  • Web searchNot listed
Takes in
Text, Images
Gives back
Text
Context window
1.05M tokens
Max output
944K tokens
Knowledge cutoff
Not published
Cached input $/Mtok
$0.03
Cache write $/Mtok
No cache write price listed
Reasoning $/Mtok
Not priced apart
Web search, per request
No search price listed
Tokenizer
Not named
Requests moderated
No
Withdrawn on
No date announced
Parameters
594.1B, per its Hugging Face weights
Downloads, all time
1,064 on Hugging Face
Training compute
No estimate published
Output speed
76 tokens/s
Speed on OpenRouter
Not measured
First token on OpenRouter
Not measured

Benchmarks: 51 of 222 measured

The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.

Coding index

48.9
  • Terminal-Bench 4 (Vals AI) 12.6% (Mini-SWE-agent) 17 of 100
  • Vibe Code Bench (Vals AI) 81.5% (OpenHands) 82 of 100
  • LiveBench coding Not measured
  • SWE-bench Verified (Vals AI) Not measured
  • FrontierCode Not measured
  • LMArena WebDev Elo, scaled from 1200 to 1900 1647 Elo 64 of 100

The index averages only the coding benchmarks that have a result; the others are skipped, never filled in. How it is weighted

Other public boards

All rankings

Coding11 of 46 boards

5 more coding boards

Not measured on Aider polyglot, SWE-bench Verified, SWE-bench Lite, SWE-bench (full test set), SWE-bench Multimodal, SWE-bench Multilingual, AA Coding Index, LiveCodeBench (Vals AI), Code migration (Vals AI), IOI (Vals AI), Terminal-Bench 2.1 (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), LiveCodeBench (Artificial Analysis run), Terminal-Bench Hard (Artificial Analysis run), Terminal-Bench, DeepSWE, FrontierSWE, GSO-Bench, WeirdML, MirrorCode, Cybench, ALE-Bench, LMArena WebDev: from an image, SciCode, SWE Atlas: Codebase QnA, SWE Atlas: Refactoring, SWE Atlas: Test Writing, GameBench 2, Terminal-Bench 2.0, Terminal-Bench 2.1, Terminal-Bench 3.0, Terminal-Bench 4.0, CursorBench 4.0, ProgramBench

Intelligence1 of 2 boards

Not measured on Epoch Capabilities Index

Agentic work9 of 44 boards

3 more agentic work boards

Not measured on AA Agentic Index, Design Arena: agents building web apps, Design Arena: agents building full-stack apps, Design Arena: agents building mobile apps, Design Arena: agents building Android apps, Design Arena: agents building Godot games, Design Arena: agents building games, Design Arena: HTML slides, Design Arena: PowerPoint slides, Design Arena: spreadsheets, LiveBench research, LiveBench browser, LiveBench long agentic, Finance Agent (Vals AI), Excel Modeling Benchmark (Vals AI), Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), τ²-Bench Telecom, METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, BALROG, DeepResearch Bench, PostTrainBench, TheAgentCompany, OSWorld, SpireClimb, Vending-Bench 2, LMArena Search, Berkeley Function Calling Leaderboard (BFCL), BrowseComp-Plus, Toolathlon-Verified, τ³-Banking

Reasoning9 of 26 boards

3 more reasoning boards

Not measured on GPQA Diamond, LiveBench reasoning, MMMU Pro (Vals AI), GPQA Diamond (Artificial Analysis run), GPQA Diamond (Epoch AI run), Humanity's Last Exam, SimpleBench, Chess puzzles, Mystery game puzzles, EBR-bench, VPCT, BIG-Bench Hard, LMArena Vision: diagrams, LMArena Vision: homework, Kagi LLM Benchmark, Humanity's Last Exam (Scale run), GoBench

Math1 of 14 boards

Not measured on AIME, MATH 500 (Vals AI), MGSM (Vals AI), AA Math Index, AIME 2025 (Artificial Analysis run), OTIS Mock AIME, FrontierMath, tiers 1 to 3, FrontierMath, tier 4, ProofBench, MATH level 5, GSM8K, LMArena Text: math, LMArena Text: mathematical work

Knowledge3 of 21 boards

Not measured on MMLU Pro, LegalBench (Vals AI), CaseLaw (Vals AI), CorpFin (Vals AI), TaxEval (Vals AI), MortgageTax (Vals AI), MedQA (Vals AI), MedCode (Vals AI), MMLU Pro (Artificial Analysis run), SimpleQA Verified, MMLU, GeoBench, AI2 Reasoning Challenge, LMArena Text: medicine and healthcare, LMArena Text: legal and government, FACTS Benchmark Suite, PRBench Finance, PRBench Legal

Web design0 of 9 boards

Not measured on Design Arena: websites, Design Arena: UI components, Design Arena: game dev, Design Arena: data viz, Design Arena: 3D, Design Arena: all code categories, Design Arena: SVG, Design Arena: ASCII art, LiveBench design

General14 of 49 boards

8 more general boards

Not measured on LiveBench data analysis, Public Benefits Bench (Vals AI), MedScribe (Vals AI), Vals Multimodal Index, IFBench, DTBench, LMCA, Fiction.LiveBench, Creative writing (Lech Mazur), CL-bench, Surface Evolver Bench, Furniture assembly, ExploitBench, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Vision, LMArena Text: Chinese, LMArena Text: German, LMArena Text: Japanese, LMArena Text: Korean, LMArena Text: French, LMArena Text: Spanish, LMArena Text: Polish, LMArena Vision: English, LMArena Vision: Chinese, LMArena Vision: reading text, LMArena Vision: humor, LMArena Vision: captioning, LMArena Vision: recognizing things, LMArena Vision: creative writing, LMArena Document, MultiChallenge, EQ-Bench 4

Image generation0 of 5 boards

Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit

Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.

All 222 benchmarks as a table
Benchmark results for Thinking Machines Inkling 2 Small
BenchmarkResultIndex weight
Aider polyglotCoding Not measured Not in index
SWE-bench VerifiedCoding Not measured Not in index
SWE-bench LiteCoding Not measured Not in index
SWE-bench (full test set)Coding Not measured Not in index
SWE-bench MultimodalCoding Not measured Not in index
SWE-bench MultilingualCoding Not measured Not in index
LiveBench codingCoding Not measured 15%
LMArena WebDevCoding 1647 10%
Vals IndexGeneral 56.1% Not in index
GPQA DiamondReasoning Not measured Not in index
AIMEMath Not measured Not in index
MMLU ProKnowledge Not measured Not in index
AA Intelligence IndexIntelligence 30.6 Not in index
AA Coding IndexCoding Not measured Not in index
AA Agentic IndexAgentic work Not measured Not in index
Design Arena: websitesWeb design Not measured Not in index
Design Arena: UI componentsWeb design Not measured Not in index
Design Arena: game devWeb design Not measured Not in index
Design Arena: data vizWeb design Not measured Not in index
Design Arena: 3DWeb design Not measured Not in index
Design Arena: all code categoriesWeb design Not measured Not in index
Design Arena: SVGWeb design Not measured Not in index
Design Arena: ASCII artWeb design Not measured Not in index
Design Arena: agents building web appsAgentic work Not measured Not in index
Design Arena: agents building full-stack appsAgentic work Not measured Not in index
Design Arena: agents building mobile appsAgentic work Not measured Not in index
Design Arena: agents building Android appsAgentic work Not measured Not in index
Design Arena: agents building Godot gamesAgentic work Not measured Not in index
Design Arena: agents building gamesAgentic work Not measured Not in index
Design Arena: HTML slidesAgentic work Not measured Not in index
Design Arena: PowerPoint slidesAgentic work Not measured Not in index
Design Arena: spreadsheetsAgentic work Not measured Not in index
Design Arena: imagesImage generation Not measured Not in index
Design Arena: graphic designImage generation Not measured Not in index
Design Arena: logosImage generation Not measured Not in index
LiveBench reasoningReasoning Not measured Not in index
LiveBench data analysisGeneral Not measured Not in index
LiveBench researchAgentic work Not measured Not in index
LiveBench browserAgentic work Not measured Not in index
LiveBench long agenticAgentic work Not measured Not in index
LiveBench designWeb design Not measured Not in index
LiveCodeBench (Vals AI)Coding Not measured Not in index
SWE-bench Verified (Vals AI)Coding Not measured 15%
Terminal-Bench 4 (Vals AI)Coding 12.6%(Mini-SWE-agent) 25%
Vibe Code Bench (Vals AI)Coding 81.5%(OpenHands) 20%
Code migration (Vals AI)Coding Not measured Not in index
ProgramBench (Vals AI)Coding 0.5% Not in index
SREBench (Vals AI)Agentic work 1.9% Not in index
IOI (Vals AI)Coding Not measured Not in index
Terminal-Bench 2.1 (Vals AI)Coding Not measured Not in index
SWE-bench Multimodal (Vals AI)Coding 43.1% Not in index
Vibe Code Bench 1-100 (Vals AI)Coding Not measured Not in index
SkillsBench (Vals AI)Coding Not measured Not in index
CyberBench (Vals AI)Coding 72.7% Not in index
Finance Agent (Vals AI)Agentic work Not measured Not in index
Tax Agent Bench (Vals AI)Agentic work 38.9% Not in index
Legal Research Bench (Vals AI)Agentic work 46.6% Not in index
Harvey's Legal Agent Benchmark (Vals AI)Agentic work 21.7% Not in index
Excel Modeling Benchmark (Vals AI)Agentic work Not measured Not in index
BioMysteryBench (Vals AI)Agentic work 70.0% Not in index
Terminal-Bench-Science (Vals AI)Agentic work 2.9%(Mini-SWE-agent) Not in index
Vals Science IndexAgentic work 32.7% Not in index
Time Horizon Index (Vals AI)Agentic work Not measured Not in index
CUA-bench (Vals AI)Agentic work Not measured Not in index
Robo-bench (Vals AI)Agentic work Not measured Not in index
Public Benefits Bench (Vals AI)General Not measured Not in index
MysteryMechanism (Vals AI)Reasoning 25.2% Not in index
MMMU Pro (Vals AI)Reasoning Not measured Not in index
MATH 500 (Vals AI)Math Not measured Not in index
MGSM (Vals AI)Math Not measured Not in index
SAGE (Vals AI)General 88.6% Not in index
LegalBench (Vals AI)Knowledge Not measured Not in index
CaseLaw (Vals AI)Knowledge Not measured Not in index
CorpFin (Vals AI)Knowledge Not measured Not in index
TaxEval (Vals AI)Knowledge Not measured Not in index
MortgageTax (Vals AI)Knowledge Not measured Not in index
MedQA (Vals AI)Knowledge Not measured Not in index
MedCode (Vals AI)Knowledge Not measured Not in index
MedScribe (Vals AI)General Not measured Not in index
Vals Multimodal IndexGeneral Not measured Not in index
AA Math IndexMath Not measured Not in index
GPQA Diamond (Artificial Analysis run)Reasoning Not measured Not in index
Humanity's Last Exam (Artificial Analysis run)Reasoning 44.1% Not in index
MMLU Pro (Artificial Analysis run)Knowledge Not measured Not in index
LiveCodeBench (Artificial Analysis run)Coding Not measured Not in index
SciCodeCoding 52.3% Not in index
Terminal-Bench Hard (Artificial Analysis run)Coding Not measured Not in index
IFBenchGeneral Not measured Not in index
Long context reasoning (AA-LCR)General 83.3% Not in index
τ²-Bench TelecomAgentic work Not measured Not in index
AIME 2025 (Artificial Analysis run)Math Not measured Not in index
Terminal-Bench 4.0 (Artificial Analysis run)Coding 13.1% Not in index
FrontierCode 2.0Coding 25.4% Not in index
HLE-Diamond (Artificial Analysis run)Reasoning 28.7% Not in index
GDPval-AAGeneral 1630 Not in index
AA-OmniscienceKnowledge 16.1 Not in index
CritPt v2, hard subset (Artificial Analysis run)Reasoning 35.0% Not in index
Terminal-BenchCoding Not measured Not in index
DeepSWECoding Not measured Not in index
FrontierCodeCoding Not measured 15%
FrontierSWECoding Not measured Not in index
GSO-BenchCoding Not measured Not in index
WeirdMLCoding Not measured Not in index
MirrorCodeCoding Not measured Not in index
APEX-AgentsAgentic work 46.8% Not in index
METR time horizonsAgentic work Not measured Not in index
Remote Labor IndexAgentic work Not measured Not in index
GDPvalAgentic work Not measured Not in index
OSWorld 2.0Agentic work Not measured Not in index
BALROGAgentic work Not measured Not in index
DeepResearch BenchAgentic work Not measured Not in index
PostTrainBenchAgentic work Not measured Not in index
GPQA Diamond (Epoch AI run)Reasoning Not measured Not in index
ARC-AGIReasoning 96.5%(xHigh) Not in index
ARC-AGI-2Reasoning 81.7%(xHigh) Not in index
Humanity's Last ExamReasoning Not measured Not in index
SimpleBenchReasoning Not measured Not in index
Chess puzzlesReasoning Not measured Not in index
Mystery game puzzlesReasoning Not measured Not in index
EBR-benchReasoning Not measured Not in index
OTIS Mock AIMEMath Not measured Not in index
FrontierMath, tiers 1 to 3Math Not measured Not in index
FrontierMath, tier 4Math Not measured Not in index
ProofBenchMath Not measured Not in index
MATH level 5Math Not measured Not in index
GSM8KMath Not measured Not in index
SimpleQA VerifiedKnowledge Not measured Not in index
MMLUKnowledge Not measured Not in index
GeoBenchKnowledge Not measured Not in index
DTBenchGeneral Not measured Not in index
LMCAGeneral Not measured Not in index
Fiction.LiveBenchGeneral Not measured Not in index
Creative writing (Lech Mazur)General Not measured Not in index
CL-benchGeneral Not measured Not in index
Surface Evolver BenchGeneral Not measured Not in index
Furniture assemblyGeneral Not measured Not in index
ExploitBenchGeneral Not measured Not in index
CybenchCoding Not measured Not in index
TheAgentCompanyAgentic work Not measured Not in index
OSWorldAgentic work Not measured Not in index
SpireClimbAgentic work Not measured Not in index
VPCTReasoning Not measured Not in index
BIG-Bench HardReasoning Not measured Not in index
AI2 Reasoning ChallengeKnowledge Not measured Not in index
HellaSwagGeneral Not measured Not in index
WinoGrandeGeneral Not measured Not in index
PIQAGeneral Not measured Not in index
CL-bench LifeGeneral Not measured Not in index
ALE-BenchCoding Not measured Not in index
Vending-Bench 2Agentic work Not measured Not in index
Epoch Capabilities IndexIntelligence Not measured Not in index
LMArena TextGeneral 1403 Not in index
LMArena Text: codingCoding 1455 Not in index
LMArena Text: hard promptsReasoning 1421 Not in index
LMArena Text: mathMath Not measured Not in index
LMArena Text: instruction followingGeneral 1408 Not in index
LMArena Text: creative writingGeneral 1348 Not in index
LMArena VisionGeneral Not measured Not in index
LMArena Text: EnglishGeneral 1418 Not in index
LMArena Text: non-EnglishGeneral 1390 Not in index
LMArena Text: ChineseGeneral Not measured Not in index
LMArena Text: GermanGeneral Not measured Not in index
LMArena Text: JapaneseGeneral Not measured Not in index
LMArena Text: KoreanGeneral Not measured Not in index
LMArena Text: FrenchGeneral Not measured Not in index
LMArena Text: SpanishGeneral Not measured Not in index
LMArena Text: RussianGeneral 1377 Not in index
LMArena Text: PolishGeneral Not measured Not in index
LMArena Text: multi-turnGeneral 1408 Not in index
LMArena Text: longer queriesGeneral 1403 Not in index
LMArena Text: expertReasoning 1478 Not in index
LMArena Text: hard prompts in EnglishReasoning 1424 Not in index
LMArena Text: software and ITCoding 1443 Not in index
LMArena Text: mathematical workMath Not measured Not in index
LMArena Text: scienceKnowledge 1409 Not in index
LMArena Text: medicine and healthcareKnowledge Not measured Not in index
LMArena Text: legal and governmentKnowledge Not measured Not in index
LMArena Text: business and financeKnowledge 1415 Not in index
LMArena Text: writing and languageGeneral 1381 Not in index
LMArena Text: entertainment and mediaGeneral 1359 Not in index
LMArena WebDev: ReactCoding 1660 Not in index
LMArena WebDev: HTMLCoding 1661 Not in index
LMArena WebDev: from an imageCoding Not measured Not in index
LMArena Vision: EnglishGeneral Not measured Not in index
LMArena Vision: ChineseGeneral Not measured Not in index
LMArena Vision: reading textGeneral Not measured Not in index
LMArena Vision: diagramsReasoning Not measured Not in index
LMArena Vision: homeworkReasoning Not measured Not in index
LMArena Vision: humorGeneral Not measured Not in index
LMArena Vision: captioningGeneral Not measured Not in index
LMArena Vision: recognizing thingsGeneral Not measured Not in index
LMArena Vision: creative writingGeneral Not measured Not in index
LMArena SearchAgentic work Not measured Not in index
LMArena DocumentGeneral Not measured Not in index
LMArena Text to ImageImage generation Not measured Not in index
LMArena Image EditImage generation Not measured Not in index
Berkeley Function Calling Leaderboard (BFCL)Agentic work Not measured Not in index
Kagi LLM BenchmarkReasoning Not measured Not in index
BrowseComp-PlusAgentic work Not measured Not in index
SciCodeCoding Not measured Not in index
FACTS Benchmark SuiteKnowledge Not measured Not in index
MathArenaMath 42.4% Not in index
MultiChallengeGeneral Not measured Not in index
MCP AtlasAgentic work 85.4% Not in index
Humanity's Last Exam (Scale run)Reasoning Not measured Not in index
PRBench FinanceKnowledge Not measured Not in index
PRBench LegalKnowledge Not measured Not in index
SWE-Bench Pro V2Coding 97.7% Not in index
SWE Atlas: Codebase QnACoding Not measured Not in index
SWE Atlas: RefactoringCoding Not measured Not in index
SWE Atlas: Test WritingCoding Not measured Not in index
EQ-Bench 4General Not measured Not in index
GameBench 2Coding Not measured Not in index
GoBenchReasoning Not measured Not in index
Terminal-Bench 2.0Coding Not measured Not in index
Terminal-Bench 2.1Coding Not measured Not in index
Terminal-Bench 3.0Coding Not measured Not in index
Terminal-Bench 4.0Coding Not measured Not in index
CursorBench 4.0Coding Not measured Not in index
Toolathlon-VerifiedAgentic work Not measured Not in index
ProgramBenchCoding Not measured Not in index
τ³-BankingAgentic work Not measured Not in index

What it costs

A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.

Output price against the market

Inkling 2 Small pricing
$0.045Dashed line: median $1.90, log scale$180.00
$1.00 per million output tokens is cheaper than 63% of the 338 paid models in the catalog.

Cost per solved task

How it is computed

Neither board that publishes what a SWE-bench Verified attempt costs, Vals AI and swebench.com, has run this model. We leave the number out rather than estimate it.

Nearly as good as Inkling 2 Small, for less

What the boards say about its runs

Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.

What each board publishes about the runs behind Thinking Machines: Inkling 2 Small's results
BoardResultWhat the run costAlso published
Vals Index 56.1% $3.51 per test Nothing else
Terminal-Bench 4 (Vals AI) 12.6%(Mini-SWE-agent) $8.22 per test Nothing else
Vibe Code Bench (Vals AI) 81.5%(OpenHands) $1.90 per test Nothing else
ProgramBench (Vals AI) 0.5% $8.46 per test Nothing else
SREBench (Vals AI) 1.9% $6.67 per test Nothing else
SWE-bench Multimodal (Vals AI) 43.1% $0.30 per test Nothing else
CyberBench (Vals AI) 72.7% $1.27 per test Nothing else
Tax Agent Bench (Vals AI) 38.9% $0.14 per test Nothing else
Legal Research Bench (Vals AI) 46.6% $0.29 per test Nothing else
Harvey's Legal Agent Benchmark (Vals AI) 21.7% $1.23 per test Nothing else
BioMysteryBench (Vals AI) 70.0% $0.27 per test Nothing else
Terminal-Bench-Science (Vals AI) 2.9%(Mini-SWE-agent) $5.55 per test Nothing else
25 more boards
What each board publishes about the runs behind Thinking Machines: Inkling 2 Small's results, continued
Vals Science Index 32.7% $1.99 per test Nothing else
MysteryMechanism (Vals AI) 25.2% $0.16 per test Nothing else
MathArena 42.4% $0.5323 expected cost per problem Nothing else
LMArena WebDev 1647 Elo Not published Votes 990 · Interval (±) ±19.4
SAGE (Vals AI) 88.6% Not published Latency, as printed 41 s
APEX-Agents 46.8% Not published Mean score 60.9%
LMArena Text 1403 Elo Not published Votes 2,669 · Interval (±) ±11.7
LMArena Text: coding 1455 Elo Not published Votes 619 · Interval (±) ±23.4
LMArena Text: hard prompts 1421 Elo Not published Votes 1,665 · Interval (±) ±14.8
LMArena Text: instruction following 1408 Elo Not published Votes 929 · Interval (±) ±19.7
LMArena Text: creative writing 1348 Elo Not published Votes 643 · Interval (±) ±24.4
LMArena Text: English 1418 Elo Not published Votes 901 · Interval (±) ±19.9
LMArena Text: non-English 1390 Elo Not published Votes 1,768 · Interval (±) ±14.2
LMArena Text: Russian 1377 Elo Not published Votes 448 · Interval (±) ±27.5
LMArena Text: multi-turn 1408 Elo Not published Votes 399 · Interval (±) ±28.7
LMArena Text: longer queries 1403 Elo Not published Votes 1,157 · Interval (±) ±18.4
LMArena Text: expert 1478 Elo Not published Votes 251 · Interval (±) ±37.4
LMArena Text: hard prompts in English 1424 Elo Not published Votes 578 · Interval (±) ±24.7
LMArena Text: software and IT 1443 Elo Not published Votes 960 · Interval (±) ±19.1
LMArena Text: science 1409 Elo Not published Votes 380 · Interval (±) ±31.3
LMArena Text: business and finance 1415 Elo Not published Votes 408 · Interval (±) ±28.3
LMArena Text: writing and language 1381 Elo Not published Votes 823 · Interval (±) ±21.3
LMArena Text: entertainment and media 1359 Elo Not published Votes 709 · Interval (±) ±23.0
LMArena WebDev: React 1660 Elo Not published Votes 639 · Interval (±) ±24.8
LMArena WebDev: HTML 1661 Elo Not published Votes 130 · Interval (±) ±55.0

Results Thinking Machines reported at launch

Thinking Machines published these results in “Inkling 2 Small” with the model's release on November 9, 2026. They are the maker's own numbers, not independent measurements, and they do not count toward the LLMBenchmark Index.

Results Thinking Machines reported for this model
BenchmarkScoreSettingSource
AA-3D 1021 Not published November 9, 2026 (model release)
AA-AnalystAgent 51.2% Not published November 9, 2026 (model release)
AA-Briefcase v1.1 1527 Not published November 9, 2026 (model release)
AA Index v5.0 30.6 Not published November 9, 2026 (model release)
AA-LCR v1.1 83.3% Not published November 9, 2026 (model release)
AA-Omniscience v1.1 non-hallucination rate 73.3% Not published November 9, 2026 (model release)
AA-Omniscience v1.1 score 16.1 Not published November 9, 2026 (model release)
Apex-Accounting v1.1 pass@1 14.5% Not published November 9, 2026 (model release)
ARC-AGI-1 96.5% Not published November 9, 2026 (model release)
ArxivMath 10/2026 27.7% Not published November 9, 2026 (model release)
ATLAS-Finance v1.1 6.0% Not published November 9, 2026 (model release)
BabyVision original / with Python 68.6% Not published November 9, 2026 (model release)
BabyVision original / with Python 93.6% Not published November 9, 2026 (model release)
BioMysteryBench terminus v2 70.0% Not published November 9, 2026 (model release)
BrokenArxiv 10/2026 63.3% Not published November 9, 2026 (model release)
BrowseComp Inkling 2 Small with compaction 90.2% Not published November 9, 2026 (model release)
BVB 71.6% Not published November 9, 2026 (model release)
Chartography original / with Python 36.7% Not published November 9, 2026 (model release)
Chartography original / with Python 82.1% Not published November 9, 2026 (model release)
Charxiv RQ (original / with python) 85.6% Not published November 9, 2026 (model release)
Charxiv RQ (original / with python) 89.1% Not published November 9, 2026 (model release)
Code Arena (WebDev) 1653 Not published November 9, 2026 (model release)
Code2Video-AA 1020 Not published November 9, 2026 (model release)
ComplexConstraints v1.0 44.5% Not published November 9, 2026 (model release)
CritPt v2 Full / Hard 55.7% Not published November 9, 2026 (model release)
CritPt v2 Full / Hard 35.0% Not published November 9, 2026 (model release)
CyberBench v1.1 72.7% Not published November 9, 2026 (model release)
DAYJOB (Finance) 14.3% Not published November 9, 2026 (model release)
DAYJOB (Healthcare) 6.4% Not published November 9, 2026 (model release)
DeepFinance 29.8% Not published November 9, 2026 (model release)
DeepSearchQA Inkling 2 Small with compaction 90.9% Not published November 9, 2026 (model release)
DeepSWE v1.1 mini-swe-agent v2.4.6 72.1% Not published November 9, 2026 (model release)
Design Arena: game dev 1424 Not published November 9, 2026 (model release)
DesignArena 3D Design 1457 Not published November 9, 2026 (model release)
DesignArena Web Apps 1286 Not published November 9, 2026 (model release)
DesignArena Website 1331 Not published November 9, 2026 (model release)
Diligence Bench Best harness 58.1% Not published November 9, 2026 (model release)
DistressBench 82.0% Not published November 9, 2026 (model release)
EnterpriseBench-CoreCraft 71.8% Not published November 9, 2026 (model release)
EnterpriseOps-Gym 46.8% Not published November 9, 2026 (model release)
ARC-AGI-2 81.7% Not published November 9, 2026 (model release)
Excel Modeling Benchmark v1.1 69.5% Not published November 9, 2026 (model release)
Finance Agent v2.1 67.5% Not published November 9, 2026 (model release)
FORTRESS (adversarial) 83.8% Not published November 9, 2026 (model release)
FORTRESS (benign) 79.7% Not published November 9, 2026 (model release)
FrontierCode v2.0 stirrup v0.2.1 25.4% Not published November 9, 2026 (model release)
GDP.pdf 25.2% Not published November 9, 2026 (model release)
GDPval-AA 2.1 1630 Not published November 9, 2026 (model release)
Global-MMLU-Lite 91.0% Not published November 9, 2026 (model release)
Harvey LAB v1.1 21.7% Not published November 9, 2026 (model release)
HLE-Diamond 28.7% Not published November 9, 2026 (model release)
HLE (text only) 44.1% Not published November 9, 2026 (model release)
HoneyBench v0.2 (↓) 52.6% Not published November 9, 2026 (model release)
Humanity’s Sixth Sense 33.3% Not published November 9, 2026 (model release)
JobBench 70.5 Not published November 9, 2026 (model release)
Legal Research Bench 46.6% Not published November 9, 2026 (model release)
LongBench v2 70.6% Not published November 9, 2026 (model release)
MCP Atlas Full / Public 85.4% Not published November 9, 2026 (model release)
MCP Atlas Full / Public 85.0% Not published November 9, 2026 (model release)
MDPBench 81.4% Not published November 9, 2026 (model release)
MMMU Pro (Standard 10) 81.6% Not published November 9, 2026 (model release)
MuirBench 79.2% Not published November 9, 2026 (model release)
MysteryMechanism 25.2% Not published November 9, 2026 (model release)
OmniDocBench v1.6 94.6% Not published November 9, 2026 (model release)
PatchEval 79.6% Not published November 9, 2026 (model release)
PerceptionBench 64.7% Not published November 9, 2026 (model release)
PMPP-Hard (AUC, 0–10h) pi v0.83.0 494.3 Not published November 9, 2026 (model release)
PostTrainBench v1.2 Inkling 2 Small in Claude Code 31.9% Not published November 9, 2026 (model release)
SAGE v1.1 88.6% Not published November 9, 2026 (model release)
ScreenSpot Pro original / with Python 83.8% Not published November 9, 2026 (model release)
ScreenSpot Pro original / with Python 92.0% Not published November 9, 2026 (model release)
SimpleVQA 68.2 Not published November 9, 2026 (model release)
StrongREJECT (none) 97.1% Not published November 9, 2026 (model release)
Sudo L7 14.1% Not published November 9, 2026 (model release)
SWE-Atlas v1.1 mini-swe-agent v2.4.6 61.9% Not published November 9, 2026 (model release)
SWEBench Pro v2 (Hard) mini-swe-agent v2.4.6 86.3% Not published November 9, 2026 (model release)
Tau 3 Banking v1.0.1 40.4% Not published November 9, 2026 (model release)
Tax Agent Bench 65.8% Not published November 9, 2026 (model release)
Terminal Bench Science v0.1 mini-swe-agent v2.4.6 5.7% Not published November 9, 2026 (model release)
Vals Index v2.2 56.1% Not published November 9, 2026 (model release)
VIALS original / with stirrup v0.2.1 34.6% Not published November 9, 2026 (model release)
VIALS original / with stirrup v0.2.1 57.8% Not published November 9, 2026 (model release)
Vibe Code Bench v1.1 openhands (vals) 81.6% Not published November 9, 2026 (model release)
ZeroBench (main) original / with Python 29.0% Not published November 9, 2026 (model release)
ZeroBench (main) original / with Python 44.0% Not published November 9, 2026 (model release)

Thinking Machines Inkling 2 Small: launch results and current rankings

Thinking Machines Inkling 2 Small API providers

On these lists

Compare with models of a similar score

All 104 comparisons for Inkling 2 Small