LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Opus 4.8 vs Kimi K2 Thinking

Updated October 21, 2026. 17 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Opus 4.8Anthropic
Coding
66.0
Overall
41.8
Output $/M
$25.00
16
Kimi K2 ThinkingMoonshot AI
Coding
63.4
Overall
22.0
Output $/M
$2.50
1
vs boards won of 17 shared

Decision reading

Pick Claude Opus 4.8 for coding: it scores 66.0 on the Vibe Coding Index against 63.4 for Kimi K2 Thinking.

Pick Kimi K2 Thinking when output tokens cost 10.0x less, or when a solved task costs $0.61 against $2.17.

Shared results
17
Claude Opus 4.8 only
109
Kimi K2 Thinking only
13
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Opus 4.8 66.0 from 2 benchmarks, Kimi K2 Thinking 63.4 from 1 benchmark.
Widest category
Coding, 30.1 points apart on average over 4 shared benchmarks.
Widest single gap
WeirdML: Claude Opus 4.8 82.9% against Kimi K2 Thinking 42.8%, 40.1 points apart on a 0 to 100 scale.
Output price
Claude Opus 4.8 $25.00 against Kimi K2 Thinking $2.50 per million output tokens, 10.0x apart.
Context window
Claude Opus 4.8 takes 1M tokens, Kimi K2 Thinking 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Opus 4.8BarsKimi K2 ThinkingTies
Coding40
Intelligence20
Agentic work10
Reasoning30
Knowledge40
Web design10
General11
All shared boards161
CodingLike-for-likeFour of these boards feed the Vibe Coding Index40
Coding benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
SWE-bench VerifiedNot measured63.4%Only Kimi K2 Thinking measured
LiveBench coding77.3%Not measuredOnly Claude Opus 4.8 measured
LMArena WebDev1556Not measuredOnly Claude Opus 4.8 measured
AA Coding Index74.3Not measuredOnly Claude Opus 4.8 measured
LiveCodeBench (Vals AI)87.8%63.1%Claude Opus 4.8
SWE-bench Verified (Vals AI)88.6%60.2%Claude Opus 4.8
Terminal-Bench 4 (Vals AI)23.2%Not measuredOnly Claude Opus 4.8 measured
Vibe Code Bench (Vals AI)82.7%Not measuredOnly Claude Opus 4.8 measured
Code migration (Vals AI)47.3%Not measuredOnly Claude Opus 4.8 measured
ProgramBench (Vals AI)1.0%Not measuredOnly Claude Opus 4.8 measured
Terminal-Bench 2.1 (Vals AI)71.9%Not measuredOnly Claude Opus 4.8 measured
SkillsBench (Vals AI)59.2%Not measuredOnly Claude Opus 4.8 measured
LiveCodeBench (Artificial Analysis run)Not measured85.3%Only Kimi K2 Thinking measured
SciCode54.4%Not measuredOnly Claude Opus 4.8 measured
Terminal-Bench Hard (Artificial Analysis run)58.3%31.1%Claude Opus 4.8
Terminal-BenchNot measured35.7%Only Kimi K2 Thinking measured
FrontierCode46.5%Not measuredOnly Claude Opus 4.8 measured
GSO-Bench47.1%Not measuredOnly Claude Opus 4.8 measured
WeirdML82.9%42.8%Claude Opus 4.8
ALE-BenchNot measured597.5Only Kimi K2 Thinking measured
LMArena Text: coding1490Not measuredOnly Claude Opus 4.8 measured
LMArena Text: software and IT1488Not measuredOnly Claude Opus 4.8 measured
LMArena WebDev: React1557Not measuredOnly Claude Opus 4.8 measured
LMArena WebDev: HTML1543Not measuredOnly Claude Opus 4.8 measured
Neither model has a result on the other 14 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
AA Intelligence Index41.822.0Claude Opus 4.8
Epoch Capabilities Index159.0145.8Claude Opus 4.8
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
AA Agentic Index41.9Not measuredOnly Claude Opus 4.8 measured
Design Arena: agents building web apps1233Not measuredOnly Claude Opus 4.8 measured
Design Arena: agents building full-stack apps1249Not measuredOnly Claude Opus 4.8 measured
Design Arena: agents building mobile apps1222Not measuredOnly Claude Opus 4.8 measured
Design Arena: agents building Android apps1237Not measuredOnly Claude Opus 4.8 measured
Design Arena: agents building Godot games1231Not measuredOnly Claude Opus 4.8 measured
Design Arena: agents building games1238Not measuredOnly Claude Opus 4.8 measured
Design Arena: HTML slides1221Not measuredOnly Claude Opus 4.8 measured
Design Arena: PowerPoint slides1227Not measuredOnly Claude Opus 4.8 measured
LiveBench research81.8%Not measuredOnly Claude Opus 4.8 measured
LiveBench browser96.0%Not measuredOnly Claude Opus 4.8 measured
LiveBench long agentic48.3%Not measuredOnly Claude Opus 4.8 measured
Finance Agent (Vals AI)53.9%Not measuredOnly Claude Opus 4.8 measured
Tax Agent Bench (Vals AI)30.0%Not measuredOnly Claude Opus 4.8 measured
Legal Research Bench (Vals AI)43.8%Not measuredOnly Claude Opus 4.8 measured
Excel Modeling Benchmark (Vals AI)69.4%Not measuredOnly Claude Opus 4.8 measured
Terminal-Bench-Science (Vals AI)4.3%Not measuredOnly Claude Opus 4.8 measured
Time Horizon Index (Vals AI)11.8%Not measuredOnly Claude Opus 4.8 measured
τ²-Bench Telecom94.4%93.0%Claude Opus 4.8
APEX-Agents48.9%Not measuredOnly Claude Opus 4.8 measured
METR time horizonsNot measured59.2%Only Kimi K2 Thinking measured
Remote Labor Index8.3%Not measuredOnly Claude Opus 4.8 measured
OSWorld 2.020.6%Not measuredOnly Claude Opus 4.8 measured
DeepResearch Bench50.2%Not measuredOnly Claude Opus 4.8 measured
PostTrainBench33.8%Not measuredOnly Claude Opus 4.8 measured
Vending-Bench 2$5,787Not measuredOnly Claude Opus 4.8 measured
LMArena Search1204Not measuredOnly Claude Opus 4.8 measured
Neither model has a result on the other 12 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index30
Reasoning benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
GPQA Diamond92.4%78.5%Claude Opus 4.8
LiveBench reasoning89.2%Not measuredOnly Claude Opus 4.8 measured
MMMU Pro (Vals AI)86.6%Not measuredOnly Claude Opus 4.8 measured
GPQA Diamond (Artificial Analysis run)92.0%83.8%Claude Opus 4.8
Humanity's Last Exam (Artificial Analysis run)48.7%23.8%Claude Opus 4.8
GPQA Diamond (Epoch AI run)91.0%Not measuredOnly Claude Opus 4.8 measured
ARC-AGI92.5%Not measuredOnly Claude Opus 4.8 measured
ARC-AGI-272.1%Not measuredOnly Claude Opus 4.8 measured
SimpleBench64.8%Not measuredOnly Claude Opus 4.8 measured
Chess puzzles52.0%Not measuredOnly Claude Opus 4.8 measured
Mystery game puzzles36.0%Not measuredOnly Claude Opus 4.8 measured
EBR-bench28.6%Not measuredOnly Claude Opus 4.8 measured
LMArena Text: hard prompts1482Not measuredOnly Claude Opus 4.8 measured
LMArena Text: expert1503Not measuredOnly Claude Opus 4.8 measured
LMArena Text: hard prompts in English1487Not measuredOnly Claude Opus 4.8 measured
LMArena Vision: diagrams1315Not measuredOnly Claude Opus 4.8 measured
LMArena Vision: homework1337Not measuredOnly Claude Opus 4.8 measured
Neither model has a result on the other 4 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index10 boards, none shared
Math benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
AIMENot measured85.4%Only Kimi K2 Thinking measured
MGSM (Vals AI)Not measured90.2%Only Kimi K2 Thinking measured
AA Math IndexNot measured94.7Only Kimi K2 Thinking measured
AIME 2025 (Artificial Analysis run)Not measured94.7%Only Kimi K2 Thinking measured
OTIS Mock AIME98.3%Not measuredOnly Claude Opus 4.8 measured
FrontierMath, tiers 1 to 380.0%Not measuredOnly Claude Opus 4.8 measured
FrontierMath, tier 456.1%Not measuredOnly Claude Opus 4.8 measured
ProofBench69.0%Not measuredOnly Claude Opus 4.8 measured
LMArena Text: math1486Not measuredOnly Claude Opus 4.8 measured
LMArena Text: mathematical work1497Not measuredOnly Claude Opus 4.8 measured
Neither model has a result on the other 3 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index40
Knowledge benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
MMLU Pro89.6%81.1%Claude Opus 4.8
LegalBench (Vals AI)83.6%80.2%Claude Opus 4.8
CaseLaw (Vals AI)Not measured65.7%Only Kimi K2 Thinking measured
CorpFin (Vals AI)66.7%60.6%Claude Opus 4.8
TaxEval (Vals AI)75.6%71.7%Claude Opus 4.8
MortgageTax (Vals AI)69.9%Not measuredOnly Claude Opus 4.8 measured
MedQA (Vals AI)Not measured92.6%Only Kimi K2 Thinking measured
MedCode (Vals AI)53.2%Not measuredOnly Claude Opus 4.8 measured
MMLU Pro (Artificial Analysis run)Not measured84.8%Only Kimi K2 Thinking measured
SimpleQA Verified53.0%Not measuredOnly Claude Opus 4.8 measured
LMArena Text: science1477Not measuredOnly Claude Opus 4.8 measured
LMArena Text: medicine and healthcare1464Not measuredOnly Claude Opus 4.8 measured
LMArena Text: legal and government1477Not measuredOnly Claude Opus 4.8 measured
LMArena Text: business and finance1458Not measuredOnly Claude Opus 4.8 measured
Neither model has a result on the other 3 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index10
Web design benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
Design Arena: websites12581113Claude Opus 4.8
Design Arena: UI components1256Not measuredOnly Claude Opus 4.8 measured
Design Arena: game dev1264Not measuredOnly Claude Opus 4.8 measured
Design Arena: data viz1240Not measuredOnly Claude Opus 4.8 measured
Design Arena: 3D1223Not measuredOnly Claude Opus 4.8 measured
Design Arena: all code categories1255Not measuredOnly Claude Opus 4.8 measured
Design Arena: SVG1194Not measuredOnly Claude Opus 4.8 measured
Design Arena: ASCII art1276Not measuredOnly Claude Opus 4.8 measured
LiveBench design78.8%Not measuredOnly Claude Opus 4.8 measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index11
General benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
LiveBench data analysis66.0%Not measuredOnly Claude Opus 4.8 measured
Public Benefits Bench (Vals AI)68.1%Not measuredOnly Claude Opus 4.8 measured
SAGE (Vals AI)54.8%Not measuredOnly Claude Opus 4.8 measured
MedScribe (Vals AI)85.8%Not measuredOnly Claude Opus 4.8 measured
Vals Multimodal Index70.9%Not measuredOnly Claude Opus 4.8 measured
IFBench62.2%68.1%Kimi K2 Thinking
Long context reasoning (AA-LCR)77.7%72.0%Claude Opus 4.8
DTBench94.9%Not measuredOnly Claude Opus 4.8 measured
LMCA57.5%Not measuredOnly Claude Opus 4.8 measured
CL-benchNot measured17.6%Only Kimi K2 Thinking measured
Surface Evolver Bench87.5%Not measuredOnly Claude Opus 4.8 measured
Furniture assembly42.5%Not measuredOnly Claude Opus 4.8 measured
LMArena Text1461Not measuredOnly Claude Opus 4.8 measured
LMArena Text: instruction following1476Not measuredOnly Claude Opus 4.8 measured
LMArena Text: creative writing1454Not measuredOnly Claude Opus 4.8 measured
LMArena Vision1294Not measuredOnly Claude Opus 4.8 measured
LMArena Text: English1468Not measuredOnly Claude Opus 4.8 measured
LMArena Text: non-English1450Not measuredOnly Claude Opus 4.8 measured
LMArena Text: Chinese1506Not measuredOnly Claude Opus 4.8 measured
LMArena Text: German1472Not measuredOnly Claude Opus 4.8 measured
LMArena Text: Japanese1442Not measuredOnly Claude Opus 4.8 measured
LMArena Text: Korean1431Not measuredOnly Claude Opus 4.8 measured
LMArena Text: French1481Not measuredOnly Claude Opus 4.8 measured
LMArena Text: Spanish1465Not measuredOnly Claude Opus 4.8 measured
LMArena Text: Russian1474Not measuredOnly Claude Opus 4.8 measured
LMArena Text: Polish1459Not measuredOnly Claude Opus 4.8 measured
LMArena Text: multi-turn1476Not measuredOnly Claude Opus 4.8 measured
LMArena Text: longer queries1483Not measuredOnly Claude Opus 4.8 measured
LMArena Text: writing and language1461Not measuredOnly Claude Opus 4.8 measured
LMArena Text: entertainment and media1440Not measuredOnly Claude Opus 4.8 measured
LMArena Vision: English1293Not measuredOnly Claude Opus 4.8 measured
LMArena Vision: Chinese1346Not measuredOnly Claude Opus 4.8 measured
LMArena Vision: reading text1303Not measuredOnly Claude Opus 4.8 measured
LMArena Vision: humor1282Not measuredOnly Claude Opus 4.8 measured
LMArena Vision: creative writing1301Not measuredOnly Claude Opus 4.8 measured
LMArena Document1475Not measuredOnly Claude Opus 4.8 measured
Neither model has a result on the other 10 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Opus 4.8 and Kimi K2 Thinking
BenchmarkClaude Opus 4.8Kimi K2 ThinkingLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Opus 4.8$0.018Fits in one request
Kimi K2 Thinking$0.0019Fits in one request

Kimi K2 Thinking costs less

Repository review

50K input + 3K output tokens

Claude Opus 4.8$0.325Fits in one request
Kimi K2 Thinking$0.037Fits in one request

Kimi K2 Thinking costs less

Agent loop

200K input + 10K output tokens

Claude Opus 4.8$1.25Fits in one request
Kimi K2 Thinking$0.145Fits in one request

Kimi K2 Thinking costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Opus 4.8 and Kimi K2 Thinking
SpecificationAnthropic Claude Opus 4.8MoonshotAI Kimi K2 Thinking
MakerAnthropicMoonshot AI
WeightsNo public weights listedOpen weights
ReleasedMay 27, 2026November 6, 2025
Context window1M262K
Input $/Mtok$5.00$0.60
Output $/Mtok$25.00$2.50
Coding index66.063.4
Independent measurements behind it21
Cost per solved task$2.17$0.61
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Opus 4.8 better than Kimi K2 Thinking for coding?

Pick Claude Opus 4.8 for coding: it scores 66.0 on the Vibe Coding Index against 63.4 for Kimi K2 Thinking. Pick Kimi K2 Thinking when output tokens cost 10.0x less, or when a solved task costs $0.61 against $2.17.

Which is cheaper, Claude Opus 4.8 or Kimi K2 Thinking?

Claude Opus 4.8 costs $5.00 per million input tokens and $25.00 per million output tokens; Kimi K2 Thinking costs $0.60 and $2.50. Per solved SWE-bench Verified task, Claude Opus 4.8 costs $2.17 and Kimi K2 Thinking $0.61.

Which has the bigger context window, Claude Opus 4.8 or Kimi K2 Thinking?

Claude Opus 4.8, with 1M tokens against 262K.

How many benchmarks is the Claude Opus 4.8 vs Kimi K2 Thinking comparison based on?

17 benchmarks have a result for both models as of October 21, 2026. Claude Opus 4.8's coding index rests on 2 independent benchmarks and Kimi K2 Thinking's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next