LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Opus 4.1 vs Gemini 3.8 Flash

Updated October 21, 2026. 58 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Opus 4.1Anthropic
Coding
27.2
Overall
22.8
Output $/M
$75.00
0
Gemini 3.8 FlashGoogle
Coding
70.5
Overall
40.9
Output $/M
$4.125
58
vs boards won of 58 shared

Decision reading

Pick Gemini 3.8 Flash for coding: it scores 70.5 on the Vibe Coding Index against 27.2 for Claude Opus 4.1.

Claude Opus 4.1 is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Shared results
58
Claude Opus 4.1 only
13
Gemini 3.8 Flash only
68
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Opus 4.1 27.2 from 1 benchmark, Gemini 3.8 Flash 70.5 from 2 benchmarks.
Widest category
Math, 27.3 points apart on average over 5 shared benchmarks.
Widest single gap
FrontierMath, tiers 1 to 3: Claude Opus 4.1 12.6% against Gemini 3.8 Flash 68.4%, 55.8 points apart on a 0 to 100 scale.
Output price
Claude Opus 4.1 $75.00 against Gemini 3.8 Flash $4.125 per million output tokens, 18.2x apart.
Context window
Claude Opus 4.1 takes 200K tokens, Gemini 3.8 Flash 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Opus 4.1BarsGemini 3.8 FlashTies
Coding06
Intelligence02
Reasoning07
Math05
Knowledge09
Web design08
General021
All shared boards058
CodingLike-for-likeFour of these boards feed the Vibe Coding Index06
Coding benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
LiveBench codingNot measured82.2%Only Gemini 3.8 Flash measured
LMArena WebDev13901585Gemini 3.8 Flash
AA Coding IndexNot measured76.3Only Gemini 3.8 Flash measured
LiveCodeBench (Vals AI)66.5%89.5%Gemini 3.8 Flash
SWE-bench Verified (Vals AI)Not measured80.0%Only Gemini 3.8 Flash measured
Terminal-Bench 4 (Vals AI)Not measured19.7%Only Gemini 3.8 Flash measured
Vibe Code Bench (Vals AI)Not measured78.7%Only Gemini 3.8 Flash measured
Code migration (Vals AI)Not measured36.5%Only Gemini 3.8 Flash measured
ProgramBench (Vals AI)Not measured1.0%Only Gemini 3.8 Flash measured
IOI (Vals AI)Not measured56.9%Only Gemini 3.8 Flash measured
Terminal-Bench 2.1 (Vals AI)Not measured81.3%Only Gemini 3.8 Flash measured
SWE-bench Multimodal (Vals AI)Not measured40.8%Only Gemini 3.8 Flash measured
Vibe Code Bench 1-100 (Vals AI)Not measured18.8%Only Gemini 3.8 Flash measured
SkillsBench (Vals AI)Not measured58.0%Only Gemini 3.8 Flash measured
CyberBench (Vals AI)Not measured43.8%Only Gemini 3.8 Flash measured
SciCodeNot measured56.6%Only Gemini 3.8 Flash measured
Terminal-Bench38.0%Not measuredOnly Claude Opus 4.1 measured
FrontierCodeNot measured41.2%Only Gemini 3.8 Flash measured
FrontierSWENot measured19.6%Only Gemini 3.8 Flash measured
WeirdML45.9%84.8%Gemini 3.8 Flash
Cybench42.0%Not measuredOnly Claude Opus 4.1 measured
ALE-BenchNot measured1269.7Only Gemini 3.8 Flash measured
LMArena Text: coding14791508Gemini 3.8 Flash
LMArena Text: software and IT14561507Gemini 3.8 Flash
LMArena WebDev: ReactNot measured1577Only Gemini 3.8 Flash measured
LMArena WebDev: HTML13991616Gemini 3.8 Flash
LMArena WebDev: from an imageNot measured1593Only Gemini 3.8 Flash measured
Neither model has a result on the other 11 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02
Intelligence benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
AA Intelligence Index22.840.9Gemini 3.8 Flash
Epoch Capabilities Index144.1157.4Gemini 3.8 Flash
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index28 boards, none shared
Agentic work benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
AA Agentic IndexNot measured40.2Only Gemini 3.8 Flash measured
Design Arena: agents building web appsNot measured1238Only Gemini 3.8 Flash measured
Design Arena: agents building full-stack appsNot measured1244Only Gemini 3.8 Flash measured
Design Arena: agents building mobile appsNot measured1236Only Gemini 3.8 Flash measured
Design Arena: agents building Android appsNot measured1078Only Gemini 3.8 Flash measured
Design Arena: agents building Godot gamesNot measured1273Only Gemini 3.8 Flash measured
Design Arena: PowerPoint slidesNot measured1178Only Gemini 3.8 Flash measured
Design Arena: spreadsheetsNot measured1052Only Gemini 3.8 Flash measured
LiveBench researchNot measured79.1%Only Gemini 3.8 Flash measured
LiveBench browserNot measured64.0%Only Gemini 3.8 Flash measured
LiveBench long agenticNot measured30.1%Only Gemini 3.8 Flash measured
SREBench (Vals AI)Not measured11.1%Only Gemini 3.8 Flash measured
Finance Agent (Vals AI)Not measured61.4%Only Gemini 3.8 Flash measured
Tax Agent Bench (Vals AI)Not measured32.1%Only Gemini 3.8 Flash measured
Legal Research Bench (Vals AI)Not measured38.9%Only Gemini 3.8 Flash measured
Harvey's Legal Agent Benchmark (Vals AI)Not measured12.1%Only Gemini 3.8 Flash measured
Excel Modeling Benchmark (Vals AI)Not measured72.2%Only Gemini 3.8 Flash measured
BioMysteryBench (Vals AI)Not measured62.2%Only Gemini 3.8 Flash measured
Terminal-Bench-Science (Vals AI)Not measured8.6%Only Gemini 3.8 Flash measured
Vals Science IndexNot measured35.8%Only Gemini 3.8 Flash measured
Time Horizon Index (Vals AI)Not measured18.8%Only Gemini 3.8 Flash measured
CUA-bench (Vals AI)Not measured4.2%Only Gemini 3.8 Flash measured
APEX-AgentsNot measured64.3%Only Gemini 3.8 Flash measured
METR time horizons66.8%Not measuredOnly Claude Opus 4.1 measured
Remote Labor IndexNot measured5.8%Only Gemini 3.8 Flash measured
GDPval43.6%Not measuredOnly Claude Opus 4.1 measured
DeepResearch Bench48.3%Not measuredOnly Claude Opus 4.1 measured
Vending-Bench 2Not measured$5,094Only Gemini 3.8 Flash measured
Neither model has a result on the other 11 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index07
Reasoning benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
GPQA Diamond76.3%94.4%Gemini 3.8 Flash
LiveBench reasoningNot measured89.3%Only Gemini 3.8 Flash measured
MysteryMechanism (Vals AI)Not measured36.5%Only Gemini 3.8 Flash measured
MMMU Pro (Vals AI)77.5%89.1%Gemini 3.8 Flash
GPQA Diamond (Artificial Analysis run)Not measured95.3%Only Gemini 3.8 Flash measured
Humanity's Last Exam (Artificial Analysis run)Not measured47.8%Only Gemini 3.8 Flash measured
GPQA Diamond (Epoch AI run)77.3%95.4%Gemini 3.8 Flash
ARC-AGINot measured98.5%Only Gemini 3.8 Flash measured
ARC-AGI-2Not measured89.2%Only Gemini 3.8 Flash measured
SimpleBench60.0%Not measuredOnly Claude Opus 4.1 measured
Chess puzzlesNot measured58.0%Only Gemini 3.8 Flash measured
Mystery game puzzles21.0%47.0%Gemini 3.8 Flash
EBR-bench7.9%Not measuredOnly Claude Opus 4.1 measured
VPCT35.0%Not measuredOnly Claude Opus 4.1 measured
LMArena Text: hard prompts14421509Gemini 3.8 Flash
LMArena Text: expert14381526Gemini 3.8 Flash
LMArena Text: hard prompts in English14511504Gemini 3.8 Flash
LMArena Vision: diagramsNot measured1345Only Gemini 3.8 Flash measured
LMArena Vision: homeworkNot measured1351Only Gemini 3.8 Flash measured
Neither model has a result on the other 2 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index05
Math benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
AIME78.2%Not measuredOnly Claude Opus 4.1 measured
MATH 500 (Vals AI)95.4%Not measuredOnly Claude Opus 4.1 measured
MGSM (Vals AI)94.4%Not measuredOnly Claude Opus 4.1 measured
OTIS Mock AIME68.9%98.9%Gemini 3.8 Flash
FrontierMath, tiers 1 to 312.6%68.4%Gemini 3.8 Flash
FrontierMath, tier 42.4%22.0%Gemini 3.8 Flash
ProofBenchNot measured48.0%Only Gemini 3.8 Flash measured
LMArena Text: math14311532Gemini 3.8 Flash
LMArena Text: mathematical work14341519Gemini 3.8 Flash
Neither model has a result on the other 4 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index09
Knowledge benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
MMLU Pro87.9%90.2%Gemini 3.8 Flash
LegalBench (Vals AI)83.5%87.0%Gemini 3.8 Flash
TaxEval (Vals AI)73.7%74.5%Gemini 3.8 Flash
MortgageTax (Vals AI)61.1%65.3%Gemini 3.8 Flash
MedQA (Vals AI)93.6%Not measuredOnly Claude Opus 4.1 measured
MedCode (Vals AI)47.2%48.1%Gemini 3.8 Flash
SimpleQA VerifiedNot measured69.7%Only Gemini 3.8 Flash measured
LMArena Text: science14221523Gemini 3.8 Flash
LMArena Text: medicine and healthcare14161508Gemini 3.8 Flash
LMArena Text: legal and government14211497Gemini 3.8 Flash
LMArena Text: business and finance14061479Gemini 3.8 Flash
Neither model has a result on the other 6 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index08
Web design benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
Design Arena: websites11771301Gemini 3.8 Flash
Design Arena: UI components11641318Gemini 3.8 Flash
Design Arena: game dev11721305Gemini 3.8 Flash
Design Arena: data viz11661269Gemini 3.8 Flash
Design Arena: 3D11531295Gemini 3.8 Flash
Design Arena: all code categories11711304Gemini 3.8 Flash
Design Arena: SVG11521295Gemini 3.8 Flash
Design Arena: ASCII art11671264Gemini 3.8 Flash
LiveBench designNot measured72.7%Only Gemini 3.8 Flash measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index021
General benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
Vals IndexNot measured56.0%Only Gemini 3.8 Flash measured
LiveBench data analysisNot measured54.0%Only Gemini 3.8 Flash measured
Public Benefits Bench (Vals AI)Not measured65.3%Only Gemini 3.8 Flash measured
SAGE (Vals AI)31.4%35.1%Gemini 3.8 Flash
MedScribe (Vals AI)73.9%84.5%Gemini 3.8 Flash
Long context reasoning (AA-LCR)Not measured84.0%Only Gemini 3.8 Flash measured
DTBench80.0%95.7%Gemini 3.8 Flash
LMCA37.1%52.9%Gemini 3.8 Flash
Creative writing (Lech Mazur)84.7%Not measuredOnly Claude Opus 4.1 measured
Surface Evolver BenchNot measured76.9%Only Gemini 3.8 Flash measured
Furniture assemblyNot measured31.7%Only Gemini 3.8 Flash measured
LMArena Text14191499Gemini 3.8 Flash
LMArena Text: instruction following14351492Gemini 3.8 Flash
LMArena Text: creative writing14121488Gemini 3.8 Flash
LMArena VisionNot measured1315Only Gemini 3.8 Flash measured
LMArena Text: English14331498Gemini 3.8 Flash
LMArena Text: non-English14051491Gemini 3.8 Flash
LMArena Text: Chinese14271553Gemini 3.8 Flash
LMArena Text: German14131501Gemini 3.8 Flash
LMArena Text: Japanese13771507Gemini 3.8 Flash
LMArena Text: Korean13811464Gemini 3.8 Flash
LMArena Text: French14331496Gemini 3.8 Flash
LMArena Text: Spanish14481487Gemini 3.8 Flash
LMArena Text: Russian14221514Gemini 3.8 Flash
LMArena Text: Polish14131497Gemini 3.8 Flash
LMArena Text: multi-turn14441503Gemini 3.8 Flash
LMArena Text: longer queries14551507Gemini 3.8 Flash
LMArena Text: writing and language14181494Gemini 3.8 Flash
LMArena Text: entertainment and media13981480Gemini 3.8 Flash
LMArena Vision: EnglishNot measured1318Only Gemini 3.8 Flash measured
LMArena Vision: ChineseNot measured1416Only Gemini 3.8 Flash measured
LMArena Vision: reading textNot measured1333Only Gemini 3.8 Flash measured
LMArena Vision: humorNot measured1321Only Gemini 3.8 Flash measured
LMArena Vision: creative writingNot measured1299Only Gemini 3.8 Flash measured
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Opus 4.1 and Gemini 3.8 Flash
BenchmarkClaude Opus 4.1Gemini 3.8 FlashLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Opus 4.1$0.052Fits in one request
Gemini 3.8 Flash$0.0029Fits in one request

Gemini 3.8 Flash costs less

Repository review

50K input + 3K output tokens

Claude Opus 4.1$0.975Fits in one request
Gemini 3.8 Flash$0.054Fits in one request

Gemini 3.8 Flash costs less

Agent loop

200K input + 10K output tokens

Claude Opus 4.1$3.75Exceeds the context window
Gemini 3.8 Flash$0.206Fits in one request

Gemini 3.8 Flash costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Opus 4.1 and Gemini 3.8 Flash
SpecificationAnthropic Claude Opus 4.1Google Gemini 3.8 Flash
MakerAnthropicGoogle
WeightsNo public weights listedNo public weights listed
ReleasedAugust 5, 2025September 2, 2026
Context window200K1.05M
Input $/Mtok$15.00$0.825
Output $/Mtok$75.00$4.125
Coding index27.270.5
Independent measurements behind it12
Cost per solved taskNot computable$2.74
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Opus 4.1 better than Gemini 3.8 Flash for coding?

Pick Gemini 3.8 Flash for coding: it scores 70.5 on the Vibe Coding Index against 27.2 for Claude Opus 4.1. Claude Opus 4.1 is neither cheaper nor larger in context, and leads no benchmark both models were measured on.

Which is cheaper, Claude Opus 4.1 or Gemini 3.8 Flash?

Claude Opus 4.1 costs $15.00 per million input tokens and $75.00 per million output tokens; Gemini 3.8 Flash costs $0.825 and $4.125. Cost per solved task is known for Gemini 3.8 Flash only.

Which has the bigger context window, Claude Opus 4.1 or Gemini 3.8 Flash?

Gemini 3.8 Flash, with 1.05M tokens against 200K.

How many benchmarks is the Claude Opus 4.1 vs Gemini 3.8 Flash comparison based on?

58 benchmarks have a result for both models as of October 21, 2026. Claude Opus 4.1's coding index rests on 1 independent benchmark and Gemini 3.8 Flash's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next