LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Haiku 5.5 vs Gemini 3.8 Flash

Updated October 21, 2026. 61 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Haiku 5.5Anthropic
Coding
75.9
Overall
43.4
Output $/M
$0.50
33
Gemini 3.8 FlashGoogle
Coding
70.5
Overall
40.9
Output $/M
$4.125
27
vs boards won of 61 shared, 1 tied

Decision reading

Pick Claude Haiku 5.5 for coding: it scores 75.9 on the Vibe Coding Index against 70.5 for Gemini 3.8 Flash.

Pick Gemini 3.8 Flash when the context window is larger, 1.05M against 1M tokens, or when what matters is IOI (Vals AI) or SciCode, where it leads.

Shared results
61
Claude Haiku 5.5 only
1
Gemini 3.8 Flash only
65
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Haiku 5.5 75.9 from 2 benchmarks, Gemini 3.8 Flash 70.5 from 2 benchmarks.
Widest category
Knowledge, 24.7 points apart on average over 2 shared benchmarks.
Widest single gap
SimpleQA Verified: Claude Haiku 5.5 23.8% against Gemini 3.8 Flash 69.7%, 45.9 points apart on a 0 to 100 scale.
Output price
Claude Haiku 5.5 $0.50 against Gemini 3.8 Flash $4.125 per million output tokens, 8.3x apart.
Context window
Claude Haiku 5.5 takes 1M tokens, Gemini 3.8 Flash 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Haiku 5.5BarsGemini 3.8 FlashTies
Coding123
Intelligence20
Agentic work77
Reasoning08
Math301 tie
Knowledge11
Web design43
General45
All shared boards33271 tie
CodingLike-for-likeFour of these boards feed the Vibe Coding Index123
Coding benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
LiveBench coding91.4%82.2%Claude Haiku 5.5
LMArena WebDev15861585Claude Haiku 5.5
AA Coding IndexNot measured76.3Only Gemini 3.8 Flash measured
LiveCodeBench (Vals AI)Not measured89.5%Only Gemini 3.8 Flash measured
SWE-bench Verified (Vals AI)Not measured80.0%Only Gemini 3.8 Flash measured
Terminal-Bench 4 (Vals AI)36.4%19.7%Claude Haiku 5.5
Vibe Code Bench (Vals AI)90.4%78.7%Claude Haiku 5.5
Code migration (Vals AI)44.6%36.5%Claude Haiku 5.5
ProgramBench (Vals AI)2.5%1.0%Claude Haiku 5.5
IOI (Vals AI)47.3%56.9%Gemini 3.8 Flash
Terminal-Bench 2.1 (Vals AI)Not measured81.3%Only Gemini 3.8 Flash measured
SWE-bench Multimodal (Vals AI)44.0%40.8%Claude Haiku 5.5
Vibe Code Bench 1-100 (Vals AI)20.4%18.8%Claude Haiku 5.5
SkillsBench (Vals AI)Not measured58.0%Only Gemini 3.8 Flash measured
CyberBench (Vals AI)75.5%43.8%Claude Haiku 5.5
SciCode55.0%56.6%Gemini 3.8 Flash
FrontierCode46.4%41.2%Claude Haiku 5.5
FrontierSWE43.8%19.6%Claude Haiku 5.5
WeirdMLNot measured84.8%Only Gemini 3.8 Flash measured
ALE-BenchNot measured1269.7Only Gemini 3.8 Flash measured
LMArena Text: codingNot measured1508Only Gemini 3.8 Flash measured
LMArena Text: software and ITNot measured1507Only Gemini 3.8 Flash measured
LMArena WebDev: React16051577Claude Haiku 5.5
LMArena WebDev: HTML15691616Gemini 3.8 Flash
LMArena WebDev: from an imageNot measured1593Only Gemini 3.8 Flash measured
Neither model has a result on the other 13 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index20
Intelligence benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
AA Intelligence Index43.440.9Claude Haiku 5.5
Epoch Capabilities Index159.3157.4Claude Haiku 5.5
Agentic workLike-for-likePublic boards, shown as published, kept out of the index77
Agentic work benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
AA Agentic IndexNot measured40.2Only Gemini 3.8 Flash measured
Design Arena: agents building web appsNot measured1238Only Gemini 3.8 Flash measured
Design Arena: agents building full-stack appsNot measured1244Only Gemini 3.8 Flash measured
Design Arena: agents building mobile appsNot measured1236Only Gemini 3.8 Flash measured
Design Arena: agents building Android appsNot measured1078Only Gemini 3.8 Flash measured
Design Arena: agents building Godot gamesNot measured1273Only Gemini 3.8 Flash measured
Design Arena: PowerPoint slidesNot measured1178Only Gemini 3.8 Flash measured
Design Arena: spreadsheetsNot measured1052Only Gemini 3.8 Flash measured
LiveBench research81.9%79.1%Claude Haiku 5.5
LiveBench browser80.0%64.0%Claude Haiku 5.5
LiveBench long agentic57.6%30.1%Claude Haiku 5.5
SREBench (Vals AI)5.7%11.1%Gemini 3.8 Flash
Finance Agent (Vals AI)54.1%61.4%Gemini 3.8 Flash
Tax Agent Bench (Vals AI)31.9%32.1%Gemini 3.8 Flash
Legal Research Bench (Vals AI)43.3%38.9%Claude Haiku 5.5
Harvey's Legal Agent Benchmark (Vals AI)4.2%12.1%Gemini 3.8 Flash
Excel Modeling Benchmark (Vals AI)59.0%72.2%Gemini 3.8 Flash
BioMysteryBench (Vals AI)70.4%62.2%Claude Haiku 5.5
Terminal-Bench-Science (Vals AI)10.0%8.6%Claude Haiku 5.5
Vals Science Index38.5%35.8%Claude Haiku 5.5
Time Horizon Index (Vals AI)Not measured18.8%Only Gemini 3.8 Flash measured
CUA-bench (Vals AI)Not measured4.2%Only Gemini 3.8 Flash measured
APEX-Agents56.1%64.3%Gemini 3.8 Flash
Remote Labor IndexNot measured5.8%Only Gemini 3.8 Flash measured
Vending-Bench 2$3,602$5,094Gemini 3.8 Flash
Neither model has a result on the other 14 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index08
Reasoning benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
GPQA DiamondNot measured94.4%Only Gemini 3.8 Flash measured
LiveBench reasoning82.4%89.3%Gemini 3.8 Flash
MysteryMechanism (Vals AI)35.1%36.5%Gemini 3.8 Flash
MMMU Pro (Vals AI)Not measured89.1%Only Gemini 3.8 Flash measured
GPQA Diamond (Artificial Analysis run)Not measured95.3%Only Gemini 3.8 Flash measured
Humanity's Last Exam (Artificial Analysis run)44.4%47.8%Gemini 3.8 Flash
GPQA Diamond (Epoch AI run)89.6%95.4%Gemini 3.8 Flash
ARC-AGI89.0%98.5%Gemini 3.8 Flash
ARC-AGI-261.3%89.2%Gemini 3.8 Flash
Chess puzzles55.0%58.0%Gemini 3.8 Flash
Mystery game puzzles30.0%47.0%Gemini 3.8 Flash
EBR-bench43.8%Not measuredOnly Claude Haiku 5.5 measured
LMArena Text: hard promptsNot measured1509Only Gemini 3.8 Flash measured
LMArena Text: expertNot measured1526Only Gemini 3.8 Flash measured
LMArena Text: hard prompts in EnglishNot measured1504Only Gemini 3.8 Flash measured
LMArena Vision: diagramsNot measured1345Only Gemini 3.8 Flash measured
LMArena Vision: homeworkNot measured1351Only Gemini 3.8 Flash measured
Neither model has a result on the other 4 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index30
Math benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
OTIS Mock AIME98.9%98.9%Tie
FrontierMath, tiers 1 to 375.1%68.4%Claude Haiku 5.5
FrontierMath, tier 446.3%22.0%Claude Haiku 5.5
ProofBench89.0%48.0%Claude Haiku 5.5
LMArena Text: mathNot measured1532Only Gemini 3.8 Flash measured
LMArena Text: mathematical workNot measured1519Only Gemini 3.8 Flash measured
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index11
Knowledge benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
MMLU ProNot measured90.2%Only Gemini 3.8 Flash measured
LegalBench (Vals AI)Not measured87.0%Only Gemini 3.8 Flash measured
TaxEval (Vals AI)Not measured74.5%Only Gemini 3.8 Flash measured
MortgageTax (Vals AI)Not measured65.3%Only Gemini 3.8 Flash measured
MedCode (Vals AI)51.5%48.1%Claude Haiku 5.5
SimpleQA Verified23.8%69.7%Gemini 3.8 Flash
LMArena Text: scienceNot measured1523Only Gemini 3.8 Flash measured
LMArena Text: medicine and healthcareNot measured1508Only Gemini 3.8 Flash measured
LMArena Text: legal and governmentNot measured1497Only Gemini 3.8 Flash measured
LMArena Text: business and financeNot measured1479Only Gemini 3.8 Flash measured
Neither model has a result on the other 7 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index43
Web design benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
Design Arena: websites12631301Gemini 3.8 Flash
Design Arena: UI components12951318Gemini 3.8 Flash
Design Arena: game dev13151305Claude Haiku 5.5
Design Arena: data viz12921269Claude Haiku 5.5
Design Arena: 3D13431295Claude Haiku 5.5
Design Arena: all code categories12791304Gemini 3.8 Flash
Design Arena: SVGNot measured1295Only Gemini 3.8 Flash measured
Design Arena: ASCII artNot measured1264Only Gemini 3.8 Flash measured
LiveBench design83.1%72.7%Claude Haiku 5.5
GeneralLike-for-likePublic boards, shown as published, kept out of the index45
General benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
Vals Index58.7%56.0%Claude Haiku 5.5
LiveBench data analysis53.1%54.0%Gemini 3.8 Flash
Public Benefits Bench (Vals AI)63.2%65.3%Gemini 3.8 Flash
SAGE (Vals AI)45.8%35.1%Claude Haiku 5.5
MedScribe (Vals AI)89.5%84.5%Claude Haiku 5.5
Long context reasoning (AA-LCR)82.7%84.0%Gemini 3.8 Flash
DTBench95.0%95.7%Gemini 3.8 Flash
LMCA51.1%52.9%Gemini 3.8 Flash
Surface Evolver BenchNot measured76.9%Only Gemini 3.8 Flash measured
Furniture assembly47.5%31.7%Claude Haiku 5.5
LMArena TextNot measured1499Only Gemini 3.8 Flash measured
LMArena Text: instruction followingNot measured1492Only Gemini 3.8 Flash measured
LMArena Text: creative writingNot measured1488Only Gemini 3.8 Flash measured
LMArena VisionNot measured1315Only Gemini 3.8 Flash measured
LMArena Text: EnglishNot measured1498Only Gemini 3.8 Flash measured
LMArena Text: non-EnglishNot measured1491Only Gemini 3.8 Flash measured
LMArena Text: ChineseNot measured1553Only Gemini 3.8 Flash measured
LMArena Text: GermanNot measured1501Only Gemini 3.8 Flash measured
LMArena Text: JapaneseNot measured1507Only Gemini 3.8 Flash measured
LMArena Text: KoreanNot measured1464Only Gemini 3.8 Flash measured
LMArena Text: FrenchNot measured1496Only Gemini 3.8 Flash measured
LMArena Text: SpanishNot measured1487Only Gemini 3.8 Flash measured
LMArena Text: RussianNot measured1514Only Gemini 3.8 Flash measured
LMArena Text: PolishNot measured1497Only Gemini 3.8 Flash measured
LMArena Text: multi-turnNot measured1503Only Gemini 3.8 Flash measured
LMArena Text: longer queriesNot measured1507Only Gemini 3.8 Flash measured
LMArena Text: writing and languageNot measured1494Only Gemini 3.8 Flash measured
LMArena Text: entertainment and mediaNot measured1480Only Gemini 3.8 Flash measured
LMArena Vision: EnglishNot measured1318Only Gemini 3.8 Flash measured
LMArena Vision: ChineseNot measured1416Only Gemini 3.8 Flash measured
LMArena Vision: reading textNot measured1333Only Gemini 3.8 Flash measured
LMArena Vision: humorNot measured1321Only Gemini 3.8 Flash measured
LMArena Vision: creative writingNot measured1299Only Gemini 3.8 Flash measured
Neither model has a result on the other 13 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Haiku 5.5 and Gemini 3.8 Flash
BenchmarkClaude Haiku 5.5Gemini 3.8 FlashLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Haiku 5.5$0.0003Fits in one request
Gemini 3.8 Flash$0.0029Fits in one request

Claude Haiku 5.5 costs less

Repository review

50K input + 3K output tokens

Claude Haiku 5.5$0.0065Fits in one request
Gemini 3.8 Flash$0.054Fits in one request

Claude Haiku 5.5 costs less

Agent loop

200K input + 10K output tokens

Claude Haiku 5.5$0.025Fits in one request
Gemini 3.8 Flash$0.206Fits in one request

Claude Haiku 5.5 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Haiku 5.5 and Gemini 3.8 Flash
SpecificationAnthropic Claude Haiku 5.5Google Gemini 3.8 Flash
MakerAnthropicGoogle
WeightsNo public weights listedNo public weights listed
ReleasedOctober 7, 2026September 2, 2026
Context window1M1.05M
Input $/Mtok$0.10$0.825
Output $/Mtok$0.50$4.125
Coding index75.970.5
Independent measurements behind it22
Cost per solved taskNot computable$2.74
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Haiku 5.5 better than Gemini 3.8 Flash for coding?

Pick Claude Haiku 5.5 for coding: it scores 75.9 on the Vibe Coding Index against 70.5 for Gemini 3.8 Flash. Pick Gemini 3.8 Flash when the context window is larger, 1.05M against 1M tokens, or when what matters is IOI (Vals AI) or SciCode, where it leads.

Which is cheaper, Claude Haiku 5.5 or Gemini 3.8 Flash?

Claude Haiku 5.5 costs $0.10 per million input tokens and $0.50 per million output tokens; Gemini 3.8 Flash costs $0.825 and $4.125. Cost per solved task is known for Gemini 3.8 Flash only.

Which has the bigger context window, Claude Haiku 5.5 or Gemini 3.8 Flash?

Gemini 3.8 Flash, with 1.05M tokens against 1M.

How many benchmarks is the Claude Haiku 5.5 vs Gemini 3.8 Flash comparison based on?

61 benchmarks have a result for both models as of October 21, 2026. Claude Haiku 5.5's coding index rests on 2 independent benchmarks and Gemini 3.8 Flash's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/claude-haiku-5-5-vs-gemini-3-8-flash" title="Claude Haiku 5.5 vs Gemini 3.8 Flash, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/claude-haiku-5-5-vs-gemini-3-8-flash">LLMBenchmark.ai, Claude Haiku 5.5 vs Gemini 3.8 Flash</a></p>