LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Claude Haiku 5.5 vs Gemini 3.1 Flash Lite Preview

Updated October 21, 2026. 20 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Claude Haiku 5.5Anthropic
Coding
75.9
Overall
43.4
Output $/M
$0.50
19
Gemini 3.1 Flash Lite PreviewGoogle
Coding
8.1
Overall
15.6
Output $/M
$1.50
1
vs boards won of 20 shared

Decision reading

Pick Claude Haiku 5.5 for coding: it scores 75.9 on the Vibe Coding Index against 8.1 for Gemini 3.1 Flash Lite Preview.

Pick Gemini 3.1 Flash Lite Preview when the context window is larger, 1.05M against 1M tokens, or when the benchmark that matters is SAGE (Vals AI), where it leads.

Shared results
20
Claude Haiku 5.5 only
42
Gemini 3.1 Flash Lite Preview only
57
Like-for-like categories
6 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Claude Haiku 5.5 75.9 from 2 benchmarks, Gemini 3.1 Flash Lite Preview 8.1 from 1 benchmark.
Widest category
Coding, 48.0 points apart on average over 6 shared benchmarks.
Widest single gap
Vibe Code Bench (Vals AI): Claude Haiku 5.5 90.4% against Gemini 3.1 Flash Lite Preview 0.0%, 90.4 points apart on a 0 to 100 scale.
Output price
Claude Haiku 5.5 $0.50 against Gemini 3.1 Flash Lite Preview $1.50 per million output tokens, 3.0x apart.
Context window
Claude Haiku 5.5 takes 1M tokens, Gemini 3.1 Flash Lite Preview 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryClaude Haiku 5.5BarsGemini 3.1 Flash Lite PreviewTies
Coding60
Intelligence10
Agentic work40
Knowledge10
Web design60
General11
All shared boards191
CodingLike-for-likeFour of these boards feed the Vibe Coding Index60
Coding benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
LiveBench coding91.4%Not measuredOnly Claude Haiku 5.5 measured
LMArena WebDev15861257Claude Haiku 5.5
AA Coding IndexNot measured34.7Only Gemini 3.1 Flash Lite Preview measured
LiveCodeBench (Vals AI)Not measured80.1%Only Gemini 3.1 Flash Lite Preview measured
SWE-bench Verified (Vals AI)Not measured62.8%Only Gemini 3.1 Flash Lite Preview measured
Terminal-Bench 4 (Vals AI)36.4%Not measuredOnly Claude Haiku 5.5 measured
Vibe Code Bench (Vals AI)90.4%0.0%Claude Haiku 5.5
Code migration (Vals AI)44.6%4.6%Claude Haiku 5.5
ProgramBench (Vals AI)2.5%0.0%Claude Haiku 5.5
IOI (Vals AI)47.3%Not measuredOnly Claude Haiku 5.5 measured
Terminal-Bench 2.1 (Vals AI)Not measured34.1%Only Gemini 3.1 Flash Lite Preview measured
SWE-bench Multimodal (Vals AI)44.0%Not measuredOnly Claude Haiku 5.5 measured
Vibe Code Bench 1-100 (Vals AI)20.4%Not measuredOnly Claude Haiku 5.5 measured
CyberBench (Vals AI)75.5%Not measuredOnly Claude Haiku 5.5 measured
SciCode55.0%Not measuredOnly Claude Haiku 5.5 measured
FrontierCode46.4%Not measuredOnly Claude Haiku 5.5 measured
FrontierSWE43.8%Not measuredOnly Claude Haiku 5.5 measured
ALE-BenchNot measured797.7Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: codingNot measured1400Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: software and ITNot measured1413Only Gemini 3.1 Flash Lite Preview measured
LMArena WebDev: React16051245Claude Haiku 5.5
LMArena WebDev: HTML15691276Claude Haiku 5.5
LMArena WebDev: from an imageNot measured1336Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 15 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
AA Intelligence Index43.415.6Claude Haiku 5.5
Epoch Capabilities Index159.3Not measuredOnly Claude Haiku 5.5 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index40
Agentic work benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
AA Agentic IndexNot measured1.6Only Gemini 3.1 Flash Lite Preview measured
LiveBench research81.9%Not measuredOnly Claude Haiku 5.5 measured
LiveBench browser80.0%Not measuredOnly Claude Haiku 5.5 measured
LiveBench long agentic57.6%Not measuredOnly Claude Haiku 5.5 measured
SREBench (Vals AI)5.7%Not measuredOnly Claude Haiku 5.5 measured
Finance Agent (Vals AI)54.1%30.0%Claude Haiku 5.5
Tax Agent Bench (Vals AI)31.9%3.1%Claude Haiku 5.5
Legal Research Bench (Vals AI)43.3%3.4%Claude Haiku 5.5
Harvey's Legal Agent Benchmark (Vals AI)4.2%Not measuredOnly Claude Haiku 5.5 measured
Excel Modeling Benchmark (Vals AI)59.0%8.6%Claude Haiku 5.5
BioMysteryBench (Vals AI)70.4%Not measuredOnly Claude Haiku 5.5 measured
Terminal-Bench-Science (Vals AI)10.0%Not measuredOnly Claude Haiku 5.5 measured
Vals Science Index38.5%Not measuredOnly Claude Haiku 5.5 measured
APEX-Agents56.1%Not measuredOnly Claude Haiku 5.5 measured
Vending-Bench 2$3,602Not measuredOnly Claude Haiku 5.5 measured
Neither model has a result on the other 24 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index16 boards, none shared
Reasoning benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
GPQA DiamondNot measured81.1%Only Gemini 3.1 Flash Lite Preview measured
LiveBench reasoning82.4%Not measuredOnly Claude Haiku 5.5 measured
MysteryMechanism (Vals AI)35.1%Not measuredOnly Claude Haiku 5.5 measured
MMMU Pro (Vals AI)Not measured82.5%Only Gemini 3.1 Flash Lite Preview measured
Humanity's Last Exam (Artificial Analysis run)44.4%Not measuredOnly Claude Haiku 5.5 measured
GPQA Diamond (Epoch AI run)89.6%Not measuredOnly Claude Haiku 5.5 measured
ARC-AGI89.0%Not measuredOnly Claude Haiku 5.5 measured
ARC-AGI-261.3%Not measuredOnly Claude Haiku 5.5 measured
Chess puzzles55.0%Not measuredOnly Claude Haiku 5.5 measured
Mystery game puzzles30.0%Not measuredOnly Claude Haiku 5.5 measured
EBR-bench43.8%Not measuredOnly Claude Haiku 5.5 measured
LMArena Text: hard promptsNot measured1407Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: expertNot measured1398Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: hard prompts in EnglishNot measured1403Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: diagramsNot measured1242Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: homeworkNot measured1271Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 5 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index7 boards, none shared
Math benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
AIMENot measured83.3%Only Gemini 3.1 Flash Lite Preview measured
OTIS Mock AIME98.9%Not measuredOnly Claude Haiku 5.5 measured
FrontierMath, tiers 1 to 375.1%Not measuredOnly Claude Haiku 5.5 measured
FrontierMath, tier 446.3%Not measuredOnly Claude Haiku 5.5 measured
ProofBench89.0%Not measuredOnly Claude Haiku 5.5 measured
LMArena Text: mathNot measured1428Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: mathematical workNot measured1417Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 6 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index10
Knowledge benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
MMLU ProNot measured86.2%Only Gemini 3.1 Flash Lite Preview measured
LegalBench (Vals AI)Not measured83.8%Only Gemini 3.1 Flash Lite Preview measured
CaseLaw (Vals AI)Not measured55.0%Only Gemini 3.1 Flash Lite Preview measured
CorpFin (Vals AI)Not measured59.4%Only Gemini 3.1 Flash Lite Preview measured
TaxEval (Vals AI)Not measured71.8%Only Gemini 3.1 Flash Lite Preview measured
MortgageTax (Vals AI)Not measured68.0%Only Gemini 3.1 Flash Lite Preview measured
MedCode (Vals AI)51.5%47.6%Claude Haiku 5.5
SimpleQA Verified23.8%Not measuredOnly Claude Haiku 5.5 measured
LMArena Text: scienceNot measured1425Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: medicine and healthcareNot measured1428Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: legal and governmentNot measured1418Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: business and financeNot measured1389Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 5 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index60
Web design benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
Design Arena: websites12631083Claude Haiku 5.5
Design Arena: UI components12951071Claude Haiku 5.5
Design Arena: game dev13151029Claude Haiku 5.5
Design Arena: data viz12921045Claude Haiku 5.5
Design Arena: 3D13431048Claude Haiku 5.5
Design Arena: all code categories12791072Claude Haiku 5.5
Design Arena: SVGNot measured1052Only Gemini 3.1 Flash Lite Preview measured
Design Arena: ASCII artNot measured1166Only Gemini 3.1 Flash Lite Preview measured
LiveBench design83.1%Not measuredOnly Claude Haiku 5.5 measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index11
General benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
Vals Index58.7%Not measuredOnly Claude Haiku 5.5 measured
LiveBench data analysis53.1%Not measuredOnly Claude Haiku 5.5 measured
Public Benefits Bench (Vals AI)63.2%Not measuredOnly Claude Haiku 5.5 measured
SAGE (Vals AI)45.8%49.5%Gemini 3.1 Flash Lite Preview
MedScribe (Vals AI)89.5%63.9%Claude Haiku 5.5
Vals Multimodal IndexNot measured41.4%Only Gemini 3.1 Flash Lite Preview measured
Long context reasoning (AA-LCR)82.7%Not measuredOnly Claude Haiku 5.5 measured
DTBench95.0%Not measuredOnly Claude Haiku 5.5 measured
LMCA51.1%Not measuredOnly Claude Haiku 5.5 measured
Furniture assembly47.5%Not measuredOnly Claude Haiku 5.5 measured
LMArena TextNot measured1416Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: instruction followingNot measured1377Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: creative writingNot measured1401Only Gemini 3.1 Flash Lite Preview measured
LMArena VisionNot measured1240Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: EnglishNot measured1414Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: non-EnglishNot measured1410Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: ChineseNot measured1460Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: GermanNot measured1430Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: JapaneseNot measured1413Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: KoreanNot measured1392Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: FrenchNot measured1424Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: SpanishNot measured1421Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: RussianNot measured1420Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: PolishNot measured1443Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: multi-turnNot measured1417Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: longer queriesNot measured1394Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: writing and languageNot measured1408Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: entertainment and mediaNot measured1386Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: EnglishNot measured1232Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: ChineseNot measured1278Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: reading textNot measured1246Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: humorNot measured1266Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: captioningNot measured1259Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: recognizing thingsNot measured1308Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: creative writingNot measured1248Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 11 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
BenchmarkClaude Haiku 5.5Gemini 3.1 Flash Lite PreviewLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Claude Haiku 5.5$0.0003Fits in one request
Gemini 3.1 Flash Lite Preview$0.0010Fits in one request

Claude Haiku 5.5 costs less

Repository review

50K input + 3K output tokens

Claude Haiku 5.5$0.0065Fits in one request
Gemini 3.1 Flash Lite Preview$0.017Fits in one request

Claude Haiku 5.5 costs less

Agent loop

200K input + 10K output tokens

Claude Haiku 5.5$0.025Fits in one request
Gemini 3.1 Flash Lite Preview$0.065Fits in one request

Claude Haiku 5.5 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Claude Haiku 5.5 and Gemini 3.1 Flash Lite Preview
SpecificationAnthropic Claude Haiku 5.5Google Gemini 3.1 Flash Lite Preview
MakerAnthropicGoogle
WeightsNo public weights listedNo public weights listed
ReleasedOctober 7, 2026March 3, 2026
Context window1M1.05M
Input $/Mtok$0.10$0.25
Output $/Mtok$0.50$1.50
Coding index75.98.1
Independent measurements behind it21
Cost per solved taskNot computable$0.18
SourceOpenRouter listingOpenRouter listing

Questions

Is Claude Haiku 5.5 better than Gemini 3.1 Flash Lite Preview for coding?

Pick Claude Haiku 5.5 for coding: it scores 75.9 on the Vibe Coding Index against 8.1 for Gemini 3.1 Flash Lite Preview. Pick Gemini 3.1 Flash Lite Preview when the context window is larger, 1.05M against 1M tokens, or when the benchmark that matters is SAGE (Vals AI), where it leads.

Which is cheaper, Claude Haiku 5.5 or Gemini 3.1 Flash Lite Preview?

Claude Haiku 5.5 costs $0.10 per million input tokens and $0.50 per million output tokens; Gemini 3.1 Flash Lite Preview costs $0.25 and $1.50. Cost per solved task is known for Gemini 3.1 Flash Lite Preview only.

Which has the bigger context window, Claude Haiku 5.5 or Gemini 3.1 Flash Lite Preview?

Gemini 3.1 Flash Lite Preview, with 1.05M tokens against 1M.

How many benchmarks is the Claude Haiku 5.5 vs Gemini 3.1 Flash Lite Preview comparison based on?

20 benchmarks have a result for both models as of October 21, 2026. Claude Haiku 5.5's coding index rests on 2 independent benchmarks and Gemini 3.1 Flash Lite Preview's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next