Enter opens the highlighted result. Esc closes.

Google Gemini 1.5 Pro Retired

  • Google
  • Released May 23, 2024
  • Weights not known
  • 2.1M context

Google Gemini 1.5 Pro was last priced at $1.25 per million input tokens and $5.00 per million output tokens, as of October 21, 2026. None of the 6 coding benchmarks behind the index has measured it, so it has no coding index, but 54 benchmarks outside the index have a result below.

Gemini 1.5 Pro is retired, so it sits outside the current price order and the rankings.

  • Coding index Not benchmarked No benchmark coverage
  • Cost per solved task Not computable No published attempt cost
  • Output, per million tokens $5.00 Not in the price order OpenRouter list price
  • Input, per million tokens $1.25 OpenRouter list price
  • Context window 2.1M Tokens per request

No longer sold through the API. Retired on September 29, 2025; last list price shown.

About and specs

OpenRouter publishes no description for this model.

API model id google/gemini-pro-1.5
  • Tool callingNot listed
  • Structured outputsNot listed
  • JSON modeNot listed
  • Reasoning modeNot listed
  • Web searchNot listed
Takes in
Not listed
Gives back
Not listed
Context window
2.1M tokens
Max output
Not published
Knowledge cutoff
Not published
Cached input $/Mtok
No cache price listed
Cache write $/Mtok
No cache write price listed
Reasoning $/Mtok
Not priced apart
Web search, per request
No search price listed
Tokenizer
Not named
Requests moderated
Not stated
Withdrawn on
No date announced
Parameters
Not published
Downloads, all time
No public weights
Training compute
No estimate published
Output speed
Not measured
Time to first token
Not measured
Speed on OpenRouter
Not measured
First token on OpenRouter
Not measured

Benchmarks: 54 of 195 measured

The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.

Coding index

Not benchmarked
  • Terminal-Bench 4 (Vals AI) Not measured
  • Vibe Code Bench (Vals AI) Not measured
  • LiveBench coding Not measured
  • SWE-bench Verified (Vals AI) Not measured
  • FrontierCode Not measured
  • LMArena WebDev Elo, scaled from 1200 to 1900 Not measured

No coding benchmark has measured this model, so there is no index. We do not estimate one from its price, its maker or its siblings. How it is weighted

Other public boards

All rankings

Coding4 of 33 boards

Not measured on Aider polyglot, SWE-bench Verified, SWE-bench Lite, SWE-bench (full test set), SWE-bench Multimodal, SWE-bench Multilingual, AA Coding Index, Code migration (Vals AI), ProgramBench (Vals AI), IOI (Vals AI), Terminal-Bench 2.1 (Vals AI), SWE-bench Multimodal (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), CyberBench (Vals AI), LiveCodeBench (Artificial Analysis run), SciCode, Terminal-Bench Hard (Artificial Analysis run), Terminal-Bench, DeepSWE, FrontierSWE, GSO-Bench, MirrorCode, Cybench, ALE-Bench, LMArena WebDev: React, LMArena WebDev: HTML, LMArena WebDev: from an image, SciCode

Intelligence0 of 2 boards

Not measured on AA Intelligence Index, Epoch Capabilities Index

Agentic work2 of 41 boards

Not measured on AA Agentic Index, Design Arena: agents building web apps, Design Arena: agents building full-stack apps, Design Arena: agents building mobile apps, Design Arena: agents building Android apps, Design Arena: agents building Godot games, Design Arena: agents building games, Design Arena: HTML slides, Design Arena: PowerPoint slides, Design Arena: spreadsheets, LiveBench research, LiveBench browser, LiveBench long agentic, SREBench (Vals AI), Finance Agent (Vals AI), Tax Agent Bench (Vals AI), Legal Research Bench (Vals AI), Harvey's Legal Agent Benchmark (Vals AI), Excel Modeling Benchmark (Vals AI), BioMysteryBench (Vals AI), Terminal-Bench-Science (Vals AI), Vals Science Index, Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), τ²-Bench Telecom, APEX-Agents, METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, DeepResearch Bench, PostTrainBench, OSWorld, SpireClimb, Vending-Bench 2, LMArena Search, Berkeley Function Calling Leaderboard (BFCL), BrowseComp-Plus

Reasoning9 of 22 boards

3 more reasoning boards

Not measured on LiveBench reasoning, MysteryMechanism (Vals AI), GPQA Diamond (Artificial Analysis run), Humanity's Last Exam (Artificial Analysis run), ARC-AGI, Humanity's Last Exam, Chess puzzles, Mystery game puzzles, EBR-bench, VPCT, LMArena Vision: diagrams, LMArena Vision: homework, Kagi LLM Benchmark

Math7 of 13 boards

1 more math boards

Not measured on AA Math Index, AIME 2025 (Artificial Analysis run), FrontierMath, tiers 1 to 3, FrontierMath, tier 4, ProofBench, GSM8K

Knowledge11 of 18 boards

5 more knowledge boards

Not measured on CaseLaw (Vals AI), MedCode (Vals AI), MMLU Pro (Artificial Analysis run), SimpleQA Verified, GeoBench, AI2 Reasoning Challenge, FACTS Benchmark Suite

Web design0 of 9 boards

Not measured on Design Arena: websites, Design Arena: UI components, Design Arena: game dev, Design Arena: data viz, Design Arena: 3D, Design Arena: all code categories, Design Arena: SVG, Design Arena: ASCII art, LiveBench design

General21 of 46 boards

15 more general boards

Not measured on Vals Index, LiveBench data analysis, Public Benefits Bench (Vals AI), SAGE (Vals AI), MedScribe (Vals AI), Vals Multimodal Index, IFBench, Long context reasoning (AA-LCR), LMCA, Fiction.LiveBench, Creative writing (Lech Mazur), CL-bench, Surface Evolver Bench, Furniture assembly, ExploitBench, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Vision: reading text, LMArena Vision: humor, LMArena Vision: captioning, LMArena Vision: recognizing things, LMArena Vision: creative writing, LMArena Document

Image generation0 of 5 boards

Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit

Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.

All 195 benchmarks as a table
Benchmark results for Google Gemini 1.5 Pro
BenchmarkResultIndex weight
Aider polyglotCoding Not measured Not in index
SWE-bench VerifiedCoding Not measured Not in index
SWE-bench LiteCoding Not measured Not in index
SWE-bench (full test set)Coding Not measured Not in index
SWE-bench MultimodalCoding Not measured Not in index
SWE-bench MultilingualCoding Not measured Not in index
LiveBench codingCoding Not measured 15%
LMArena WebDevCoding Not measured 10%
Vals IndexGeneral Not measured Not in index
GPQA DiamondReasoning 58.3% Not in index
AIMEMath 18.8% Not in index
MMLU ProKnowledge 75.3% Not in index
AA Intelligence IndexIntelligence Not measured Not in index
AA Coding IndexCoding Not measured Not in index
AA Agentic IndexAgentic work Not measured Not in index
Design Arena: websitesWeb design Not measured Not in index
Design Arena: UI componentsWeb design Not measured Not in index
Design Arena: game devWeb design Not measured Not in index
Design Arena: data vizWeb design Not measured Not in index
Design Arena: 3DWeb design Not measured Not in index
Design Arena: all code categoriesWeb design Not measured Not in index
Design Arena: SVGWeb design Not measured Not in index
Design Arena: ASCII artWeb design Not measured Not in index
Design Arena: agents building web appsAgentic work Not measured Not in index
Design Arena: agents building full-stack appsAgentic work Not measured Not in index
Design Arena: agents building mobile appsAgentic work Not measured Not in index
Design Arena: agents building Android appsAgentic work Not measured Not in index
Design Arena: agents building Godot gamesAgentic work Not measured Not in index
Design Arena: agents building gamesAgentic work Not measured Not in index
Design Arena: HTML slidesAgentic work Not measured Not in index
Design Arena: PowerPoint slidesAgentic work Not measured Not in index
Design Arena: spreadsheetsAgentic work Not measured Not in index
Design Arena: imagesImage generation Not measured Not in index
Design Arena: graphic designImage generation Not measured Not in index
Design Arena: logosImage generation Not measured Not in index
LiveBench reasoningReasoning Not measured Not in index
LiveBench data analysisGeneral Not measured Not in index
LiveBench researchAgentic work Not measured Not in index
LiveBench browserAgentic work Not measured Not in index
LiveBench long agenticAgentic work Not measured Not in index
LiveBench designWeb design Not measured Not in index
LiveCodeBench (Vals AI)Coding 41.7% Not in index
SWE-bench Verified (Vals AI)Coding Not measured 15%
Terminal-Bench 4 (Vals AI)Coding Not measured 25%
Vibe Code Bench (Vals AI)Coding Not measured 20%
Code migration (Vals AI)Coding Not measured Not in index
ProgramBench (Vals AI)Coding Not measured Not in index
SREBench (Vals AI)Agentic work Not measured Not in index
IOI (Vals AI)Coding Not measured Not in index
Terminal-Bench 2.1 (Vals AI)Coding Not measured Not in index
SWE-bench Multimodal (Vals AI)Coding Not measured Not in index
Vibe Code Bench 1-100 (Vals AI)Coding Not measured Not in index
SkillsBench (Vals AI)Coding Not measured Not in index
CyberBench (Vals AI)Coding Not measured Not in index
Finance Agent (Vals AI)Agentic work Not measured Not in index
Tax Agent Bench (Vals AI)Agentic work Not measured Not in index
Legal Research Bench (Vals AI)Agentic work Not measured Not in index
Harvey's Legal Agent Benchmark (Vals AI)Agentic work Not measured Not in index
Excel Modeling Benchmark (Vals AI)Agentic work Not measured Not in index
BioMysteryBench (Vals AI)Agentic work Not measured Not in index
Terminal-Bench-Science (Vals AI)Agentic work Not measured Not in index
Vals Science IndexAgentic work Not measured Not in index
Time Horizon Index (Vals AI)Agentic work Not measured Not in index
CUA-bench (Vals AI)Agentic work Not measured Not in index
Robo-bench (Vals AI)Agentic work Not measured Not in index
Public Benefits Bench (Vals AI)General Not measured Not in index
MysteryMechanism (Vals AI)Reasoning Not measured Not in index
MMMU Pro (Vals AI)Reasoning 65.5% Not in index
MATH 500 (Vals AI)Math 82.8% Not in index
MGSM (Vals AI)Math 89.2% Not in index
SAGE (Vals AI)General Not measured Not in index
LegalBench (Vals AI)Knowledge 69.1% Not in index
CaseLaw (Vals AI)Knowledge Not measured Not in index
CorpFin (Vals AI)Knowledge 40.5% Not in index
TaxEval (Vals AI)Knowledge 59.5% Not in index
MortgageTax (Vals AI)Knowledge 56.8% Not in index
MedQA (Vals AI)Knowledge 76.5% Not in index
MedCode (Vals AI)Knowledge Not measured Not in index
MedScribe (Vals AI)General Not measured Not in index
Vals Multimodal IndexGeneral Not measured Not in index
AA Math IndexMath Not measured Not in index
GPQA Diamond (Artificial Analysis run)Reasoning Not measured Not in index
Humanity's Last Exam (Artificial Analysis run)Reasoning Not measured Not in index
MMLU Pro (Artificial Analysis run)Knowledge Not measured Not in index
LiveCodeBench (Artificial Analysis run)Coding Not measured Not in index
SciCodeCoding Not measured Not in index
Terminal-Bench Hard (Artificial Analysis run)Coding Not measured Not in index
IFBenchGeneral Not measured Not in index
Long context reasoning (AA-LCR)General Not measured Not in index
τ²-Bench TelecomAgentic work Not measured Not in index
AIME 2025 (Artificial Analysis run)Math Not measured Not in index
Terminal-BenchCoding Not measured Not in index
DeepSWECoding Not measured Not in index
FrontierCodeCoding Not measured 15%
FrontierSWECoding Not measured Not in index
GSO-BenchCoding Not measured Not in index
WeirdMLCoding 22.2% Not in index
MirrorCodeCoding Not measured Not in index
APEX-AgentsAgentic work Not measured Not in index
METR time horizonsAgentic work Not measured Not in index
Remote Labor IndexAgentic work Not measured Not in index
GDPvalAgentic work Not measured Not in index
OSWorld 2.0Agentic work Not measured Not in index
BALROGAgentic work 21.0% Not in index
DeepResearch BenchAgentic work Not measured Not in index
PostTrainBenchAgentic work Not measured Not in index
GPQA Diamond (Epoch AI run)Reasoning 57.2% Not in index
ARC-AGIReasoning Not measured Not in index
ARC-AGI-2Reasoning 0.8% Not in index
Humanity's Last ExamReasoning Not measured Not in index
SimpleBenchReasoning 27.1% Not in index
Chess puzzlesReasoning Not measured Not in index
Mystery game puzzlesReasoning Not measured Not in index
EBR-benchReasoning Not measured Not in index
OTIS Mock AIMEMath 23.1% Not in index
FrontierMath, tiers 1 to 3Math Not measured Not in index
FrontierMath, tier 4Math Not measured Not in index
ProofBenchMath Not measured Not in index
MATH level 5Math 70.4% Not in index
GSM8KMath Not measured Not in index
SimpleQA VerifiedKnowledge Not measured Not in index
MMLUKnowledge 86.9% Not in index
GeoBenchKnowledge Not measured Not in index
DTBenchGeneral 59.0% Not in index
LMCAGeneral Not measured Not in index
Fiction.LiveBenchGeneral Not measured Not in index
Creative writing (Lech Mazur)General Not measured Not in index
CL-benchGeneral Not measured Not in index
Surface Evolver BenchGeneral Not measured Not in index
Furniture assemblyGeneral Not measured Not in index
ExploitBenchGeneral Not measured Not in index
CybenchCoding Not measured Not in index
TheAgentCompanyAgentic work 3.4% Not in index
OSWorldAgentic work Not measured Not in index
SpireClimbAgentic work Not measured Not in index
VPCTReasoning Not measured Not in index
BIG-Bench HardReasoning 89.2% Not in index
AI2 Reasoning ChallengeKnowledge Not measured Not in index
HellaSwagGeneral Not measured Not in index
WinoGrandeGeneral Not measured Not in index
PIQAGeneral Not measured Not in index
CL-bench LifeGeneral Not measured Not in index
ALE-BenchCoding Not measured Not in index
Vending-Bench 2Agentic work Not measured Not in index
Epoch Capabilities IndexIntelligence Not measured Not in index
LMArena TextGeneral 1319 Not in index
LMArena Text: codingCoding 1294 Not in index
LMArena Text: hard promptsReasoning 1296 Not in index
LMArena Text: mathMath 1315 Not in index
LMArena Text: instruction followingGeneral 1297 Not in index
LMArena Text: creative writingGeneral 1332 Not in index
LMArena VisionGeneral 1161 Not in index
LMArena Text: EnglishGeneral 1323 Not in index
LMArena Text: non-EnglishGeneral 1312 Not in index
LMArena Text: ChineseGeneral 1331 Not in index
LMArena Text: GermanGeneral 1286 Not in index
LMArena Text: JapaneseGeneral 1292 Not in index
LMArena Text: KoreanGeneral 1298 Not in index
LMArena Text: FrenchGeneral 1302 Not in index
LMArena Text: SpanishGeneral 1310 Not in index
LMArena Text: RussianGeneral 1320 Not in index
LMArena Text: PolishGeneral 1291 Not in index
LMArena Text: multi-turnGeneral 1296 Not in index
LMArena Text: longer queriesGeneral 1308 Not in index
LMArena Text: expertReasoning 1278 Not in index
LMArena Text: hard prompts in EnglishReasoning 1299 Not in index
LMArena Text: software and ITCoding 1304 Not in index
LMArena Text: mathematical workMath 1324 Not in index
LMArena Text: scienceKnowledge 1321 Not in index
LMArena Text: medicine and healthcareKnowledge 1306 Not in index
LMArena Text: legal and governmentKnowledge 1328 Not in index
LMArena Text: business and financeKnowledge 1286 Not in index
LMArena Text: writing and languageGeneral 1326 Not in index
LMArena Text: entertainment and mediaGeneral 1305 Not in index
LMArena WebDev: ReactCoding Not measured Not in index
LMArena WebDev: HTMLCoding Not measured Not in index
LMArena WebDev: from an imageCoding Not measured Not in index
LMArena Vision: EnglishGeneral 1159 Not in index
LMArena Vision: ChineseGeneral 1187 Not in index
LMArena Vision: reading textGeneral Not measured Not in index
LMArena Vision: diagramsReasoning Not measured Not in index
LMArena Vision: homeworkReasoning Not measured Not in index
LMArena Vision: humorGeneral Not measured Not in index
LMArena Vision: captioningGeneral Not measured Not in index
LMArena Vision: recognizing thingsGeneral Not measured Not in index
LMArena Vision: creative writingGeneral Not measured Not in index
LMArena SearchAgentic work Not measured Not in index
LMArena DocumentGeneral Not measured Not in index
LMArena Text to ImageImage generation Not measured Not in index
LMArena Image EditImage generation Not measured Not in index
Berkeley Function Calling Leaderboard (BFCL)Agentic work Not measured Not in index
Kagi LLM BenchmarkReasoning Not measured Not in index
BrowseComp-PlusAgentic work Not measured Not in index
SciCodeCoding Not measured Not in index
FACTS Benchmark SuiteKnowledge Not measured Not in index

What it costs

A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.

Output price against the market

Gemini 1.5 Pro pricing
$0.05Dashed line: median $1.80, log scale$600.00
$5.00 per million output tokens is cheaper than 26% of the 344 paid models in the catalog.

Cost per solved task

How it is computed

Neither board that publishes what a SWE-bench Verified attempt costs, Vals AI and swebench.com, has run this model. We leave the number out rather than estimate it.

Nearly as good as Gemini 1.5 Pro, for less

What the boards say about its runs

Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.

What each board publishes about the runs behind Google: Gemini 1.5 Pro's results
BoardResultWhat the run costAlso published
WeirdML 22.2% $0.0505 per run Median lines of code 80
ARC-AGI-2 0.8% $0.04 per task Nothing else
TheAgentCompany 3.4% $6.78 average cost per task Nothing else
GPQA Diamond 58.3% Not published Latency, as printed 7.7 s
AIME 18.8% Not published Latency, as printed 11 s
MMLU Pro 75.3% Not published Latency, as printed 3.3 s
LiveCodeBench (Vals AI) 41.7% Not published Latency, as printed 4.0 s
MMMU Pro (Vals AI) 65.5% Not published Latency, as printed 44 s
MATH 500 (Vals AI) 82.8% Not published Latency, as printed 5.0 s
MGSM (Vals AI) 89.2% Not published Latency, as printed 2.8 s
LegalBench (Vals AI) 69.1% Not published Latency, as printed 0.9 s
CorpFin (Vals AI) 40.5% Not published Latency, as printed 38 s
34 more boards
What each board publishes about the runs behind Google: Gemini 1.5 Pro's results, continued
TaxEval (Vals AI) 59.5% Not published Latency, as printed 9.9 s
MortgageTax (Vals AI) 56.8% Not published Latency, as printed 4.2 s
MedQA (Vals AI) 76.5% Not published Latency, as printed 5.9 s
LMArena Text 1319 Elo Not published Votes 55,606 · Interval (±) ±3.4
LMArena Text: coding 1294 Elo Not published Votes 9,175 · Interval (±) ±6.8
LMArena Text: hard prompts 1296 Elo Not published Votes 14,853 · Interval (±) ±5.5
LMArena Text: math 1315 Elo Not published Votes 7,610 · Interval (±) ±7.4
LMArena Text: instruction following 1297 Elo Not published Votes 22,789 · Interval (±) ±5.0
LMArena Text: creative writing 1332 Elo Not published Votes 8,062 · Interval (±) ±7.3
LMArena Vision 1161 Elo Not published Votes 8,902 · Interval (±) ±9.1
LMArena Text: English 1323 Elo Not published Votes 30,133 · Interval (±) ±4.4
LMArena Text: non-English 1312 Elo Not published Votes 25,473 · Interval (±) ±4.7
LMArena Text: Chinese 1331 Elo Not published Votes 4,444 · Interval (±) ±9.9
LMArena Text: German 1286 Elo Not published Votes 1,281 · Interval (±) ±16.9
LMArena Text: Japanese 1292 Elo Not published Votes 1,210 · Interval (±) ±17.9
LMArena Text: Korean 1298 Elo Not published Votes 773 · Interval (±) ±23.6
LMArena Text: French 1302 Elo Not published Votes 459 · Interval (±) ±28.5
LMArena Text: Spanish 1310 Elo Not published Votes 405 · Interval (±) ±29.3
LMArena Text: Russian 1320 Elo Not published Votes 7,738 · Interval (±) ±7.7
LMArena Text: Polish 1291 Elo Not published Votes 148 · Interval (±) ±60.6
LMArena Text: multi-turn 1296 Elo Not published Votes 10,053 · Interval (±) ±6.9
LMArena Text: longer queries 1308 Elo Not published Votes 8,372 · Interval (±) ±7.1
LMArena Text: expert 1278 Elo Not published Votes 3,319 · Interval (±) ±11.0
LMArena Text: hard prompts in English 1299 Elo Not published Votes 9,056 · Interval (±) ±6.7
LMArena Text: software and IT 1304 Elo Not published Votes 14,433 · Interval (±) ±5.8
LMArena Text: mathematical work 1324 Elo Not published Votes 6,506 · Interval (±) ±7.8
LMArena Text: science 1321 Elo Not published Votes 9,790 · Interval (±) ±6.9
LMArena Text: medicine and healthcare 1306 Elo Not published Votes 2,686 · Interval (±) ±12.5
LMArena Text: legal and government 1328 Elo Not published Votes 3,342 · Interval (±) ±11.2
LMArena Text: business and finance 1286 Elo Not published Votes 6,378 · Interval (±) ±8.2
LMArena Text: writing and language 1326 Elo Not published Votes 14,953 · Interval (±) ±5.9
LMArena Text: entertainment and media 1305 Elo Not published Votes 9,269 · Interval (±) ±6.8
LMArena Vision: English 1159 Elo Not published Votes 4,829 · Interval (±) ±11.7
LMArena Vision: Chinese 1187 Elo Not published Votes 395 · Interval (±) ±43.6

No comparison page of its own yet: one needs a coding index on both sides, and Gemini 1.5 Pro has none. Compare Gemini 1.5 Pro with any model