Gemini 3.1 Pro Preview vs Grok 4.5

Grok 4.5 leads Gemini 3.1 Pro Preview on coding, 58.6 to 32.3 on the Vibe Coding Index, and Grok 4.5 costs 2.0x less per output token ($6.00 vs $12.00 per million). Updated October 22, 2026; 108 benchmarks have a result for both.

Replace Gemini 3.1 Pro Preview Replace Grok 4.5

Gemini 3.1 Pro PreviewGoogle

Coding: 32.3
Overall: 54.0
Output $/M: $12.00

Grok 4.5xAI

Coding: 58.6
Overall: 62.1
Output $/M: $6.00

vs boards won of 108 shared, 1 tied

Gemini 3.1 Pro Preview or Grok 4.5: which to pick

Pick Grok 4.5 for coding: it scores 58.6 on the Vibe Coding Index against 32.3 for Gemini 3.1 Pro Preview.

Pick Gemini 3.1 Pro Preview for a larger context window (1.05M against 500K tokens) and work measured by LiveCodeBench (Vals AI) or IOI (Vals AI), where it leads.

Model AGemini 3.1 Pro PreviewGoogle32.3/1004 independent benchmarks$0.99 per solved task Model BGrok 4.5xAI58.6/1006 independent benchmarks$0.62 per solved task

1082515

Shared results: 108
Gemini 3.1 Pro Preview only: 25
Grok 4.5 only: 15
Like-for-like categories: 8 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, six public coding benchmarks
Grok 4.5
Grok 4.5 scores 58.6 against 32.3.
4 and 6 benchmarks behind the scores
Intelligence
AA Intelligence Index
Grok 4.5
Grok 4.5 leads, 38.8 against 29.7.
Same board, both measured
Agentic work
AA Agentic Index
Grok 4.5
Grok 4.5 leads, 41.2 against 8.2.
Same board, both measured
Reasoning
GPQA Diamond
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview leads, 95.5% against 92.9%.
Same board, both measured
Math
AIME
No call
Only Gemini 3.1 Pro Preview has a AIME result, 98.1%.
Directional only
Knowledge
MMLU Pro
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview leads, 91.0% against 89.2%.
Same board, both measured
Web design
Design Arena: websites
Grok 4.5
Grok 4.5 leads, 1281 against 1233.
Same board, both measured
Long documents
Listed context window
Gemini 3.1 Pro Preview
Gemini 3.1 Pro Preview takes 1.05M tokens against 500K.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
Grok 4.5
Gemini 3.1 Pro Preview $0.0080, Grok 4.5 $0.0050 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
Grok 4.5
Gemini 3.1 Pro Preview $0.99, Grok 4.5 $0.62.
Published attempt cost and pass rate

At a glance

Coding index: Gemini 3.1 Pro Preview 32.3 from 4 benchmarks, Grok 4.5 58.6 from 6 benchmarks.
Widest category: Agentic work, 14.1 points apart on average over 17 shared benchmarks.
Widest single gap: Vibe Code Bench (Vals AI): Gemini 3.1 Pro Preview 32.0% against Grok 4.5 69.0%, 37.0 points apart on a 0 to 100 scale.
Output price: Gemini 3.1 Pro Preview $12.00 against Grok 4.5 $6.00 per million output tokens, 2.0x apart.
Context window: Gemini 3.1 Pro Preview takes 1.05M tokens, Grok 4.5 500K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	Gemini 3.1 Pro Preview	Grok 4.5	Ties
Coding	8	10	1 tie
Intelligence	0	1
Agentic work	1	16
Reasoning	14	0
Math	3	3
Knowledge	11	1
Web design	2	6
General	28	3
All shared boards	67	40	1 tie

CodingLike-for-likeSix of these boards feed the Vibe Coding Index810

Coding benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
LiveBench coding	Not measured	94.3%	Only Grok 4.5 measured
LMArena WebDev	1447	1553	Grok 4.5
AA Coding Index	68.8	72.4	Grok 4.5
LiveCodeBench (Vals AI)	88.5%	87.3%	Gemini 3.1 Pro Preview
SWE-bench Verified (Vals AI)	78.8%	86.6%	Grok 4.5
Terminal-Bench 4 (Vals AI)	2.5%	8.6%	Grok 4.5
Vibe Code Bench (Vals AI)	32.0%	69.0%	Grok 4.5
Code migration (Vals AI)	17.3%	36.6%	Grok 4.5
ProgramBench (Vals AI)	0.0%	0.0%	Tie
IOI (Vals AI)	51.8%	40.6%	Gemini 3.1 Pro Preview
Terminal-Bench 2.1 (Vals AI)	70.8%	67.8%	Gemini 3.1 Pro Preview
Vibe Code Bench 1-100 (Vals AI)	6.7%	Not measured	Only Gemini 3.1 Pro Preview measured
SkillsBench (Vals AI)	Not measured	66.0%	Only Grok 4.5 measured
CyberBench (Vals AI)	Not measured	71.0%	Only Grok 4.5 measured
SciCode	58.7%	55.0%	Gemini 3.1 Pro Preview
Terminal-Bench Hard (Artificial Analysis run)	53.8%	Not measured	Only Gemini 3.1 Pro Preview measured
Terminal-Bench	80.2%	Not measured	Only Gemini 3.1 Pro Preview measured
FrontierCode	Not measured	42.4%	Only Grok 4.5 measured
GSO-Bench	22.6%	Not measured	Only Gemini 3.1 Pro Preview measured
WeirdML	72.1%	46.4%	Gemini 3.1 Pro Preview
MirrorCode	8.9%	Not measured	Only Gemini 3.1 Pro Preview measured
ALE-Bench	1160.6	1309.3	Grok 4.5
LMArena Text: coding	1484	1474	Gemini 3.1 Pro Preview
LMArena Text: software and IT	1487	1471	Gemini 3.1 Pro Preview
LMArena WebDev: React	1438	1556	Grok 4.5
LMArena WebDev: HTML	1490	1567	Grok 4.5
LMArena WebDev: from an image	1481	1562	Grok 4.5
SciCode	14.3%	6.5%	Gemini 3.1 Pro Preview
Neither model has a result on the other 11 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01

Intelligence benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
AA Intelligence Index	29.7	38.8	Grok 4.5
Epoch Capabilities Index	Not measured	154.1	Only Grok 4.5 measured

Agentic workLike-for-likePublic boards, shown as published, kept out of the index116

Agentic work benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
AA Agentic Index	8.2	41.2	Grok 4.5
Design Arena: agents building web apps	1125	1218	Grok 4.5
Design Arena: agents building full-stack apps	1068	1249	Grok 4.5
Design Arena: agents building mobile apps	1094	1220	Grok 4.5
Design Arena: agents building Android apps	1049	1236	Grok 4.5
Design Arena: agents building Godot games	1236	1229	Gemini 3.1 Pro Preview
Design Arena: agents building games	1113	1236	Grok 4.5
Design Arena: HTML slides	1103	1205	Grok 4.5
Design Arena: PowerPoint slides	1041	1230	Grok 4.5
LiveBench research	Not measured	85.9%	Only Grok 4.5 measured
LiveBench browser	Not measured	44.0%	Only Grok 4.5 measured
LiveBench long agentic	Not measured	27.9%	Only Grok 4.5 measured
SREBench (Vals AI)	0.0%	0.8%	Grok 4.5
Finance Agent (Vals AI)	43.0%	48.4%	Grok 4.5
Tax Agent Bench (Vals AI)	9.3%	24.9%	Grok 4.5
Legal Research Bench (Vals AI)	20.7%	38.0%	Grok 4.5
Excel Modeling Benchmark (Vals AI)	52.6%	52.9%	Grok 4.5
BioMysteryBench (Vals AI)	60.0%	Not measured	Only Gemini 3.1 Pro Preview measured
Terminal-Bench-Science (Vals AI)	1.4%	Not measured	Only Gemini 3.1 Pro Preview measured
Vals Science Index	27.4%	Not measured	Only Gemini 3.1 Pro Preview measured
Time Horizon Index (Vals AI)	Not measured	6.3%	Only Grok 4.5 measured
τ²-Bench Telecom	95.6%	Not measured	Only Gemini 3.1 Pro Preview measured
APEX-Agents	35.1%	56.2%	Grok 4.5
METR time horizons	77.0%	Not measured	Only Gemini 3.1 Pro Preview measured
BALROG	57.0%	Not measured	Only Gemini 3.1 Pro Preview measured
DeepResearch Bench	47.8%	Not measured	Only Gemini 3.1 Pro Preview measured
PostTrainBench	22.0%	23.4%	Grok 4.5
Vending-Bench 2	$911	$3,887	Grok 4.5
LMArena Search	Not measured	1216	Only Grok 4.5 measured
Neither model has a result on the other 12 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index140

Reasoning benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
GPQA Diamond	95.5%	92.9%	Gemini 3.1 Pro Preview
LiveBench reasoning	Not measured	87.2%	Only Grok 4.5 measured
MysteryMechanism (Vals AI)	20.7%	Not measured	Only Gemini 3.1 Pro Preview measured
MMMU Pro (Vals AI)	88.2%	61.8%	Gemini 3.1 Pro Preview
GPQA Diamond (Artificial Analysis run)	94.1%	93.1%	Gemini 3.1 Pro Preview
Humanity's Last Exam (Artificial Analysis run)	47.0%	42.7%	Gemini 3.1 Pro Preview
GPQA Diamond (Epoch AI run)	94.4%	93.4%	Gemini 3.1 Pro Preview
ARC-AGI	98.0%	87.2%	Gemini 3.1 Pro Preview
ARC-AGI-2	77.1%	52.6%	Gemini 3.1 Pro Preview
SimpleBench	79.6%	70.0%	Gemini 3.1 Pro Preview
Chess puzzles	51.0%	35.0%	Gemini 3.1 Pro Preview
Mystery game puzzles	34.0%	Not measured	Only Gemini 3.1 Pro Preview measured
EBR-bench	14.3%	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Text: hard prompts	1485	1462	Gemini 3.1 Pro Preview
LMArena Text: expert	1483	1465	Gemini 3.1 Pro Preview
LMArena Text: hard prompts in English	1480	1464	Gemini 3.1 Pro Preview
LMArena Vision: diagrams	1311	1304	Gemini 3.1 Pro Preview
LMArena Vision: homework	1316	1295	Gemini 3.1 Pro Preview
Kagi LLM Benchmark	Not measured	83.5%	Only Grok 4.5 measured
Neither model has a result on the other 3 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index33

Math benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
AIME	98.1%	Not measured	Only Gemini 3.1 Pro Preview measured
OTIS Mock AIME	95.6%	97.8%	Grok 4.5
FrontierMath, tiers 1 to 3	59.6%	57.2%	Gemini 3.1 Pro Preview
FrontierMath, tier 4	26.8%	24.4%	Gemini 3.1 Pro Preview
ProofBench	26.0%	31.0%	Grok 4.5
LMArena Text: math	1486	1460	Gemini 3.1 Pro Preview
LMArena Text: mathematical work	1478	1482	Grok 4.5
Neither model has a result on the other 6 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index111

Knowledge benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
MMLU Pro	91.0%	89.2%	Gemini 3.1 Pro Preview
LegalBench (Vals AI)	87.4%	86.0%	Gemini 3.1 Pro Preview
CaseLaw (Vals AI)	64.8%	Not measured	Only Gemini 3.1 Pro Preview measured
CorpFin (Vals AI)	64.5%	67.4%	Grok 4.5
TaxEval (Vals AI)	72.9%	71.7%	Gemini 3.1 Pro Preview
MortgageTax (Vals AI)	69.4%	61.8%	Gemini 3.1 Pro Preview
MedQA (Vals AI)	96.4%	Not measured	Only Gemini 3.1 Pro Preview measured
MedCode (Vals AI)	59.1%	43.3%	Gemini 3.1 Pro Preview
SimpleQA Verified	73.5%	48.3%	Gemini 3.1 Pro Preview
LMArena Text: science	1497	1464	Gemini 3.1 Pro Preview
LMArena Text: medicine and healthcare	1486	1440	Gemini 3.1 Pro Preview
LMArena Text: legal and government	1487	1463	Gemini 3.1 Pro Preview
LMArena Text: business and finance	1459	1441	Gemini 3.1 Pro Preview
FACTS Benchmark Suite	67.4%	50.2%	Gemini 3.1 Pro Preview
Neither model has a result on the other 4 boards here

Web designLike-for-likePublic boards, shown as published, kept out of the index26

Web design benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
Design Arena: websites	1233	1281	Grok 4.5
Design Arena: UI components	1224	1280	Grok 4.5
Design Arena: game dev	1202	1264	Grok 4.5
Design Arena: data viz	1209	1266	Grok 4.5
Design Arena: 3D	1234	1257	Grok 4.5
Design Arena: all code categories	1231	1275	Grok 4.5
Design Arena: SVG	1285	1215	Gemini 3.1 Pro Preview
Design Arena: ASCII art	1270	1256	Gemini 3.1 Pro Preview
LiveBench design	Not measured	78.1%	Only Grok 4.5 measured

GeneralLike-for-likePublic boards, shown as published, kept out of the index283

General benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
LiveBench data analysis	Not measured	73.0%	Only Grok 4.5 measured
Public Benefits Bench (Vals AI)	53.8%	Not measured	Only Gemini 3.1 Pro Preview measured
SAGE (Vals AI)	48.7%	35.0%	Gemini 3.1 Pro Preview
MedScribe (Vals AI)	76.1%	86.9%	Grok 4.5
Vals Multimodal Index	56.1%	63.4%	Grok 4.5
IFBench	77.1%	Not measured	Only Gemini 3.1 Pro Preview measured
Long context reasoning (AA-LCR)	82.0%	79.3%	Gemini 3.1 Pro Preview
DTBench	97.1%	96.5%	Gemini 3.1 Pro Preview
LMCA	53.8%	45.2%	Gemini 3.1 Pro Preview
CL-bench	20.8%	Not measured	Only Gemini 3.1 Pro Preview measured
Surface Evolver Bench	Not measured	74.4%	Only Grok 4.5 measured
Furniture assembly	26.7%	22.5%	Gemini 3.1 Pro Preview
ExploitBench	26.1%	Not measured	Only Gemini 3.1 Pro Preview measured
CL-bench Life	16.9%	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Text	1480	1448	Gemini 3.1 Pro Preview
LMArena Text: instruction following	1466	1445	Gemini 3.1 Pro Preview
LMArena Text: creative writing	1482	1442	Gemini 3.1 Pro Preview
LMArena Vision	1296	1287	Gemini 3.1 Pro Preview
LMArena Text: English	1478	1453	Gemini 3.1 Pro Preview
LMArena Text: non-English	1476	1440	Gemini 3.1 Pro Preview
LMArena Text: Chinese	1527	1495	Gemini 3.1 Pro Preview
LMArena Text: German	1490	1448	Gemini 3.1 Pro Preview
LMArena Text: Japanese	1491	1430	Gemini 3.1 Pro Preview
LMArena Text: Korean	1455	1406	Gemini 3.1 Pro Preview
LMArena Text: French	1487	1457	Gemini 3.1 Pro Preview
LMArena Text: Spanish	1481	1451	Gemini 3.1 Pro Preview
LMArena Text: Russian	1497	1449	Gemini 3.1 Pro Preview
LMArena Text: Polish	1498	1432	Gemini 3.1 Pro Preview
LMArena Text: multi-turn	1487	1456	Gemini 3.1 Pro Preview
LMArena Text: longer queries	1482	1462	Gemini 3.1 Pro Preview
LMArena Text: writing and language	1481	1445	Gemini 3.1 Pro Preview
LMArena Text: entertainment and media	1465	1434	Gemini 3.1 Pro Preview
LMArena Vision: English	1287	1285	Gemini 3.1 Pro Preview
LMArena Vision: Chinese	1364	1345	Gemini 3.1 Pro Preview
LMArena Vision: reading text	1304	1293	Gemini 3.1 Pro Preview
LMArena Vision: humor	1322	1276	Gemini 3.1 Pro Preview
LMArena Vision: captioning	1345	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Vision: recognizing things	1330	Not measured	Only Gemini 3.1 Pro Preview measured
LMArena Vision: creative writing	1324	1293	Gemini 3.1 Pro Preview
LMArena Document	1444	1452	Grok 4.5
Neither model has a result on the other 6 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for Gemini 3.1 Pro Preview and Grok 4.5
Benchmark	Gemini 3.1 Pro Preview	Grok 4.5	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 3.1 Pro Preview$0.0080Fits in one request

Grok 4.5$0.0050Fits in one request

Grok 4.5 costs less

Repository review

50K input + 3K output tokens

Gemini 3.1 Pro Preview$0.136Fits in one request

Grok 4.5$0.118Fits in one request

Grok 4.5 costs less

Agent loop

200K input + 10K output tokens

Gemini 3.1 Pro Preview$0.520Fits in one request

Grok 4.5$0.460Fits in one request

Grok 4.5 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 3.1 Pro Preview and Grok 4.5
Specification	Google Gemini 3.1 Pro Preview	SpaceXAI Grok 4.5
Maker	Google	xAI
Weights	No public weights listed	No public weights listed
Released	February 19, 2026	July 8, 2026
Context window	1.05M	500K
Input $/Mtok	$2.00	$2.00
Output $/Mtok	$12.00	$6.00
Coding index	32.3	58.6
Independent measurements behind it	4	6
Cost per solved task	$0.99	$0.62
Source	OpenRouter listing	OpenRouter listing

Questions

Is Gemini 3.1 Pro Preview better than Grok 4.5 for coding?

Pick Grok 4.5 for coding: it scores 58.6 on the Vibe Coding Index against 32.3 for Gemini 3.1 Pro Preview. Pick Gemini 3.1 Pro Preview for a larger context window (1.05M against 500K tokens) and work measured by LiveCodeBench (Vals AI) or IOI (Vals AI), where it leads.

Which is cheaper, Gemini 3.1 Pro Preview or Grok 4.5?

Gemini 3.1 Pro Preview costs $2.00 per million input tokens and $12.00 per million output tokens; Grok 4.5 costs $2.00 and $6.00. Per solved SWE-bench Verified task, Gemini 3.1 Pro Preview costs $0.99 and Grok 4.5 $0.62.

Which has the bigger context window, Gemini 3.1 Pro Preview or Grok 4.5?

Gemini 3.1 Pro Preview, with 1.05M tokens against 500K.

How many benchmarks is the Gemini 3.1 Pro Preview vs Grok 4.5 comparison based on?

108 benchmarks have a result for both models as of October 22, 2026. Gemini 3.1 Pro Preview's coding index rests on 4 independent benchmarks and Grok 4.5's on 6. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/gemini-3-1-pro-preview-vs-grok-4-5" title="Gemini 3.1 Pro Preview vs Grok 4.5, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/gemini-3-1-pro-preview-vs-grok-4-5">LLMBenchmark.ai, Gemini 3.1 Pro Preview vs Grok 4.5</a></p>

Gemini 3.1 Pro Preview or Grok 4.5: which to pick

Which one for your work

Coding

Intelligence

Agentic work

Reasoning

Math

Knowledge

Web design

Long documents

Everyday cost

Cost per solved task

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next