LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Gemini 3.1 Pro Preview vs GLM 5.3

Updated October 21, 2026. 86 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Gemini 3.1 Pro PreviewGoogle
Coding
35.3
Overall
29.7
Output $/M
$12.00
29
GLM 5.3Z.ai
Coding
73.1
Overall
44.8
Output $/M
$1.40
57
vs boards won of 86 shared

Decision reading

Pick GLM 5.3 for coding: it scores 73.1 on the Vibe Coding Index against 35.3 for Gemini 3.1 Pro Preview.

Pick Gemini 3.1 Pro Preview when what matters is LiveCodeBench (Vals AI) or GPQA Diamond, where it leads.

Shared results
86
Gemini 3.1 Pro Preview only
45
GLM 5.3 only
14
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Gemini 3.1 Pro Preview 35.3 from 1 benchmark, GLM 5.3 73.1 from 2 benchmarks.
Widest category
Agentic work, 20.1 points apart on average over 12 shared benchmarks.
Widest single gap
Vibe Code Bench (Vals AI): Gemini 3.1 Pro Preview 32.0% against GLM 5.3 78.1%, 46.1 points apart on a 0 to 100 scale.
Output price
Gemini 3.1 Pro Preview $12.00 against GLM 5.3 $1.40 per million output tokens, 8.6x apart.
Context window
Both take 1.05M tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGemini 3.1 Pro PreviewBarsGLM 5.3Ties
Coding117
Intelligence01
Agentic work012
Reasoning64
Math15
Knowledge72
Web design17
General139
All shared boards2957
CodingLike-for-likeFour of these boards feed the Vibe Coding Index117
Coding benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
LiveBench codingNot measured82.8%Only GLM 5.3 measured
LMArena WebDev14471621GLM 5.3
AA Coding Index68.874.8GLM 5.3
LiveCodeBench (Vals AI)88.5%80.5%Gemini 3.1 Pro Preview
SWE-bench Verified (Vals AI)78.8%95.4%GLM 5.3
Terminal-Bench 4 (Vals AI)2.5%38.9%GLM 5.3
Vibe Code Bench (Vals AI)32.0%78.1%GLM 5.3
Code migration (Vals AI)17.3%44.2%GLM 5.3
ProgramBench (Vals AI)0.0%1.5%GLM 5.3
IOI (Vals AI)51.8%68.4%GLM 5.3
Terminal-Bench 2.1 (Vals AI)70.8%71.5%GLM 5.3
Vibe Code Bench 1-100 (Vals AI)6.7%20.0%GLM 5.3
SkillsBench (Vals AI)Not measured47.5%Only GLM 5.3 measured
CyberBench (Vals AI)Not measured72.1%Only GLM 5.3 measured
SciCode58.7%59.0%GLM 5.3
Terminal-Bench Hard (Artificial Analysis run)53.8%Not measuredOnly Gemini 3.1 Pro Preview measured
Terminal-Bench80.2%Not measuredOnly Gemini 3.1 Pro Preview measured
FrontierCodeNot measured40.1%Only GLM 5.3 measured
FrontierSWENot measured30.2%Only GLM 5.3 measured
GSO-Bench22.6%Not measuredOnly Gemini 3.1 Pro Preview measured
WeirdML72.1%75.4%GLM 5.3
MirrorCode8.9%Not measuredOnly Gemini 3.1 Pro Preview measured
ALE-Bench1160.61317.4GLM 5.3
LMArena Text: coding14841497GLM 5.3
LMArena Text: software and IT14871493GLM 5.3
LMArena WebDev: React14381641GLM 5.3
LMArena WebDev: HTML14901595GLM 5.3
LMArena WebDev: from an image1481Not measuredOnly Gemini 3.1 Pro Preview measured
Neither model has a result on the other 10 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
AA Intelligence Index29.744.8GLM 5.3
Epoch Capabilities IndexNot measured156.0Only GLM 5.3 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index012
Agentic work benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
AA Agentic Index8.253.1GLM 5.3
Design Arena: agents building web apps1125Not measuredOnly Gemini 3.1 Pro Preview measured
Design Arena: agents building full-stack apps1068Not measuredOnly Gemini 3.1 Pro Preview measured
Design Arena: agents building mobile apps10941194GLM 5.3
Design Arena: agents building Android apps1055Not measuredOnly Gemini 3.1 Pro Preview measured
Design Arena: agents building Godot games1236Not measuredOnly Gemini 3.1 Pro Preview measured
Design Arena: agents building games1114Not measuredOnly Gemini 3.1 Pro Preview measured
Design Arena: HTML slides11531189GLM 5.3
Design Arena: PowerPoint slides10641255GLM 5.3
LiveBench researchNot measured73.2%Only GLM 5.3 measured
LiveBench browserNot measured0.0%Only GLM 5.3 measured
LiveBench long agenticNot measured35.9%Only GLM 5.3 measured
SREBench (Vals AI)0.0%9.2%GLM 5.3
Finance Agent (Vals AI)43.0%55.8%GLM 5.3
Tax Agent Bench (Vals AI)9.3%39.7%GLM 5.3
Legal Research Bench (Vals AI)20.7%49.0%GLM 5.3
Harvey's Legal Agent Benchmark (Vals AI)Not measured14.6%Only GLM 5.3 measured
Excel Modeling Benchmark (Vals AI)52.6%56.3%GLM 5.3
BioMysteryBench (Vals AI)60.0%Not measuredOnly Gemini 3.1 Pro Preview measured
Terminal-Bench-Science (Vals AI)1.4%5.7%GLM 5.3
Vals Science Index27.4%Not measuredOnly Gemini 3.1 Pro Preview measured
τ²-Bench Telecom95.6%Not measuredOnly Gemini 3.1 Pro Preview measured
APEX-Agents35.1%56.6%GLM 5.3
METR time horizons77.0%Not measuredOnly Gemini 3.1 Pro Preview measured
BALROG57.0%Not measuredOnly Gemini 3.1 Pro Preview measured
DeepResearch Bench47.8%Not measuredOnly Gemini 3.1 Pro Preview measured
PostTrainBench22.0%Not measuredOnly Gemini 3.1 Pro Preview measured
Vending-Bench 2$911$8,164GLM 5.3
Neither model has a result on the other 11 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index64
Reasoning benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
GPQA Diamond95.5%88.1%Gemini 3.1 Pro Preview
LiveBench reasoningNot measured85.8%Only GLM 5.3 measured
MysteryMechanism (Vals AI)20.7%23.0%GLM 5.3
MMMU Pro (Vals AI)88.2%Not measuredOnly Gemini 3.1 Pro Preview measured
GPQA Diamond (Artificial Analysis run)94.1%91.7%Gemini 3.1 Pro Preview
Humanity's Last Exam (Artificial Analysis run)47.0%42.3%Gemini 3.1 Pro Preview
GPQA Diamond (Epoch AI run)94.4%90.9%Gemini 3.1 Pro Preview
ARC-AGI98.0%Not measuredOnly Gemini 3.1 Pro Preview measured
ARC-AGI-277.1%Not measuredOnly Gemini 3.1 Pro Preview measured
SimpleBench79.6%Not measuredOnly Gemini 3.1 Pro Preview measured
Chess puzzles51.0%37.0%Gemini 3.1 Pro Preview
Mystery game puzzles34.0%33.0%Gemini 3.1 Pro Preview
EBR-bench14.3%Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Text: hard prompts14851490GLM 5.3
LMArena Text: expert14831514GLM 5.3
LMArena Text: hard prompts in English14801496GLM 5.3
LMArena Vision: diagrams1311Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Vision: homework1316Not measuredOnly Gemini 3.1 Pro Preview measured
Neither model has a result on the other 3 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index15
Math benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
AIME98.1%Not measuredOnly Gemini 3.1 Pro Preview measured
OTIS Mock AIME95.6%91.1%Gemini 3.1 Pro Preview
FrontierMath, tiers 1 to 359.6%68.8%GLM 5.3
FrontierMath, tier 426.8%29.3%GLM 5.3
ProofBench26.0%49.0%GLM 5.3
LMArena Text: math14861495GLM 5.3
LMArena Text: mathematical work14781497GLM 5.3
Neither model has a result on the other 6 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index72
Knowledge benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
MMLU Pro91.0%86.8%Gemini 3.1 Pro Preview
LegalBench (Vals AI)87.4%84.8%Gemini 3.1 Pro Preview
CaseLaw (Vals AI)64.8%Not measuredOnly Gemini 3.1 Pro Preview measured
CorpFin (Vals AI)64.5%Not measuredOnly Gemini 3.1 Pro Preview measured
TaxEval (Vals AI)72.9%72.4%Gemini 3.1 Pro Preview
MortgageTax (Vals AI)69.4%Not measuredOnly Gemini 3.1 Pro Preview measured
MedQA (Vals AI)96.4%Not measuredOnly Gemini 3.1 Pro Preview measured
MedCode (Vals AI)59.1%42.9%Gemini 3.1 Pro Preview
SimpleQA Verified73.5%41.0%Gemini 3.1 Pro Preview
LMArena Text: science14971498GLM 5.3
LMArena Text: medicine and healthcare14861481Gemini 3.1 Pro Preview
LMArena Text: legal and government14871473Gemini 3.1 Pro Preview
LMArena Text: business and finance14591459GLM 5.3
Neither model has a result on the other 4 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index17
Web design benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
Design Arena: websites12341295GLM 5.3
Design Arena: UI components12261314GLM 5.3
Design Arena: game dev12031311GLM 5.3
Design Arena: data viz12091260GLM 5.3
Design Arena: 3D12341332GLM 5.3
Design Arena: all code categories12311304GLM 5.3
Design Arena: SVG12851292GLM 5.3
Design Arena: ASCII art12701213Gemini 3.1 Pro Preview
LiveBench designNot measured77.3%Only GLM 5.3 measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index139
General benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
Vals IndexNot measured59.7%Only GLM 5.3 measured
LiveBench data analysisNot measured70.2%Only GLM 5.3 measured
Public Benefits Bench (Vals AI)53.8%68.5%GLM 5.3
SAGE (Vals AI)48.7%Not measuredOnly Gemini 3.1 Pro Preview measured
MedScribe (Vals AI)76.1%88.8%GLM 5.3
Vals Multimodal Index56.1%Not measuredOnly Gemini 3.1 Pro Preview measured
IFBench77.1%Not measuredOnly Gemini 3.1 Pro Preview measured
Long context reasoning (AA-LCR)82.0%79.7%Gemini 3.1 Pro Preview
DTBench97.1%87.7%Gemini 3.1 Pro Preview
LMCA53.8%55.5%GLM 5.3
CL-bench20.8%Not measuredOnly Gemini 3.1 Pro Preview measured
Furniture assembly26.7%Not measuredOnly Gemini 3.1 Pro Preview measured
ExploitBench26.1%Not measuredOnly Gemini 3.1 Pro Preview measured
CL-bench Life16.9%Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Text14801474Gemini 3.1 Pro Preview
LMArena Text: instruction following14661479GLM 5.3
LMArena Text: creative writing14821458Gemini 3.1 Pro Preview
LMArena Vision1296Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Text: English14781482GLM 5.3
LMArena Text: non-English14761459Gemini 3.1 Pro Preview
LMArena Text: Chinese15271532GLM 5.3
LMArena Text: German14901488Gemini 3.1 Pro Preview
LMArena Text: Japanese14911460Gemini 3.1 Pro Preview
LMArena Text: Korean14551460GLM 5.3
LMArena Text: French14871503GLM 5.3
LMArena Text: Spanish14811462Gemini 3.1 Pro Preview
LMArena Text: Russian14971469Gemini 3.1 Pro Preview
LMArena Text: Polish14981466Gemini 3.1 Pro Preview
LMArena Text: multi-turn14871472Gemini 3.1 Pro Preview
LMArena Text: longer queries14821483GLM 5.3
LMArena Text: writing and language14811469Gemini 3.1 Pro Preview
LMArena Text: entertainment and media14651447Gemini 3.1 Pro Preview
LMArena Vision: English1287Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Vision: Chinese1364Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Vision: reading text1304Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Vision: humor1322Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Vision: captioning1345Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Vision: recognizing things1330Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Vision: creative writing1324Not measuredOnly Gemini 3.1 Pro Preview measured
LMArena Document1444Not measuredOnly Gemini 3.1 Pro Preview measured
Neither model has a result on the other 6 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Gemini 3.1 Pro Preview and GLM 5.3
BenchmarkGemini 3.1 Pro PreviewGLM 5.3Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 3.1 Pro Preview$0.0080Fits in one request
GLM 5.3$0.0008Fits in one request

GLM 5.3 costs less

Repository review

50K input + 3K output tokens

Gemini 3.1 Pro Preview$0.136Fits in one request
GLM 5.3$0.0081Fits in one request

GLM 5.3 costs less

Agent loop

200K input + 10K output tokens

Gemini 3.1 Pro Preview$0.520Fits in one request
GLM 5.3$0.030Fits in one request

GLM 5.3 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 3.1 Pro Preview and GLM 5.3
SpecificationGoogle Gemini 3.1 Pro PreviewZ.ai GLM 5.3
MakerGoogleZ.ai
WeightsNo public weights listedOpen weights
ReleasedFebruary 19, 2026August 18, 2026
Context window1.05M1.05M
Input $/Mtok$2.00$0.079
Output $/Mtok$12.00$1.40
Coding index35.373.1
Independent measurements behind it12
Cost per solved task$0.99$0.36
SourceOpenRouter listingOpenRouter listing

Questions

Is Gemini 3.1 Pro Preview better than GLM 5.3 for coding?

Pick GLM 5.3 for coding: it scores 73.1 on the Vibe Coding Index against 35.3 for Gemini 3.1 Pro Preview. Pick Gemini 3.1 Pro Preview when what matters is LiveCodeBench (Vals AI) or GPQA Diamond, where it leads.

Which is cheaper, Gemini 3.1 Pro Preview or GLM 5.3?

Gemini 3.1 Pro Preview costs $2.00 per million input tokens and $12.00 per million output tokens; GLM 5.3 costs $0.079 and $1.40. Per solved SWE-bench Verified task, Gemini 3.1 Pro Preview costs $0.99 and GLM 5.3 $0.36.

Which has the bigger context window, Gemini 3.1 Pro Preview or GLM 5.3?

Neither: both take 1.05M tokens.

How many benchmarks is the Gemini 3.1 Pro Preview vs GLM 5.3 comparison based on?

86 benchmarks have a result for both models as of October 21, 2026. Gemini 3.1 Pro Preview's coding index rests on 1 independent benchmark and GLM 5.3's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next