LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Gemini 3.1 Flash Lite Preview vs GLM 5.1

Updated October 21, 2026. 60 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace Gemini 3.1 Flash Lite Preview Replace GLM 5.1
Gemini 3.1 Flash Lite PreviewGoogle
Coding
8.1
Overall
15.6
Output $/M
$1.50
4
GLM 5.1Z.ai
Coding
44.0
Overall
26.1
Output $/M
$4.40
55
vs boards won of 60 shared, 1 tied

Decision reading

Pick GLM 5.1 for coding: it scores 44.0 on the Vibe Coding Index against 8.1 for Gemini 3.1 Flash Lite Preview.

Pick Gemini 3.1 Flash Lite Preview when output tokens cost 2.9x less, or when a solved task costs $0.18 against $0.60.

Model AGemini 3.1 Flash Lite PreviewGoogle8.1/1001 independent benchmark$0.18 per solved taskModel BGLM 5.1Z.ai44.0/1001 independent benchmark$0.60 per solved task
Shared results
60
Gemini 3.1 Flash Lite Preview only
17
GLM 5.1 only
29
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Gemini 3.1 Flash Lite Preview 8.1 from 1 benchmark, GLM 5.1 44.0 from 1 benchmark.
Widest category
Web design, 25.9 points apart on average over 8 shared benchmarks.
Widest single gap
LMArena WebDev: React: Gemini 3.1 Flash Lite Preview 1245 against GLM 5.1 1505, 43.3 points apart on a 0 to 100 scale.
Output price
Gemini 3.1 Flash Lite Preview $1.50 against GLM 5.1 $4.40 per million output tokens, 2.9x apart.
Context window
Gemini 3.1 Flash Lite Preview takes 1.05M tokens, GLM 5.1 205K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGemini 3.1 Flash Lite PreviewBarsGLM 5.1Ties
Coding0121 tie
Intelligence01
Agentic work03
Reasoning04
Math03
Knowledge37
Web design17
General018
All shared boards4551 tie
CodingLike-for-likeFour of these boards feed the Vibe Coding Index012
Coding benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
LMArena WebDev12571508GLM 5.1
AA Coding Index34.755.8GLM 5.1
LiveCodeBench (Vals AI)80.1%81.4%GLM 5.1
SWE-bench Verified (Vals AI)62.8%76.4%GLM 5.1
Vibe Code Bench (Vals AI)0.0%31.5%GLM 5.1
Code migration (Vals AI)4.6%25.8%GLM 5.1
ProgramBench (Vals AI)0.0%0.0%Tie
Terminal-Bench 2.1 (Vals AI)34.1%56.9%GLM 5.1
SciCodeNot measured44.8%Only GLM 5.1 measured
Terminal-Bench Hard (Artificial Analysis run)Not measured43.2%Only GLM 5.1 measured
WeirdMLNot measured57.1%Only GLM 5.1 measured
ALE-Bench797.7887.1GLM 5.1
LMArena Text: coding14001485GLM 5.1
LMArena Text: software and IT14131484GLM 5.1
LMArena WebDev: React12451505GLM 5.1
LMArena WebDev: HTML12761508GLM 5.1
LMArena WebDev: from an image1336Not measuredOnly Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 21 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
AA Intelligence Index15.626.1GLM 5.1
Epoch Capabilities IndexNot measured149.8Only GLM 5.1 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index03
Agentic work benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
AA Agentic Index1.623.9GLM 5.1
Design Arena: agents building web appsNot measured1175Only GLM 5.1 measured
Design Arena: agents building full-stack appsNot measured1167Only GLM 5.1 measured
Design Arena: agents building mobile appsNot measured1162Only GLM 5.1 measured
Design Arena: agents building Android appsNot measured1186Only GLM 5.1 measured
Design Arena: agents building Godot gamesNot measured1053Only GLM 5.1 measured
Design Arena: agents building gamesNot measured1164Only GLM 5.1 measured
Design Arena: HTML slidesNot measured1170Only GLM 5.1 measured
Design Arena: PowerPoint slidesNot measured1189Only GLM 5.1 measured
Design Arena: spreadsheetsNot measured1315Only GLM 5.1 measured
Finance Agent (Vals AI)30.0%44.8%GLM 5.1
Tax Agent Bench (Vals AI)3.1%Not measuredOnly Gemini 3.1 Flash Lite Preview measured
Legal Research Bench (Vals AI)3.4%27.9%GLM 5.1
Excel Modeling Benchmark (Vals AI)8.6%Not measuredOnly Gemini 3.1 Flash Lite Preview measured
τ²-Bench TelecomNot measured97.7%Only GLM 5.1 measured
APEX-AgentsNot measured40.9%Only GLM 5.1 measured
Vending-Bench 2Not measured$5,634Only GLM 5.1 measured
Neither model has a result on the other 22 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index04
Reasoning benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
GPQA Diamond81.1%84.5%GLM 5.1
MMMU Pro (Vals AI)82.5%Not measuredOnly Gemini 3.1 Flash Lite Preview measured
GPQA Diamond (Artificial Analysis run)Not measured86.8%Only GLM 5.1 measured
Humanity's Last Exam (Artificial Analysis run)Not measured30.1%Only GLM 5.1 measured
GPQA Diamond (Epoch AI run)Not measured89.9%Only GLM 5.1 measured
SimpleBenchNot measured55.1%Only GLM 5.1 measured
Chess puzzlesNot measured20.0%Only GLM 5.1 measured
LMArena Text: hard prompts14071473GLM 5.1
LMArena Text: expert13981478GLM 5.1
LMArena Text: hard prompts in English14031482GLM 5.1
LMArena Vision: diagrams1242Not measuredOnly Gemini 3.1 Flash Lite Preview measured
LMArena Vision: homework1271Not measuredOnly Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 9 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index03
Math benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
AIME83.3%91.9%GLM 5.1
OTIS Mock AIMENot measured93.3%Only GLM 5.1 measured
FrontierMath, tiers 1 to 3Not measured36.8%Only GLM 5.1 measured
ProofBenchNot measured22.2%Only GLM 5.1 measured
LMArena Text: math14281473GLM 5.1
LMArena Text: mathematical work14171470GLM 5.1
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index37
Knowledge benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
MMLU Pro86.2%86.9%GLM 5.1
LegalBench (Vals AI)83.8%84.4%GLM 5.1
CaseLaw (Vals AI)55.0%51.5%Gemini 3.1 Flash Lite Preview
CorpFin (Vals AI)59.4%64.5%GLM 5.1
TaxEval (Vals AI)71.8%71.2%Gemini 3.1 Flash Lite Preview
MortgageTax (Vals AI)68.0%Not measuredOnly Gemini 3.1 Flash Lite Preview measured
MedCode (Vals AI)47.6%41.6%Gemini 3.1 Flash Lite Preview
SimpleQA VerifiedNot measured34.0%Only GLM 5.1 measured
LMArena Text: science14251478GLM 5.1
LMArena Text: medicine and healthcare14281474GLM 5.1
LMArena Text: legal and government14181465GLM 5.1
LMArena Text: business and finance13891452GLM 5.1
Neither model has a result on the other 5 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index17
Web design benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
Design Arena: websites10831290GLM 5.1
Design Arena: UI components10711292GLM 5.1
Design Arena: game dev10291265GLM 5.1
Design Arena: data viz10451366GLM 5.1
Design Arena: 3D10481336GLM 5.1
Design Arena: all code categories10721268GLM 5.1
Design Arena: SVG10521217GLM 5.1
Design Arena: ASCII art11661142Gemini 3.1 Flash Lite Preview
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index018
General benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
Public Benefits Bench (Vals AI)Not measured61.8%Only GLM 5.1 measured
SAGE (Vals AI)49.5%Not measuredOnly Gemini 3.1 Flash Lite Preview measured
MedScribe (Vals AI)63.9%72.3%GLM 5.1
Vals Multimodal Index41.4%Not measuredOnly Gemini 3.1 Flash Lite Preview measured
IFBenchNot measured76.3%Only GLM 5.1 measured
Long context reasoning (AA-LCR)Not measured73.7%Only GLM 5.1 measured
ExploitBenchNot measured18.1%Only GLM 5.1 measured
LMArena Text14161463GLM 5.1
LMArena Text: instruction following13771453GLM 5.1
LMArena Text: creative writing14011453GLM 5.1
LMArena Vision1240Not measuredOnly Gemini 3.1 Flash Lite Preview measured
LMArena Text: English14141476GLM 5.1
LMArena Text: non-English14101448GLM 5.1
LMArena Text: Chinese14601515GLM 5.1
LMArena Text: German14301467GLM 5.1
LMArena Text: Japanese14131435GLM 5.1
LMArena Text: Korean13921424GLM 5.1
LMArena Text: French14241470GLM 5.1
LMArena Text: Spanish14211468GLM 5.1
LMArena Text: Russian14201454GLM 5.1
LMArena Text: Polish14431449GLM 5.1
LMArena Text: multi-turn14171473GLM 5.1
LMArena Text: longer queries13941467GLM 5.1
LMArena Text: writing and language14081454GLM 5.1
LMArena Text: entertainment and media13861442GLM 5.1
LMArena Vision: English1232Not measuredOnly Gemini 3.1 Flash Lite Preview measured
LMArena Vision: Chinese1278Not measuredOnly Gemini 3.1 Flash Lite Preview measured
LMArena Vision: reading text1246Not measuredOnly Gemini 3.1 Flash Lite Preview measured
LMArena Vision: humor1266Not measuredOnly Gemini 3.1 Flash Lite Preview measured
LMArena Vision: captioning1259Not measuredOnly Gemini 3.1 Flash Lite Preview measured
LMArena Vision: recognizing things1308Not measuredOnly Gemini 3.1 Flash Lite Preview measured
LMArena Vision: creative writing1248Not measuredOnly Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 14 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Gemini 3.1 Flash Lite Preview and GLM 5.1
BenchmarkGemini 3.1 Flash Lite PreviewGLM 5.1Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Gemini 3.1 Flash Lite Preview$0.0010Fits in one request
GLM 5.1$0.0036Fits in one request

Gemini 3.1 Flash Lite Preview costs less

Repository review

50K input + 3K output tokens

Gemini 3.1 Flash Lite Preview$0.017Fits in one request
GLM 5.1$0.083Fits in one request

Gemini 3.1 Flash Lite Preview costs less

Agent loop

200K input + 10K output tokens

Gemini 3.1 Flash Lite Preview$0.065Fits in one request
GLM 5.1$0.324Exceeds the context window

Gemini 3.1 Flash Lite Preview costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Gemini 3.1 Flash Lite Preview and GLM 5.1
SpecificationGoogle Gemini 3.1 Flash Lite PreviewZ.ai GLM 5.1
MakerGoogleZ.ai
WeightsNo public weights listedOpen weights
ReleasedMarch 3, 2026April 7, 2026
Context window1.05M205K
Input $/Mtok$0.25$1.40
Output $/Mtok$1.50$4.40
Coding index8.144.0
Independent measurements behind it11
Cost per solved task$0.18$0.60
SourceOpenRouter listingOpenRouter listing

Questions

Is Gemini 3.1 Flash Lite Preview better than GLM 5.1 for coding?

Pick GLM 5.1 for coding: it scores 44.0 on the Vibe Coding Index against 8.1 for Gemini 3.1 Flash Lite Preview. Pick Gemini 3.1 Flash Lite Preview when output tokens cost 2.9x less, or when a solved task costs $0.18 against $0.60.

Which is cheaper, Gemini 3.1 Flash Lite Preview or GLM 5.1?

Gemini 3.1 Flash Lite Preview costs $0.25 per million input tokens and $1.50 per million output tokens; GLM 5.1 costs $1.40 and $4.40. Per solved SWE-bench Verified task, Gemini 3.1 Flash Lite Preview costs $0.18 and GLM 5.1 $0.60.

Which has the bigger context window, Gemini 3.1 Flash Lite Preview or GLM 5.1?

Gemini 3.1 Flash Lite Preview, with 1.05M tokens against 205K.

How many benchmarks is the Gemini 3.1 Flash Lite Preview vs GLM 5.1 comparison based on?

60 benchmarks have a result for both models as of October 21, 2026. Gemini 3.1 Flash Lite Preview's coding index rests on 1 independent benchmark and GLM 5.1's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next