LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Z.ai GLM 5.1

As of October 20, 2026, Z.ai GLM 5.1 ranks #64 of 213 models overall with 26.1 on the Artificial Analysis Intelligence Index. Its strongest category is web design, where it ranks #24 of 131. Z.ai GLM 5.1 costs $0.966 per million input tokens and $3.036 per million output tokens. It was released on April 7, 2026.

Its output price ranks 234 of 349 priced models, counting from the cheapest.

  • Coding index 44.0 Thin, 1 benchmark
  • Cost per solved task $0.60 One SWE-bench Verified task, solved
  • Output, per million tokens $3.036 234 of 349 from the cheapest
  • Input, per million tokens $0.966 OpenRouter list price
  • Context window 205K Tokens per request
  • Downloads, 30 days 547K Hugging Face

About and specs

GLM-5.1 delivers a major leap in coding capability, with particularly significant gains in handling long-horizon tasks. Unlike previous models built around minute-level interactions, GLM-5.1 can work independently and continuously on...

API model id z-ai/glm-5.1
  • Tool callingListed
  • Structured outputsListed
  • JSON modeListed
  • Reasoning modeListed
  • Web searchNot listed
Takes in
Text
Gives back
Text
Context window
205K tokens
Max output
128K tokens
Knowledge cutoff
Not published
Cached input $/Mtok
$0.1794
Cache write $/Mtok
No cache write price listed
Reasoning $/Mtok
Not priced apart
Web search, per request
No search price listed
Tokenizer
Not named
Requests moderated
No
Withdrawn on
No date announced
Parameters
753.9B, per its Hugging Face weights
Downloads, all time
1.3M on Hugging Face
Training compute
No estimate published
Output speed
Not measured
Time to first token
Not measured
Speed on OpenRouter
25 tokens/s via Z.AI, 30-minute median
First token on OpenRouter
9.3 s via Z.AI, 30-minute median

Benchmarks: 89 of 190 measured

The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.

Where it stands

Full leaderboard
#64of 213 overall 26.1AA Intelligence Index

Measured in 6 of 6 categories. A place counts only the models measured on that board.

Coding index

44.0
  • Aider polyglot Not measured
  • SWE-bench Verified Not measured
  • LiveBench coding Not measured
  • LMArena WebDev Elo, scaled from 1200 to 1900 1508 Elo 44 of 100

The index averages only the coding benchmarks that have a result; the others are skipped, never filled in. How it is weighted

Other public boards

All rankings

Best placings

  1. Design Arena: data viz3#3 of 119
  2. τ²-Bench Telecom#8 of 129
  3. IFBench#14 of 131
  4. Design Arena: 3D#15 of 116

Lowest placings

  1. Design Arena: agents building Godot games#35 of 37
  2. CaseLaw (Vals AI)#41 of 45
  3. MedScribe (Vals AI)#71 of 85

Coding15 of 34 boards

9 more coding boards

Not measured on SWE-bench Lite, SWE-bench (full test set), SWE-bench Multimodal, SWE-bench Multilingual, Terminal-Bench 4 (Vals AI), IOI (Vals AI), SWE-bench Multimodal (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), CyberBench (Vals AI), LiveCodeBench (Artificial Analysis run), Terminal-Bench, DeepSWE, FrontierCode, FrontierSWE, GSO-Bench, MirrorCode, Cybench, LMArena WebDev: from an image

Intelligence2 of 2 boards

Agentic work15 of 39 boards

9 more agentic work boards

Not measured on LiveBench research, LiveBench browser, LiveBench long agentic, SREBench (Vals AI), Tax Agent Bench (Vals AI), Harvey's Legal Agent Benchmark (Vals AI), Excel Modeling Benchmark (Vals AI), BioMysteryBench (Vals AI), Terminal-Bench-Science (Vals AI), Vals Science Index, Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, BALROG, DeepResearch Bench, PostTrainBench, TheAgentCompany, OSWorld, SpireClimb, LMArena Search

Reasoning9 of 21 boards

3 more reasoning boards

Not measured on LiveBench reasoning, MysteryMechanism (Vals AI), MMMU Pro (Vals AI), ARC-AGI, ARC-AGI-2, Humanity's Last Exam, Mystery game puzzles, EBR-bench, VPCT, BIG-Bench Hard, LMArena Vision: diagrams, LMArena Vision: homework

Math6 of 13 boards

Not measured on MATH 500 (Vals AI), MGSM (Vals AI), AA Math Index, AIME 2025 (Artificial Analysis run), FrontierMath, tier 4, MATH level 5, GSM8K

Knowledge11 of 17 boards

5 more knowledge boards

Not measured on MortgageTax (Vals AI), MedQA (Vals AI), MMLU Pro (Artificial Analysis run), MMLU, GeoBench, AI2 Reasoning Challenge

Web design8 of 9 boards

2 more web design boards

Not measured on LiveBench design

General22 of 46 boards

16 more general boards

Not measured on Vals Index, LiveBench data analysis, SAGE (Vals AI), Vals Multimodal Index, DTBench, LMCA, Fiction.LiveBench, Creative writing (Lech Mazur), CL-bench, Surface Evolver Bench, Furniture assembly, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Vision, LMArena Vision: English, LMArena Vision: Chinese, LMArena Vision: reading text, LMArena Vision: humor, LMArena Vision: captioning, LMArena Vision: recognizing things, LMArena Vision: creative writing, LMArena Document

Image generation0 of 5 boards

Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit

Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.

All 190 benchmarks as a table
Benchmark results for Z.ai GLM 5.1
BenchmarkResultIndex weight
Aider polyglotCoding Not measured 35%
SWE-bench VerifiedCoding Not measured 30%
SWE-bench LiteCoding Not measured Not in index
SWE-bench (full test set)Coding Not measured Not in index
SWE-bench MultimodalCoding Not measured Not in index
SWE-bench MultilingualCoding Not measured Not in index
LiveBench codingCoding Not measured 20%
LMArena WebDevCoding 1508 15%
Vals IndexGeneral Not measured Not in index
GPQA DiamondReasoning 84.5% Not in index
AIMEMath 91.9% Not in index
MMLU ProKnowledge 86.9% Not in index
AA Intelligence IndexIntelligence 26.1 Not in index
AA Coding IndexCoding 55.8 Not in index
AA Agentic IndexAgentic work 23.9 Not in index
Design Arena: websitesWeb design 1290 Not in index
Design Arena: UI componentsWeb design 1292 Not in index
Design Arena: game devWeb design 1264 Not in index
Design Arena: data vizWeb design 1366 Not in index
Design Arena: 3DWeb design 1336 Not in index
Design Arena: all code categoriesWeb design 1269 Not in index
Design Arena: SVGWeb design 1217 Not in index
Design Arena: ASCII artWeb design 1142 Not in index
Design Arena: agents building web appsAgentic work 1175 Not in index
Design Arena: agents building full-stack appsAgentic work 1167 Not in index
Design Arena: agents building mobile appsAgentic work 1161 Not in index
Design Arena: agents building Android appsAgentic work 1195 Not in index
Design Arena: agents building Godot gamesAgentic work 1053 Not in index
Design Arena: agents building gamesAgentic work 1164 Not in index
Design Arena: HTML slidesAgentic work 1170 Not in index
Design Arena: PowerPoint slidesAgentic work 1189 Not in index
Design Arena: spreadsheetsAgentic work 1315 Not in index
Design Arena: imagesImage generation Not measured Not in index
Design Arena: graphic designImage generation Not measured Not in index
Design Arena: logosImage generation Not measured Not in index
LiveBench reasoningReasoning Not measured Not in index
LiveBench data analysisGeneral Not measured Not in index
LiveBench researchAgentic work Not measured Not in index
LiveBench browserAgentic work Not measured Not in index
LiveBench long agenticAgentic work Not measured Not in index
LiveBench designWeb design Not measured Not in index
LiveCodeBench (Vals AI)Coding 81.4% Not in index
SWE-bench Verified (Vals AI)Coding 76.4% Not in index
Terminal-Bench 4 (Vals AI)Coding Not measured Not in index
Vibe Code Bench (Vals AI)Coding 31.5% Not in index
Code migration (Vals AI)Coding 25.8% Not in index
ProgramBench (Vals AI)Coding 0.0% Not in index
SREBench (Vals AI)Agentic work Not measured Not in index
IOI (Vals AI)Coding Not measured Not in index
Terminal-Bench 2.1 (Vals AI)Coding 56.9% Not in index
SWE-bench Multimodal (Vals AI)Coding Not measured Not in index
Vibe Code Bench 1-100 (Vals AI)Coding Not measured Not in index
SkillsBench (Vals AI)Coding Not measured Not in index
CyberBench (Vals AI)Coding Not measured Not in index
Finance Agent (Vals AI)Agentic work 44.8% Not in index
Tax Agent Bench (Vals AI)Agentic work Not measured Not in index
Legal Research Bench (Vals AI)Agentic work 27.9% Not in index
Harvey's Legal Agent Benchmark (Vals AI)Agentic work Not measured Not in index
Excel Modeling Benchmark (Vals AI)Agentic work Not measured Not in index
BioMysteryBench (Vals AI)Agentic work Not measured Not in index
Terminal-Bench-Science (Vals AI)Agentic work Not measured Not in index
Vals Science IndexAgentic work Not measured Not in index
Time Horizon Index (Vals AI)Agentic work Not measured Not in index
CUA-bench (Vals AI)Agentic work Not measured Not in index
Robo-bench (Vals AI)Agentic work Not measured Not in index
Public Benefits Bench (Vals AI)General 61.8% Not in index
MysteryMechanism (Vals AI)Reasoning Not measured Not in index
MMMU Pro (Vals AI)Reasoning Not measured Not in index
MATH 500 (Vals AI)Math Not measured Not in index
MGSM (Vals AI)Math Not measured Not in index
SAGE (Vals AI)General Not measured Not in index
LegalBench (Vals AI)Knowledge 84.4% Not in index
CaseLaw (Vals AI)Knowledge 51.5% Not in index
CorpFin (Vals AI)Knowledge 64.5% Not in index
TaxEval (Vals AI)Knowledge 71.2% Not in index
MortgageTax (Vals AI)Knowledge Not measured Not in index
MedQA (Vals AI)Knowledge Not measured Not in index
MedCode (Vals AI)Knowledge 41.6% Not in index
MedScribe (Vals AI)General 72.3% Not in index
Vals Multimodal IndexGeneral Not measured Not in index
AA Math IndexMath Not measured Not in index
GPQA Diamond (Artificial Analysis run)Reasoning 86.8% Not in index
Humanity's Last Exam (Artificial Analysis run)Reasoning 30.1% Not in index
MMLU Pro (Artificial Analysis run)Knowledge Not measured Not in index
LiveCodeBench (Artificial Analysis run)Coding Not measured Not in index
SciCodeCoding 44.8% Not in index
Terminal-Bench Hard (Artificial Analysis run)Coding 43.2% Not in index
IFBenchGeneral 76.3% Not in index
Long context reasoning (AA-LCR)General 73.7% Not in index
τ²-Bench TelecomAgentic work 97.7% Not in index
AIME 2025 (Artificial Analysis run)Math Not measured Not in index
Terminal-BenchCoding Not measured Not in index
DeepSWECoding Not measured Not in index
FrontierCodeCoding Not measured Not in index
FrontierSWECoding Not measured Not in index
GSO-BenchCoding Not measured Not in index
WeirdMLCoding 57.1% Not in index
MirrorCodeCoding Not measured Not in index
APEX-AgentsAgentic work 40.9% Not in index
METR time horizonsAgentic work Not measured Not in index
Remote Labor IndexAgentic work Not measured Not in index
GDPvalAgentic work Not measured Not in index
OSWorld 2.0Agentic work Not measured Not in index
BALROGAgentic work Not measured Not in index
DeepResearch BenchAgentic work Not measured Not in index
PostTrainBenchAgentic work Not measured Not in index
GPQA Diamond (Epoch AI run)Reasoning 89.9% Not in index
ARC-AGIReasoning Not measured Not in index
ARC-AGI-2Reasoning Not measured Not in index
Humanity's Last ExamReasoning Not measured Not in index
SimpleBenchReasoning 55.1% Not in index
Chess puzzlesReasoning 20.0% Not in index
Mystery game puzzlesReasoning Not measured Not in index
EBR-benchReasoning Not measured Not in index
OTIS Mock AIMEMath 93.3% Not in index
FrontierMath, tiers 1 to 3Math 36.8% Not in index
FrontierMath, tier 4Math Not measured Not in index
ProofBenchMath 22.2% Not in index
MATH level 5Math Not measured Not in index
GSM8KMath Not measured Not in index
SimpleQA VerifiedKnowledge 34.0% Not in index
MMLUKnowledge Not measured Not in index
GeoBenchKnowledge Not measured Not in index
DTBenchGeneral Not measured Not in index
LMCAGeneral Not measured Not in index
Fiction.LiveBenchGeneral Not measured Not in index
Creative writing (Lech Mazur)General Not measured Not in index
CL-benchGeneral Not measured Not in index
Surface Evolver BenchGeneral Not measured Not in index
Furniture assemblyGeneral Not measured Not in index
ExploitBenchGeneral 18.1% Not in index
CybenchCoding Not measured Not in index
TheAgentCompanyAgentic work Not measured Not in index
OSWorldAgentic work Not measured Not in index
SpireClimbAgentic work Not measured Not in index
VPCTReasoning Not measured Not in index
BIG-Bench HardReasoning Not measured Not in index
AI2 Reasoning ChallengeKnowledge Not measured Not in index
HellaSwagGeneral Not measured Not in index
WinoGrandeGeneral Not measured Not in index
PIQAGeneral Not measured Not in index
CL-bench LifeGeneral Not measured Not in index
ALE-BenchCoding 887.1 Not in index
Vending-Bench 2Agentic work $5,634 Not in index
Epoch Capabilities IndexIntelligence 150.0 Not in index
LMArena TextGeneral 1462 Not in index
LMArena Text: codingCoding 1485 Not in index
LMArena Text: hard promptsReasoning 1472 Not in index
LMArena Text: mathMath 1473 Not in index
LMArena Text: instruction followingGeneral 1452 Not in index
LMArena Text: creative writingGeneral 1454 Not in index
LMArena VisionGeneral Not measured Not in index
LMArena Text: EnglishGeneral 1475 Not in index
LMArena Text: non-EnglishGeneral 1448 Not in index
LMArena Text: ChineseGeneral 1514 Not in index
LMArena Text: GermanGeneral 1467 Not in index
LMArena Text: JapaneseGeneral 1436 Not in index
LMArena Text: KoreanGeneral 1422 Not in index
LMArena Text: FrenchGeneral 1472 Not in index
LMArena Text: SpanishGeneral 1469 Not in index
LMArena Text: RussianGeneral 1454 Not in index
LMArena Text: PolishGeneral 1447 Not in index
LMArena Text: multi-turnGeneral 1472 Not in index
LMArena Text: longer queriesGeneral 1467 Not in index
LMArena Text: expertReasoning 1477 Not in index
LMArena Text: hard prompts in EnglishReasoning 1482 Not in index
LMArena Text: software and ITCoding 1483 Not in index
LMArena Text: mathematical workMath 1469 Not in index
LMArena Text: scienceKnowledge 1478 Not in index
LMArena Text: medicine and healthcareKnowledge 1473 Not in index
LMArena Text: legal and governmentKnowledge 1465 Not in index
LMArena Text: business and financeKnowledge 1452 Not in index
LMArena Text: writing and languageGeneral 1454 Not in index
LMArena Text: entertainment and mediaGeneral 1443 Not in index
LMArena WebDev: ReactCoding 1505 Not in index
LMArena WebDev: HTMLCoding 1508 Not in index
LMArena WebDev: from an imageCoding Not measured Not in index
LMArena Vision: EnglishGeneral Not measured Not in index
LMArena Vision: ChineseGeneral Not measured Not in index
LMArena Vision: reading textGeneral Not measured Not in index
LMArena Vision: diagramsReasoning Not measured Not in index
LMArena Vision: homeworkReasoning Not measured Not in index
LMArena Vision: humorGeneral Not measured Not in index
LMArena Vision: captioningGeneral Not measured Not in index
LMArena Vision: recognizing thingsGeneral Not measured Not in index
LMArena Vision: creative writingGeneral Not measured Not in index
LMArena SearchAgentic work Not measured Not in index
LMArena DocumentGeneral Not measured Not in index
LMArena Text to ImageImage generation Not measured Not in index
LMArena Image EditImage generation Not measured Not in index

What it costs

A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.

Output price against the market

GLM 5.1 pricing
$0.0112Dashed line: median $1.80, log scale$600.00
$3.036 per million output tokens is cheaper than 33% of the 344 paid models in the catalog.

Cost per solved task

How it is computed
$0.46one attempt, Vals AI 76.4%tasks solved $0.60per solved task

Nearly as good as GLM 5.1, for less

What the boards say about its runs

Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.

What each board publishes about the runs behind Z.ai: GLM 5.1's results
BoardResultWhat the run costAlso published
SWE-bench Verified (Vals AI) 76.4% $0.46 per test Duration, as printed 8m 47s
Vibe Code Bench (Vals AI) 31.5% $2.89 per test Duration, as printed 33m 35s
Code migration (Vals AI) 25.8% $5.70 per test Duration, as printed 58m 22s
Terminal-Bench 2.1 (Vals AI) 56.9% $0.23 per test Duration, as printed 15m 41s
Finance Agent (Vals AI) 44.8% $0.62 per test Duration, as printed 15m 24s
Legal Research Bench (Vals AI) 27.9% $0.39 per test Duration, as printed 5m 26s
Public Benefits Bench (Vals AI) 61.8% $0.34 per test Nothing else
WeirdML 57.1% $0.3175 per run Median lines of code 178
ProofBench 22.2% $0.5846 per test Time per proof 1h 19m
ALE-Bench 887.1 $0.1294 per problem Tokens per problem 31,928
LMArena WebDev 1508 Elo Not published Votes 10,703 · Interval (±) ±6.8
GPQA Diamond 84.5% Not published Latency, as printed 4m 10s
50 more boards
What each board publishes about the runs behind Z.ai: GLM 5.1's results, continued
AIME 91.9% Not published Latency, as printed 6m 15s
MMLU Pro 86.9% Not published Latency, as printed 1m 09s
Design Arena: agents building web apps 1175 Elo Not published Battles 7,155
Design Arena: agents building full-stack apps 1167 Elo Not published Battles 3,901
Design Arena: agents building mobile apps 1161 Elo Not published Battles 3,235
Design Arena: agents building Android apps 1195 Elo Not published Battles 1,078
Design Arena: agents building Godot games 1053 Elo Not published Battles 431
Design Arena: agents building games 1164 Elo Not published Battles 1,497
Design Arena: HTML slides 1170 Elo Not published Battles 3,133
Design Arena: PowerPoint slides 1189 Elo Not published Battles 1,933
Design Arena: spreadsheets 1315 Elo Not published Battles 29
LiveCodeBench (Vals AI) 81.4% Not published Latency, as printed 3m 46s
ProgramBench (Vals AI) 0.0% Not published Duration, as printed 1h 06m
LegalBench (Vals AI) 84.4% Not published Latency, as printed 14 s
CaseLaw (Vals AI) 51.5% Not published Latency, as printed 49 s
CorpFin (Vals AI) 64.5% Not published Latency, as printed 1m 08s
TaxEval (Vals AI) 71.2% Not published Latency, as printed 1m 24s
MedCode (Vals AI) 41.6% Not published Latency, as printed 1m 18s
MedScribe (Vals AI) 72.3% Not published Latency, as printed 1m 36s
APEX-Agents 40.9% Not published Mean score 56.8%
LMArena Text 1462 Elo Not published Votes 62,889 · Interval (±) ±3.6
LMArena Text: coding 1485 Elo Not published Votes 17,133 · Interval (±) ±5.5
LMArena Text: hard prompts 1472 Elo Not published Votes 41,196 · Interval (±) ±4.2
LMArena Text: math 1473 Elo Not published Votes 3,088 · Interval (±) ±11.0
LMArena Text: instruction following 1452 Elo Not published Votes 22,045 · Interval (±) ±5.0
LMArena Text: creative writing 1454 Elo Not published Votes 12,259 · Interval (±) ±6.4
LMArena Text: English 1475 Elo Not published Votes 26,947 · Interval (±) ±4.6
LMArena Text: non-English 1448 Elo Not published Votes 35,940 · Interval (±) ±4.3
LMArena Text: Chinese 1514 Elo Not published Votes 4,393 · Interval (±) ±9.5
LMArena Text: German 1467 Elo Not published Votes 1,009 · Interval (±) ±19.4
LMArena Text: Japanese 1436 Elo Not published Votes 851 · Interval (±) ±22.2
LMArena Text: Korean 1422 Elo Not published Votes 1,192 · Interval (±) ±18.4
LMArena Text: French 1472 Elo Not published Votes 2,245 · Interval (±) ±14.1
LMArena Text: Spanish 1469 Elo Not published Votes 2,067 · Interval (±) ±13.9
LMArena Text: Russian 1454 Elo Not published Votes 7,504 · Interval (±) ±7.4
LMArena Text: Polish 1447 Elo Not published Votes 1,156 · Interval (±) ±17.2
LMArena Text: multi-turn 1472 Elo Not published Votes 9,941 · Interval (±) ±6.7
LMArena Text: longer queries 1467 Elo Not published Votes 28,385 · Interval (±) ±4.8
LMArena Text: expert 1477 Elo Not published Votes 6,716 · Interval (±) ±7.8
LMArena Text: hard prompts in English 1482 Elo Not published Votes 17,950 · Interval (±) ±5.4
LMArena Text: software and IT 1483 Elo Not published Votes 24,729 · Interval (±) ±4.8
LMArena Text: mathematical work 1469 Elo Not published Votes 3,412 · Interval (±) ±10.7
LMArena Text: science 1478 Elo Not published Votes 10,348 · Interval (±) ±6.5
LMArena Text: medicine and healthcare 1473 Elo Not published Votes 4,478 · Interval (±) ±9.4
LMArena Text: legal and government 1465 Elo Not published Votes 4,966 · Interval (±) ±8.9
LMArena Text: business and finance 1452 Elo Not published Votes 12,138 · Interval (±) ±6.2
LMArena Text: writing and language 1454 Elo Not published Votes 16,617 · Interval (±) ±5.6
LMArena Text: entertainment and media 1443 Elo Not published Votes 14,929 · Interval (±) ±5.9
LMArena WebDev: React 1505 Elo Not published Votes 8,155 · Interval (±) ±7.7
LMArena WebDev: HTML 1508 Elo Not published Votes 1,208 · Interval (±) ±18.2

On these lists

Compare with models of a similar score

All 135 comparisons for GLM 5.1