GLM 5.1 vs GPT-6 Astra

GPT-6 Astra leads GLM 5.1 on coding, 85.1 to 49.2 on the Vibe Coding Index, and GLM 5.1 costs 11.4x less per output token ($4.40 vs $50.00 per million). Updated October 22, 2026; 71 benchmarks have a result for both.

Replace GLM 5.1 Replace GPT-6 Astra

GLM 5.1Z.ai

Coding: 49.2
Overall: 57.5
Output $/M: $4.40

GPT-6 AstraOpenAI

Coding: 85.1
Overall: 83.0
Output $/M: $50.00

vs boards won of 71 shared

GLM 5.1 or GPT-6 Astra: which to pick

Pick GPT-6 Astra for coding: it scores 85.1 on the Vibe Coding Index against 49.2 for GLM 5.1.

Pick GLM 5.1 for output tokens 11.4x cheaper ($4.40 vs $50.00 per million) and work measured by LMArena Text: software and IT or LMArena Text: hard prompts, where it leads.

Model AGLM 5.1Z.ai49.2/1003 independent benchmarks$0.60 per solved task Model BGPT-6 AstraOpenAI85.1/1005 independent benchmarksNo cost per solved task

711850

Shared results: 71
GLM 5.1 only: 18
GPT-6 Astra only: 50
Like-for-like categories: 8 of 9

Only benchmarks that tested both models count toward a pick; a result only one model has is shown but not compared.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, six public coding benchmarks
GPT-6 Astra
GPT-6 Astra scores 85.1 against 49.2.
3 and 5 benchmarks behind the scores
Intelligence
AA Intelligence Index
GPT-6 Astra
GPT-6 Astra leads, 52.7 against 26.1.
Same board, both measured
Agentic work
AA Agentic Index
GPT-6 Astra
GPT-6 Astra leads, 51.0 against 23.9.
Same board, both measured
Reasoning
GPQA Diamond
No call
Only GLM 5.1 has a GPQA Diamond result, 84.5%.
Directional only
Math
AIME
No call
Only GLM 5.1 has a AIME result, 91.9%.
Directional only
Knowledge
MMLU Pro
No call
Only GLM 5.1 has a MMLU Pro result, 86.9%.
Directional only
Web design
Design Arena: websites
GPT-6 Astra
GPT-6 Astra leads, 1336 against 1290.
Same board, both measured
General
Vals Index
No call
Only GPT-6 Astra has a Vals Index result, 65.0%.
Directional only
Long documents
Listed context window
GPT-6 Astra
GPT-6 Astra takes 1.05M tokens against 205K.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
GLM 5.1
GLM 5.1 $0.0036, GPT-6 Astra $0.035 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
No call
Only GLM 5.1 has the number, $0.60.
Directional only

At a glance

Coding index: GLM 5.1 49.2 from 3 benchmarks, GPT-6 Astra 85.1 from 5 benchmarks.
Widest category: Math, 28.8 points apart on average over 5 shared benchmarks.
Widest single gap: ProofBench: GLM 5.1 22.2% against GPT-6 Astra 99.0%, 76.8 points apart on a 0 to 100 scale.
Output price: GLM 5.1 $4.40 against GPT-6 Astra $50.00 per million output tokens, 11.4x apart.
Context window: GLM 5.1 takes 205K tokens, GPT-6 Astra 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	GLM 5.1	GPT-6 Astra
Coding	1	12
Intelligence	0	2
Agentic work	0	11
Reasoning	2	5
Math	1	4
Knowledge	4	2
Web design	1	7
General	15	4
All shared boards	24	47

CodingLike-for-likeSix of these boards feed the Vibe Coding Index112

Coding benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
LiveBench coding	Not measured	93.7%	Only GPT-6 Astra measured
LMArena WebDev	1508	1774	GPT-6 Astra
AA Coding Index	55.8	76.9	GPT-6 Astra
LiveCodeBench (Vals AI)	81.4%	Not measured	Only GLM 5.1 measured
SWE-bench Verified (Vals AI)	76.4%	Not measured	Only GLM 5.1 measured
Terminal-Bench 4 (Vals AI)	Not measured	59.6%	Only GPT-6 Astra measured
Vibe Code Bench (Vals AI)	31.5%	89.6%	GPT-6 Astra
Code migration (Vals AI)	25.8%	67.7%	GPT-6 Astra
ProgramBench (Vals AI)	0.0%	5.5%	GPT-6 Astra
IOI (Vals AI)	Not measured	100.0%	Only GPT-6 Astra measured
Terminal-Bench 2.1 (Vals AI)	56.9%	87.3%	GPT-6 Astra
SWE-bench Multimodal (Vals AI)	Not measured	43.3%	Only GPT-6 Astra measured
Vibe Code Bench 1-100 (Vals AI)	Not measured	27.6%	Only GPT-6 Astra measured
CyberBench (Vals AI)	Not measured	41.1%	Only GPT-6 Astra measured
SciCode	44.8%	56.5%	GPT-6 Astra
Terminal-Bench Hard (Artificial Analysis run)	43.2%	Not measured	Only GLM 5.1 measured
FrontierCode	Not measured	53.3%	Only GPT-6 Astra measured
FrontierSWE	Not measured	65.5%	Only GPT-6 Astra measured
GSO-Bench	Not measured	79.4%	Only GPT-6 Astra measured
WeirdML	57.1%	93.3%	GPT-6 Astra
MirrorCode	Not measured	46.7%	Only GPT-6 Astra measured
ALE-Bench	887.1	2951.3	GPT-6 Astra
LMArena Text: coding	1485	1489	GPT-6 Astra
LMArena Text: software and IT	1484	1474	GLM 5.1
LMArena WebDev: React	1505	1798	GPT-6 Astra
LMArena WebDev: HTML	1508	1775	GPT-6 Astra
LMArena WebDev: from an image	Not measured	1726	Only GPT-6 Astra measured
SciCode	Not measured	12.3%	Only GPT-6 Astra measured
Neither model has a result on the other 11 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index02

Intelligence benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
AA Intelligence Index	26.1	52.7	GPT-6 Astra
Epoch Capabilities Index	149.8	168.8	GPT-6 Astra

Agentic workLike-for-likePublic boards, shown as published, kept out of the index011

Agentic work benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
AA Agentic Index	23.9	51.0	GPT-6 Astra
Design Arena: agents building web apps	1175	1373	GPT-6 Astra
Design Arena: agents building full-stack apps	1167	1357	GPT-6 Astra
Design Arena: agents building mobile apps	1162	1312	GPT-6 Astra
Design Arena: agents building Android apps	1182	Not measured	Only GLM 5.1 measured
Design Arena: agents building Godot games	1053	1348	GPT-6 Astra
Design Arena: agents building games	1164	Not measured	Only GLM 5.1 measured
Design Arena: HTML slides	1120	Not measured	Only GLM 5.1 measured
Design Arena: PowerPoint slides	1163	1219	GPT-6 Astra
Design Arena: spreadsheets	1315	1365	GPT-6 Astra
LiveBench research	Not measured	85.2%	Only GPT-6 Astra measured
LiveBench browser	Not measured	84.0%	Only GPT-6 Astra measured
LiveBench long agentic	Not measured	82.4%	Only GPT-6 Astra measured
SREBench (Vals AI)	Not measured	56.9%	Only GPT-6 Astra measured
Finance Agent (Vals AI)	44.8%	53.5%	GPT-6 Astra
Tax Agent Bench (Vals AI)	Not measured	20.7%	Only GPT-6 Astra measured
Legal Research Bench (Vals AI)	27.9%	39.4%	GPT-6 Astra
Harvey's Legal Agent Benchmark (Vals AI)	Not measured	7.1%	Only GPT-6 Astra measured
Excel Modeling Benchmark (Vals AI)	Not measured	71.7%	Only GPT-6 Astra measured
BioMysteryBench (Vals AI)	Not measured	79.3%	Only GPT-6 Astra measured
Terminal-Bench-Science (Vals AI)	Not measured	62.9%	Only GPT-6 Astra measured
Vals Science Index	Not measured	65.1%	Only GPT-6 Astra measured
Time Horizon Index (Vals AI)	Not measured	90.5%	Only GPT-6 Astra measured
CUA-bench (Vals AI)	Not measured	19.2%	Only GPT-6 Astra measured
Robo-bench (Vals AI)	Not measured	23.3%	Only GPT-6 Astra measured
τ²-Bench Telecom	97.7%	Not measured	Only GLM 5.1 measured
APEX-Agents	40.9%	64.7%	GPT-6 Astra
Remote Labor Index	Not measured	20.8%	Only GPT-6 Astra measured
BALROG	Not measured	68.3%	Only GPT-6 Astra measured
SpireClimb	Not measured	25.7%	Only GPT-6 Astra measured
Vending-Bench 2	$5,634	$15,515	GPT-6 Astra
Neither model has a result on the other 10 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index25

Reasoning benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
GPQA Diamond	84.5%	Not measured	Only GLM 5.1 measured
LiveBench reasoning	Not measured	92.7%	Only GPT-6 Astra measured
MysteryMechanism (Vals AI)	Not measured	53.1%	Only GPT-6 Astra measured
GPQA Diamond (Artificial Analysis run)	86.8%	96.3%	GPT-6 Astra
Humanity's Last Exam (Artificial Analysis run)	30.1%	54.7%	GPT-6 Astra
GPQA Diamond (Epoch AI run)	89.9%	95.8%	GPT-6 Astra
ARC-AGI	Not measured	98.5%	Only GPT-6 Astra measured
ARC-AGI-2	Not measured	95.0%	Only GPT-6 Astra measured
SimpleBench	55.1%	Not measured	Only GLM 5.1 measured
Chess puzzles	20.0%	74.0%	GPT-6 Astra
Mystery game puzzles	Not measured	84.0%	Only GPT-6 Astra measured
EBR-bench	Not measured	76.2%	Only GPT-6 Astra measured
LMArena Text: hard prompts	1473	1463	GLM 5.1
LMArena Text: expert	1478	1489	GPT-6 Astra
LMArena Text: hard prompts in English	1482	1464	GLM 5.1
LMArena Vision: diagrams	Not measured	1297	Only GPT-6 Astra measured
LMArena Vision: homework	Not measured	1337	Only GPT-6 Astra measured
Neither model has a result on the other 5 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index14

Math benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
AIME	91.9%	Not measured	Only GLM 5.1 measured
OTIS Mock AIME	93.3%	100.0%	GPT-6 Astra
FrontierMath, tiers 1 to 3	36.8%	93.7%	GPT-6 Astra
FrontierMath, tier 4	Not measured	97.6%	Only GPT-6 Astra measured
ProofBench	22.2%	99.0%	GPT-6 Astra
LMArena Text: math	1473	1465	GLM 5.1
LMArena Text: mathematical work	1470	1484	GPT-6 Astra
Neither model has a result on the other 6 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index42

Knowledge benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
MMLU Pro	86.9%	Not measured	Only GLM 5.1 measured
LegalBench (Vals AI)	84.4%	Not measured	Only GLM 5.1 measured
CaseLaw (Vals AI)	51.5%	Not measured	Only GLM 5.1 measured
CorpFin (Vals AI)	64.5%	Not measured	Only GLM 5.1 measured
TaxEval (Vals AI)	71.2%	Not measured	Only GLM 5.1 measured
MedCode (Vals AI)	41.6%	48.5%	GPT-6 Astra
SimpleQA Verified	34.0%	75.6%	GPT-6 Astra
LMArena Text: science	1478	1451	GLM 5.1
LMArena Text: medicine and healthcare	1474	1425	GLM 5.1
LMArena Text: legal and government	1465	1462	GLM 5.1
LMArena Text: business and finance	1452	1439	GLM 5.1
FACTS Benchmark Suite	Not measured	75.7%	Only GPT-6 Astra measured
Neither model has a result on the other 6 boards here

Web designLike-for-likePublic boards, shown as published, kept out of the index17

Web design benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
Design Arena: websites	1290	1336	GPT-6 Astra
Design Arena: UI components	1292	1393	GPT-6 Astra
Design Arena: game dev	1265	1478	GPT-6 Astra
Design Arena: data viz	1366	1335	GLM 5.1
Design Arena: 3D	1336	1500	GPT-6 Astra
Design Arena: all code categories	1268	1379	GPT-6 Astra
Design Arena: SVG	1218	1431	GPT-6 Astra
Design Arena: ASCII art	1141	1353	GPT-6 Astra
LiveBench design	Not measured	82.0%	Only GPT-6 Astra measured

GeneralLike-for-likePublic boards, shown as published, kept out of the index154

General benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
Vals Index	Not measured	65.0%	Only GPT-6 Astra measured
LiveBench data analysis	Not measured	83.0%	Only GPT-6 Astra measured
Public Benefits Bench (Vals AI)	61.8%	Not measured	Only GLM 5.1 measured
SAGE (Vals AI)	Not measured	46.4%	Only GPT-6 Astra measured
MedScribe (Vals AI)	72.3%	87.9%	GPT-6 Astra
IFBench	76.3%	Not measured	Only GLM 5.1 measured
Long context reasoning (AA-LCR)	73.7%	80.7%	GPT-6 Astra
DTBench	Not measured	97.3%	Only GPT-6 Astra measured
LMCA	Not measured	64.4%	Only GPT-6 Astra measured
Furniture assembly	Not measured	80.0%	Only GPT-6 Astra measured
ExploitBench	18.1%	Not measured	Only GLM 5.1 measured
LMArena Text	1463	1441	GLM 5.1
LMArena Text: instruction following	1453	1455	GPT-6 Astra
LMArena Text: creative writing	1453	1420	GLM 5.1
LMArena Vision	Not measured	1280	Only GPT-6 Astra measured
LMArena Text: English	1476	1447	GLM 5.1
LMArena Text: non-English	1448	1432	GLM 5.1
LMArena Text: Chinese	1515	1489	GLM 5.1
LMArena Text: German	1467	1459	GLM 5.1
LMArena Text: Japanese	1435	1405	GLM 5.1
LMArena Text: Korean	1424	1428	GPT-6 Astra
LMArena Text: French	1470	1432	GLM 5.1
LMArena Text: Spanish	1468	1422	GLM 5.1
LMArena Text: Russian	1454	1438	GLM 5.1
LMArena Text: Polish	1449	1422	GLM 5.1
LMArena Text: multi-turn	1473	1447	GLM 5.1
LMArena Text: longer queries	1467	1460	GLM 5.1
LMArena Text: writing and language	1454	1437	GLM 5.1
LMArena Text: entertainment and media	1442	1427	GLM 5.1
LMArena Vision: English	Not measured	1280	Only GPT-6 Astra measured
LMArena Vision: Chinese	Not measured	1361	Only GPT-6 Astra measured
LMArena Vision: reading text	Not measured	1292	Only GPT-6 Astra measured
LMArena Vision: creative writing	Not measured	1286	Only GPT-6 Astra measured
Neither model has a result on the other 13 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for GLM 5.1 and GPT-6 Astra
Benchmark	GLM 5.1	GPT-6 Astra	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GLM 5.1$0.0036Fits in one request

GPT-6 Astra$0.035Fits in one request

GLM 5.1 costs less

Repository review

50K input + 3K output tokens

GLM 5.1$0.083Fits in one request

GPT-6 Astra$0.650Fits in one request

GLM 5.1 costs less

Agent loop

200K input + 10K output tokens

GLM 5.1$0.324Exceeds the context window

GPT-6 Astra$2.50Fits in one request

GLM 5.1 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GLM 5.1 and GPT-6 Astra
Specification	Z.ai GLM 5.1	OpenAI GPT-6 Astra
Maker	Z.ai	OpenAI
Weights	Open weights	No public weights listed
Released	April 7, 2026	September 4, 2026
Context window	205K	1.05M
Input $/Mtok	$1.40	$10.00
Output $/Mtok	$4.40	$50.00
Coding index	49.2	85.1
Independent measurements behind it	3	5
Cost per solved task	$0.60	Not computable
Source	OpenRouter listing	OpenRouter listing

Questions

Is GLM 5.1 better than GPT-6 Astra for coding?

Pick GPT-6 Astra for coding: it scores 85.1 on the Vibe Coding Index against 49.2 for GLM 5.1. Pick GLM 5.1 for output tokens 11.4x cheaper ($4.40 vs $50.00 per million) and work measured by LMArena Text: software and IT or LMArena Text: hard prompts, where it leads.

Which is cheaper, GLM 5.1 or GPT-6 Astra?

GLM 5.1 costs $1.40 per million input tokens and $4.40 per million output tokens; GPT-6 Astra costs $10.00 and $50.00. Cost per solved task is known for GLM 5.1 only.

Which has the bigger context window, GLM 5.1 or GPT-6 Astra?

GPT-6 Astra, with 1.05M tokens against 205K.

How many benchmarks is the GLM 5.1 vs GPT-6 Astra comparison based on?

71 benchmarks have a result for both models as of October 22, 2026. GLM 5.1's coding index rests on 3 independent benchmarks and GPT-6 Astra's on 5. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/glm-5-1-vs-gpt-6-astra" title="GLM 5.1 vs GPT-6 Astra, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/glm-5-1-vs-gpt-6-astra">LLMBenchmark.ai, GLM 5.1 vs GPT-6 Astra</a></p>

GLM 5.1 or GPT-6 Astra: which to pick

Which one for your work

Coding

Intelligence

Agentic work

Reasoning

Math

Knowledge

Web design

General

Long documents

Everyday cost

Cost per solved task

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next