GLM 4.6 vs GPT-5.1

Updated October 21, 2026. 61 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace GLM 4.6 Replace GPT-5.1

GLM 4.6Z.ai

Coding: 52.2
Overall: 18.5
Output $/M: $2.20

GPT-5.1OpenAI

Coding: 53.3
Overall: 24.7
Output $/M: $10.00

vs boards won of 61 shared

Decision reading

GLM 4.6 and GPT-5.1 are level for coding, 52.2 against 53.3 on the Vibe Coding Index, so price and context decide.

Pick GLM 4.6 when output tokens cost 4.5x less, or when what matters is SWE-bench Verified or LMArena Text: software and IT, where it leads. Pick GPT-5.1 when the context window is larger, 400K against 205K tokens, or when what matters is LMArena WebDev or AA Coding Index, where it leads.

Model AGLM 4.6Z.ai52.2/1002 independent benchmarksNo cost per solved task Model BGPT-5.1OpenAI53.3/1002 independent benchmarks$1.02 per solved task

61539

Shared results: 61
GLM 4.6 only: 5
GPT-5.1 only: 39
Like-for-like categories: 8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

Coding
Vibe Coding Index, four public coding benchmarks
No call
Level: 52.2 against 53.3, inside 2 points.
2 benchmarks behind each score
Intelligence
AA Intelligence Index
GPT-5.1
GPT-5.1 leads, 24.7 against 18.5.
Same board, both measured
Reasoning
GPQA Diamond
GPT-5.1
GPT-5.1 leads, 86.6% against 74.5%.
Same board, both measured
Math
AIME
GPT-5.1
GPT-5.1 leads, 93.3% against 92.7%.
Same board, both measured
Knowledge
MMLU Pro
GPT-5.1
GPT-5.1 leads, 86.4% against 82.2%.
Same board, both measured
Web design
Design Arena: websites
GPT-5.1
GPT-5.1 leads, 1187 against 1174.
Same board, both measured
Long documents
Listed context window
GPT-5.1
GPT-5.1 takes 400K tokens against 205K.
Listed by OpenRouter
Everyday cost
1K input + 500 output tokens
GLM 4.6
GLM 4.6 $0.0016, GPT-5.1 $0.0063 per turn.
List prices
Cost per solved task
One SWE-bench Verified task, solved
No call
Only GPT-5.1 has the number, $1.02.
Directional only

At a glance

Coding index: GLM 4.6 52.2 from 2 benchmarks, GPT-5.1 53.3 from 2 benchmarks.
Widest category: Coding, 9.8 points apart on average over 11 shared benchmarks.
Widest single gap: IFBench: GLM 4.6 43.4% against GPT-5.1 72.9%, 29.5 points apart on a 0 to 100 scale.
Output price: GLM 4.6 $2.20 against GPT-5.1 $10.00 per million output tokens, 4.5x apart.
Context window: GLM 4.6 takes 205K tokens, GPT-5.1 400K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Category	GLM 4.6	GPT-5.1
Coding	2	9
Intelligence	0	1
Agentic work	0	1
Reasoning	0	6
Math	0	6
Knowledge	0	10
Web design	1	6
General	5	14
All shared boards	8	53

CodingLike-for-likeFour of these boards feed the Vibe Coding Index29

Coding benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
SWE-bench Verified	68.2%	66.0%	GLM 4.6
LMArena WebDev	1341	1396	GPT-5.1
AA Coding Index	45.8	49.4	GPT-5.1
LiveCodeBench (Vals AI)	81.0%	86.5%	GPT-5.1
SWE-bench Verified (Vals AI)	Not measured	69.8%	Only GPT-5.1 measured
Vibe Code Bench (Vals AI)	3.1%	24.6%	GPT-5.1
LiveCodeBench (Artificial Analysis run)	69.5%	86.8%	GPT-5.1
Terminal-Bench Hard (Artificial Analysis run)	28.8%	45.5%	GPT-5.1
Terminal-Bench	24.5%	47.6%	GPT-5.1
GSO-Bench	Not measured	13.7%	Only GPT-5.1 measured
WeirdML	Not measured	60.8%	Only GPT-5.1 measured
ALE-Bench	340.8	Not measured	Only GLM 4.6 measured
LMArena Text: coding	1449	1453	GPT-5.1
LMArena Text: software and IT	1455	1454	GLM 4.6
LMArena WebDev: React	Not measured	1307	Only GPT-5.1 measured
LMArena WebDev: HTML	1350	1405	GPT-5.1
LMArena WebDev: from an image	Not measured	1421	Only GPT-5.1 measured
Neither model has a result on the other 21 boards here

IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01

Intelligence benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
AA Intelligence Index	18.5	24.7	GPT-5.1
Epoch Capabilities Index	Not measured	149.8	Only GPT-5.1 measured

Agentic workLike-for-likePublic boards, shown as published, kept out of the index01

Agentic work benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
Design Arena: agents building full-stack apps	1029	Not measured	Only GLM 4.6 measured
Design Arena: agents building mobile apps	1096	Not measured	Only GLM 4.6 measured
Design Arena: agents building Android apps	1090	Not measured	Only GLM 4.6 measured
Design Arena: agents building Godot games	1180	Not measured	Only GLM 4.6 measured
τ²-Bench Telecom	76.9%	81.9%	GPT-5.1
DeepResearch Bench	Not measured	42.8%	Only GPT-5.1 measured
Vending-Bench 2	Not measured	$1,473	Only GPT-5.1 measured
Neither model has a result on the other 32 boards here

ReasoningLike-for-likePublic boards, shown as published, kept out of the index06

Reasoning benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
GPQA Diamond	74.5%	86.6%	GPT-5.1
MMMU Pro (Vals AI)	Not measured	83.2%	Only GPT-5.1 measured
GPQA Diamond (Artificial Analysis run)	78.0%	87.3%	GPT-5.1
Humanity's Last Exam (Artificial Analysis run)	14.5%	28.5%	GPT-5.1
GPQA Diamond (Epoch AI run)	Not measured	87.6%	Only GPT-5.1 measured
ARC-AGI	Not measured	72.8%	Only GPT-5.1 measured
ARC-AGI-2	Not measured	17.6%	Only GPT-5.1 measured
SimpleBench	Not measured	53.2%	Only GPT-5.1 measured
Chess puzzles	Not measured	42.0%	Only GPT-5.1 measured
Mystery game puzzles	Not measured	19.0%	Only GPT-5.1 measured
VPCT	Not measured	58.7%	Only GPT-5.1 measured
LMArena Text: hard prompts	1440	1457	GPT-5.1
LMArena Text: expert	1432	1470	GPT-5.1
LMArena Text: hard prompts in English	1445	1462	GPT-5.1
LMArena Vision: diagrams	Not measured	1264	Only GPT-5.1 measured
LMArena Vision: homework	Not measured	1272	Only GPT-5.1 measured
Neither model has a result on the other 5 boards here

MathLike-for-likePublic boards, shown as published, kept out of the index06

Math benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
AIME	92.7%	93.3%	GPT-5.1
MGSM (Vals AI)	89.8%	93.0%	GPT-5.1
AA Math Index	86.0	94.0	GPT-5.1
AIME 2025 (Artificial Analysis run)	86.0%	94.0%	GPT-5.1
OTIS Mock AIME	Not measured	88.6%	Only GPT-5.1 measured
LMArena Text: math	1432	1446	GPT-5.1
LMArena Text: mathematical work	1447	1449	GPT-5.1
Neither model has a result on the other 6 boards here

KnowledgeLike-for-likePublic boards, shown as published, kept out of the index010

Knowledge benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
MMLU Pro	82.2%	86.4%	GPT-5.1
LegalBench (Vals AI)	79.6%	85.7%	GPT-5.1
CaseLaw (Vals AI)	Not measured	73.4%	Only GPT-5.1 measured
CorpFin (Vals AI)	56.8%	63.8%	GPT-5.1
TaxEval (Vals AI)	66.2%	74.9%	GPT-5.1
MortgageTax (Vals AI)	Not measured	61.4%	Only GPT-5.1 measured
MedQA (Vals AI)	92.2%	96.4%	GPT-5.1
MedCode (Vals AI)	Not measured	52.7%	Only GPT-5.1 measured
MMLU Pro (Artificial Analysis run)	82.9%	87.0%	GPT-5.1
SimpleQA Verified	Not measured	48.0%	Only GPT-5.1 measured
LMArena Text: science	1456	1459	GPT-5.1
LMArena Text: medicine and healthcare	1455	1456	GPT-5.1
LMArena Text: legal and government	1448	1459	GPT-5.1
LMArena Text: business and finance	1416	1431	GPT-5.1
Neither model has a result on the other 3 boards here

Web designLike-for-likePublic boards, shown as published, kept out of the index16

Web design benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
Design Arena: websites	1174	1187	GPT-5.1
Design Arena: UI components	1147	1166	GPT-5.1
Design Arena: game dev	1151	1179	GPT-5.1
Design Arena: data viz	1161	1204	GPT-5.1
Design Arena: 3D	1129	1061	GLM 4.6
Design Arena: all code categories	1166	1171	GPT-5.1
Design Arena: SVG	1108	1149	GPT-5.1
Design Arena: ASCII art	Not measured	1118	Only GPT-5.1 measured
Neither model has a result on the other 1 board here

GeneralLike-for-likePublic boards, shown as published, kept out of the index514

General benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
SAGE (Vals AI)	Not measured	43.2%	Only GPT-5.1 measured
MedScribe (Vals AI)	Not measured	88.1%	Only GPT-5.1 measured
IFBench	43.4%	72.9%	GPT-5.1
Long context reasoning (AA-LCR)	54.0%	80.0%	GPT-5.1
DTBench	Not measured	90.1%	Only GPT-5.1 measured
LMCA	Not measured	43.9%	Only GPT-5.1 measured
CL-bench	Not measured	23.7%	Only GPT-5.1 measured
CL-bench Life	Not measured	17.3%	Only GPT-5.1 measured
LMArena Text	1440	1443	GPT-5.1
LMArena Text: instruction following	1410	1443	GPT-5.1
LMArena Text: creative writing	1412	1427	GPT-5.1
LMArena Vision	Not measured	1250	Only GPT-5.1 measured
LMArena Text: English	1449	1451	GPT-5.1
LMArena Text: non-English	1426	1431	GPT-5.1
LMArena Text: Chinese	1499	1495	GLM 4.6
LMArena Text: German	1447	1438	GLM 4.6
LMArena Text: Japanese	1393	1453	GPT-5.1
LMArena Text: Korean	1400	1401	GPT-5.1
LMArena Text: French	1459	1450	GLM 4.6
LMArena Text: Spanish	1436	1433	GLM 4.6
LMArena Text: Russian	1418	1435	GPT-5.1
LMArena Text: Polish	1447	1440	GLM 4.6
LMArena Text: multi-turn	1427	1450	GPT-5.1
LMArena Text: longer queries	1422	1448	GPT-5.1
LMArena Text: writing and language	1415	1428	GPT-5.1
LMArena Text: entertainment and media	1409	1415	GPT-5.1
LMArena Vision: English	Not measured	1252	Only GPT-5.1 measured
LMArena Vision: Chinese	Not measured	1270	Only GPT-5.1 measured
LMArena Vision: reading text	Not measured	1255	Only GPT-5.1 measured
LMArena Vision: humor	Not measured	1263	Only GPT-5.1 measured
LMArena Vision: captioning	Not measured	1252	Only GPT-5.1 measured
LMArena Vision: recognizing things	Not measured	1232	Only GPT-5.1 measured
LMArena Vision: creative writing	Not measured	1266	Only GPT-5.1 measured
LMArena Document	Not measured	1403	Only GPT-5.1 measured
Neither model has a result on the other 12 boards here

Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared

Image generation benchmarks for GLM 4.6 and GPT-5.1
Benchmark	GLM 4.6	GPT-5.1	Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GLM 4.6$0.0016Fits in one request

GPT-5.1$0.0063Fits in one request

GLM 4.6 costs less

Repository review

50K input + 3K output tokens

GLM 4.6$0.034Fits in one request

GPT-5.1$0.092Fits in one request

GLM 4.6 costs less

Agent loop

200K input + 10K output tokens

GLM 4.6$0.132Exceeds the context window

GPT-5.1$0.350Fits in one request

GLM 4.6 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GLM 4.6 and GPT-5.1
Specification	Z.ai GLM 4.6	OpenAI GPT-5.1
Maker	Z.ai	OpenAI
Weights	Open weights	No public weights listed
Released	September 30, 2025	November 13, 2025
Context window	205K	400K
Input $/Mtok	$0.55	$1.25
Output $/Mtok	$2.20	$10.00
Coding index	52.2	53.3
Independent measurements behind it	2	2
Cost per solved task	Not computable	$1.02
Source	OpenRouter listing	OpenRouter listing

Questions

Is GLM 4.6 better than GPT-5.1 for coding?

GLM 4.6 and GPT-5.1 are level for coding, 52.2 against 53.3 on the Vibe Coding Index, so price and context decide. Pick GLM 4.6 when output tokens cost 4.5x less, or when what matters is SWE-bench Verified or LMArena Text: software and IT, where it leads. Pick GPT-5.1 when the context window is larger, 400K against 205K tokens, or when what matters is LMArena WebDev or AA Coding Index, where it leads.

Which is cheaper, GLM 4.6 or GPT-5.1?

GLM 4.6 costs $0.55 per million input tokens and $2.20 per million output tokens; GPT-5.1 costs $1.25 and $10.00. Cost per solved task is known for GPT-5.1 only.

Which has the bigger context window, GLM 4.6 or GPT-5.1?

GPT-5.1, with 400K tokens against 205K.

How many benchmarks is the GLM 4.6 vs GPT-5.1 comparison based on?

61 benchmarks have a result for both models as of October 21, 2026. GLM 4.6's coding index rests on 2 independent benchmarks and GPT-5.1's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next

Embed this comparison on your site

Free under CC BY 4.0, while the source link stays visible. Preview the frame · Terms and other embeds

<iframe src="https://llmbenchmark.ai/embed/compare/glm-4-6-vs-gpt-5-1" title="GLM 4.6 vs GPT-5.1, LLMBenchmark.ai" width="100%" height="360" style="border:0;max-width:100%" loading="lazy"></iframe>
<p style="font:13px/1.4 sans-serif;margin:6px 0 0">Source: <a href="https://llmbenchmark.ai/compare/glm-4-6-vs-gpt-5-1">LLMBenchmark.ai, GLM 4.6 vs GPT-5.1</a></p>

Decision reading

Which one for your work

Coding

Intelligence

Reasoning

Math

Knowledge

Web design

Long documents

Everyday cost

Cost per solved task

At a glance

Benchmark by benchmark

What each workload costs

Chat turn

Repository review

Agent loop

Specification differences

Questions

Compare next