Enter opens the highlighted result. Esc closes.

GPT-4 vs Mistral Large 3 2512

Updated October 21, 2026. 4 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Replace GPT-4 Replace Mistral Large 3 2512
GPT-4OpenAI
Coding
No data
Overall
6.7
Output $/M
$60.00
1
Mistral Large 3 2512Mistral AI
Coding
No data
Overall
9.3
Output $/M
$1.50
3
vs boards won of 4 shared

Decision reading

Neither model has a coding score yet, so the two cannot be ranked on coding.

GPT-4 has the edge where what matters is AA Coding Index or AA Intelligence Index, where it leads.

Model AGPT-4OpenAINot benchmarkedNo coding benchmarkNo cost per solved taskModel BMistral Large 3 2512Mistral AINot benchmarked1 independent benchmark$0.77 per solved task
Shared results
4
GPT-4 only
41
Mistral Large 3 2512 only
24
Like-for-like categories
3 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-4 not benchmarked, Mistral Large 3 2512 not benchmarked.
Widest category
Coding, 7.0 points apart on average over 1 shared benchmark.
Widest single gap
AA Coding Index: GPT-4 13.1 against Mistral Large 3 2512 20.1, 7.0 points apart on a 0 to 100 scale.
Output price
GPT-4 $60.00 against Mistral Large 3 2512 $1.50 per million output tokens, 40.0x apart.
Context window
GPT-4 takes 8K tokens, Mistral Large 3 2512 262K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-4BarsMistral Large 3 2512Ties
Coding01
Intelligence01
General11
All shared boards13
CodingLike-for-likeSix of these boards feed the Vibe Coding Index01
Coding benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
SWE-bench Verified22.4%Not measuredOnly GPT-4 measured
SWE-bench Lite39.7%Not measuredOnly GPT-4 measured
SWE-bench (full test set)12.5%Not measuredOnly GPT-4 measured
AA Coding Index13.120.1Mistral Large 3 2512
LiveCodeBench (Vals AI)Not measured55.3%Only Mistral Large 3 2512 measured
SWE-bench Verified (Vals AI)Not measured41.4%Only Mistral Large 3 2512 measured
ALE-BenchNot measured264.7Only Mistral Large 3 2512 measured
LMArena Text: coding1209Not measuredOnly GPT-4 measured
LMArena Text: software and IT1195Not measuredOnly GPT-4 measured
Neither model has a result on the other 29 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
AA Intelligence Index6.79.3Mistral Large 3 2512
Epoch Capabilities Index125.7Not measuredOnly GPT-4 measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index1 board, none shared
Agentic work benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
AA Agentic IndexNot measured1.0Only Mistral Large 3 2512 measured
Neither model has a result on the other 38 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index7 boards, none shared
Reasoning benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
GPQA DiamondNot measured68.4%Only Mistral Large 3 2512 measured
MMMU Pro (Vals AI)Not measured66.2%Only Mistral Large 3 2512 measured
GPQA Diamond (Artificial Analysis run)34.9%Not measuredOnly GPT-4 measured
BIG-Bench Hard75.1%Not measuredOnly GPT-4 measured
LMArena Text: hard prompts1200Not measuredOnly GPT-4 measured
LMArena Text: expert1149Not measuredOnly GPT-4 measured
LMArena Text: hard prompts in English1209Not measuredOnly GPT-4 measured
Neither model has a result on the other 14 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index5 boards, none shared
Math benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
AIMENot measured42.9%Only Mistral Large 3 2512 measured
MGSM (Vals AI)Not measured85.4%Only Mistral Large 3 2512 measured
GSM8K92.0%Not measuredOnly GPT-4 measured
LMArena Text: math1230Not measuredOnly GPT-4 measured
LMArena Text: mathematical work1228Not measuredOnly GPT-4 measured
Neither model has a result on the other 8 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index14 boards, none shared
Knowledge benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
MMLU ProNot measured79.8%Only Mistral Large 3 2512 measured
LegalBench (Vals AI)Not measured79.1%Only Mistral Large 3 2512 measured
CaseLaw (Vals AI)Not measured61.4%Only Mistral Large 3 2512 measured
CorpFin (Vals AI)Not measured61.0%Only Mistral Large 3 2512 measured
TaxEval (Vals AI)Not measured73.1%Only Mistral Large 3 2512 measured
MortgageTax (Vals AI)Not measured52.1%Only Mistral Large 3 2512 measured
MedQA (Vals AI)Not measured82.2%Only Mistral Large 3 2512 measured
MMLU Pro (Artificial Analysis run)56.2%Not measuredOnly GPT-4 measured
MMLU86.4%Not measuredOnly GPT-4 measured
AI2 Reasoning Challenge96.3%Not measuredOnly GPT-4 measured
LMArena Text: science1177Not measuredOnly GPT-4 measured
LMArena Text: medicine and healthcare1145Not measuredOnly GPT-4 measured
LMArena Text: legal and government1191Not measuredOnly GPT-4 measured
LMArena Text: business and finance1145Not measuredOnly GPT-4 measured
Neither model has a result on the other 3 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
Design Arena: websitesNot measured1162Only Mistral Large 3 2512 measured
Design Arena: UI componentsNot measured1102Only Mistral Large 3 2512 measured
Design Arena: game devNot measured1080Only Mistral Large 3 2512 measured
Design Arena: data vizNot measured1136Only Mistral Large 3 2512 measured
Design Arena: 3DNot measured1099Only Mistral Large 3 2512 measured
Design Arena: all code categoriesNot measured1142Only Mistral Large 3 2512 measured
Design Arena: SVGNot measured993Only Mistral Large 3 2512 measured
Design Arena: ASCII artNot measured1069Only Mistral Large 3 2512 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index11
General benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
SAGE (Vals AI)Not measured24.6%Only Mistral Large 3 2512 measured
IFBench33.2%Not measuredOnly GPT-4 measured
DTBench62.7%65.1%Mistral Large 3 2512
LMCA17.1%16.7%GPT-4
HellaSwag95.3%Not measuredOnly GPT-4 measured
WinoGrande87.5%Not measuredOnly GPT-4 measured
LMArena Text1206Not measuredOnly GPT-4 measured
LMArena Text: instruction following1201Not measuredOnly GPT-4 measured
LMArena Text: creative writing1191Not measuredOnly GPT-4 measured
LMArena Text: English1220Not measuredOnly GPT-4 measured
LMArena Text: non-English1194Not measuredOnly GPT-4 measured
LMArena Text: Chinese1184Not measuredOnly GPT-4 measured
LMArena Text: German1198Not measuredOnly GPT-4 measured
LMArena Text: Japanese1137Not measuredOnly GPT-4 measured
LMArena Text: Korean1087Not measuredOnly GPT-4 measured
LMArena Text: French1220Not measuredOnly GPT-4 measured
LMArena Text: Spanish1197Not measuredOnly GPT-4 measured
LMArena Text: Russian1195Not measuredOnly GPT-4 measured
LMArena Text: Polish1265Not measuredOnly GPT-4 measured
LMArena Text: multi-turn1206Not measuredOnly GPT-4 measured
LMArena Text: longer queries1190Not measuredOnly GPT-4 measured
LMArena Text: writing and language1219Not measuredOnly GPT-4 measured
LMArena Text: entertainment and media1184Not measuredOnly GPT-4 measured
Neither model has a result on the other 23 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-4 and Mistral Large 3 2512
BenchmarkGPT-4Mistral Large 3 2512Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-4$0.060Fits in one request
Mistral Large 3 2512$0.0013Fits in one request

Mistral Large 3 2512 costs less

Repository review

50K input + 3K output tokens

GPT-4$1.68Exceeds the context window
Mistral Large 3 2512$0.029Fits in one request

Mistral Large 3 2512 costs less

Agent loop

200K input + 10K output tokens

GPT-4$6.60Exceeds the context window
Mistral Large 3 2512$0.115Fits in one request

Mistral Large 3 2512 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-4 and Mistral Large 3 2512
SpecificationOpenAI GPT-4Mistral Large 3 2512
MakerOpenAIMistral AI
WeightsNo public weights listedNo public weights listed
ReleasedMay 28, 2023December 1, 2025
Context window8K262K
Input $/Mtok$30.00$0.50
Output $/Mtok$60.00$1.50
Coding indexNot benchmarkedNot benchmarked
Independent measurements behind it01
Cost per solved taskNot computable$0.77
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-4 better than Mistral Large 3 2512 for coding?

Neither model has a coding score yet, so the two cannot be ranked on coding. GPT-4 has the edge where what matters is AA Coding Index or AA Intelligence Index, where it leads.

Which is cheaper, GPT-4 or Mistral Large 3 2512?

GPT-4 costs $30.00 per million input tokens and $60.00 per million output tokens; Mistral Large 3 2512 costs $0.50 and $1.50. Cost per solved task is known for Mistral Large 3 2512 only.

Which has the bigger context window, GPT-4 or Mistral Large 3 2512?

Mistral Large 3 2512, with 262K tokens against 8K.

How many benchmarks is the GPT-4 vs Mistral Large 3 2512 comparison based on?

4 benchmarks have a result for both models as of October 21, 2026. GPT-4's coding index rests on 0 independent benchmarks and Mistral Large 3 2512's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next