Enter opens the highlighted result. Esc closes.

GPT-4o-mini (2024-07-18) vs Mistral Small 4

GPT-4o-mini (2024-07-18) and Mistral Small 4 cost about the same per output token ($0.60 vs $0.60 per million). Updated October 22, 2026; no benchmark has tested both models yet.

GPT-4o-mini (2024-07-18)OpenAI
Coding
No data
Overall
No data
Output $/M
$0.60
Mistral Small 4Mistral AI
Coding
No data
Overall
No data
Output $/M
$0.60
vs $0.60 vs $0.60 per 1M output tokens. About the same price.

GPT-4o-mini (2024-07-18) or Mistral Small 4: which to pick

Neither model has a coding score yet, so the two cannot be ranked on coding.

Compare them on price, context and the boards below.

No benchmark has tested both yet. GPT-4o-mini (2024-07-18) has results on Aider polyglot, WeirdML and LMArena Text: coding; Mistral Small 4 on AA Coding Index, Vibe Code Bench (Vals AI) and SciCode. Compare them on price and context instead.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-4o-mini (2024-07-18) not benchmarked, Mistral Small 4 not benchmarked.
Widest category
None yet: no category has been tested on both models.
Widest single gap
None yet: no benchmark has tested both models.
Output price
Both cost $0.60 per million output tokens.
Context window
GPT-4o-mini (2024-07-18) takes 128K tokens, Mistral Small 4 262K.

Benchmark by benchmark

Every board either model has a result on, a category to a fold; bars are each result on a 0 to 100 scale. Only one model is measured on each, so no row names a leader.

CodingDirectional onlySix of these boards feed the Vibe Coding Index9 boards measured
Coding benchmarks for GPT-4o-mini (2024-07-18) and Mistral Small 4
BenchmarkGPT-4o-mini (2024-07-18)Mistral Small 4Leader
Aider polyglot3.6%Not measuredOnly GPT-4o-mini (2024-07-18) measured
AA Coding IndexNot measured26.6Only Mistral Small 4 measured
Vibe Code Bench (Vals AI)Not measured0.0%Only Mistral Small 4 measured
SciCodeNot measured38.8%Only Mistral Small 4 measured
Terminal-Bench Hard (Artificial Analysis run)Not measured17.4%Only Mistral Small 4 measured
WeirdML11.8%Not measuredOnly GPT-4o-mini (2024-07-18) measured
ALE-BenchNot measured497.6Only Mistral Small 4 measured
LMArena Text: coding1290Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: software and IT1291Not measuredOnly GPT-4o-mini (2024-07-18) measured
Neither model has a result on the other 34 boards here
IntelligenceDirectional onlyPublic boards, shown as published, kept out of the index1 board measured
Intelligence benchmarks for GPT-4o-mini (2024-07-18) and Mistral Small 4
BenchmarkGPT-4o-mini (2024-07-18)Mistral Small 4Leader
AA Intelligence IndexNot measured11.3Only Mistral Small 4 measured
Neither model has a result on the other 1 board here
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index3 boards measured
Agentic work benchmarks for GPT-4o-mini (2024-07-18) and Mistral Small 4
BenchmarkGPT-4o-mini (2024-07-18)Mistral Small 4Leader
AA Agentic IndexNot measured0.8Only Mistral Small 4 measured
τ²-Bench TelecomNot measured41.2%Only Mistral Small 4 measured
BALROG17.4%Not measuredOnly GPT-4o-mini (2024-07-18) measured
Neither model has a result on the other 39 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index11 boards measured
Reasoning benchmarks for GPT-4o-mini (2024-07-18) and Mistral Small 4
BenchmarkGPT-4o-mini (2024-07-18)Mistral Small 4Leader
GPQA Diamond (Artificial Analysis run)Not measured76.9%Only Mistral Small 4 measured
Humanity's Last Exam (Artificial Analysis run)Not measured9.9%Only Mistral Small 4 measured
GPQA Diamond (Epoch AI run)37.7%Not measuredOnly GPT-4o-mini (2024-07-18) measured
SimpleBench10.7%Not measuredOnly GPT-4o-mini (2024-07-18) measured
Chess puzzles3.0%Not measuredOnly GPT-4o-mini (2024-07-18) measured
Mystery game puzzles12.0%Not measuredOnly GPT-4o-mini (2024-07-18) measured
VPCT34.0%Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: hard prompts1267Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: expert1234Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: hard prompts in English1278Not measuredOnly GPT-4o-mini (2024-07-18) measured
Kagi LLM BenchmarkNot measured40.5%Only Mistral Small 4 measured
Neither model has a result on the other 12 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index5 boards measured
Math benchmarks for GPT-4o-mini (2024-07-18) and Mistral Small 4
BenchmarkGPT-4o-mini (2024-07-18)Mistral Small 4Leader
OTIS Mock AIME6.9%Not measuredOnly GPT-4o-mini (2024-07-18) measured
FrontierMath, tiers 1 to 30.7%Not measuredOnly GPT-4o-mini (2024-07-18) measured
MATH level 552.6%Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: math1267Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: mathematical work1271Not measuredOnly GPT-4o-mini (2024-07-18) measured
Neither model has a result on the other 9 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index7 boards measured
Knowledge benchmarks for GPT-4o-mini (2024-07-18) and Mistral Small 4
BenchmarkGPT-4o-mini (2024-07-18)Mistral Small 4Leader
SimpleQA Verified8.3%Not measuredOnly GPT-4o-mini (2024-07-18) measured
MMLU76.7%Not measuredOnly GPT-4o-mini (2024-07-18) measured
GeoBench64.0%Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: science1286Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: medicine and healthcare1282Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: legal and government1305Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: business and finance1265Not measuredOnly GPT-4o-mini (2024-07-18) measured
Neither model has a result on the other 13 boards here
GeneralDirectional onlyPublic boards, shown as published, kept out of the index25 boards measured
General benchmarks for GPT-4o-mini (2024-07-18) and Mistral Small 4
BenchmarkGPT-4o-mini (2024-07-18)Mistral Small 4Leader
IFBenchNot measured48.2%Only Mistral Small 4 measured
Long context reasoning (AA-LCR)Not measured49.7%Only Mistral Small 4 measured
DTBenchNot measured70.9%Only Mistral Small 4 measured
LMCANot measured20.6%Only Mistral Small 4 measured
Creative writing (Lech Mazur)67.2%Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text1286Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: instruction following1258Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: creative writing1268Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Vision1066Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: English1301Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: non-English1266Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: Chinese1265Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: German1272Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: Japanese1216Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: Korean1195Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: French1297Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: Spanish1276Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: Russian1275Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: Polish1244Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: multi-turn1285Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: longer queries1289Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: writing and language1282Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Text: entertainment and media1253Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Vision: English1072Not measuredOnly GPT-4o-mini (2024-07-18) measured
LMArena Vision: Chinese1033Not measuredOnly GPT-4o-mini (2024-07-18) measured
Neither model has a result on the other 23 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-4o-mini (2024-07-18)$0.0004Fits in one request
Mistral Small 4$0.0004Fits in one request

Same cost

Repository review

50K input + 3K output tokens

GPT-4o-mini (2024-07-18)$0.0093Fits in one request
Mistral Small 4$0.0093Fits in one request

Same cost

Agent loop

200K input + 10K output tokens

GPT-4o-mini (2024-07-18)$0.036Exceeds the context window
Mistral Small 4$0.036Fits in one request

Same cost

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-4o-mini (2024-07-18) and Mistral Small 4
SpecificationOpenAI GPT-4o-mini (2024-07-18)Mistral Small 4
MakerOpenAIMistral AI
WeightsNo public weights listedOpen weights
ReleasedJuly 18, 2024March 16, 2026
Context window128K262K
Input $/Mtok$0.15$0.15
Output $/Mtok$0.60$0.60
Coding indexNot benchmarkedNot benchmarked
Independent measurements behind it01
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-4o-mini (2024-07-18) better than Mistral Small 4 for coding?

Neither model has a coding score yet, so the two cannot be ranked on coding. Compare them on price, context and the boards below.

Which is cheaper, GPT-4o-mini (2024-07-18) or Mistral Small 4?

GPT-4o-mini (2024-07-18) costs $0.15 per million input tokens and $0.60 per million output tokens; Mistral Small 4 costs $0.15 and $0.60. Cost per solved task is known for neither of them.

Which has the bigger context window, GPT-4o-mini (2024-07-18) or Mistral Small 4?

Mistral Small 4, with 262K tokens against 128K.

Has any benchmark tested both GPT-4o-mini (2024-07-18) and Mistral Small 4?

No benchmark has tested both yet. GPT-4o-mini (2024-07-18) has results on Aider polyglot, WeirdML and LMArena Text: coding; Mistral Small 4 on AA Coding Index, Vibe Code Bench (Vals AI) and SciCode. Compare them on price and context instead. Data as of October 22, 2026.

Compare next