LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

o4 Mini vs MiMo-V2.5

Updated October 21, 2026. 61 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

o4 MiniOpenAI
Coding
68.6
Overall
16.7
Output $/M
$4.40
8
MiMo-V2.5Xiaomi
Coding
34.0
Overall
21.8
Output $/M
$0.238
53
vs boards won of 61 shared

Decision reading

Pick o4 Mini for coding: it scores 68.6 on the Vibe Coding Index against 34.0 for MiMo-V2.5.

Pick MiMo-V2.5 when output tokens cost 18.5x less, or when the context window is larger, 1.05M against 200K tokens.

Shared results
61
o4 Mini only
33
MiMo-V2.5 only
19
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
o4 Mini 68.6 from 2 benchmarks, MiMo-V2.5 34.0 from 1 benchmark.
Widest category
Web design, 35.5 points apart on average over 6 shared benchmarks.
Widest single gap
Design Arena: 3D: o4 Mini 854 against MiMo-V2.5 1216, 45.3 points apart on a 0 to 100 scale.
Output price
o4 Mini $4.40 against MiMo-V2.5 $0.238 per million output tokens, 18.5x apart.
Context window
o4 Mini takes 200K tokens, MiMo-V2.5 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Categoryo4 MiniBarsMiMo-V2.5Ties
Coding13
Intelligence01
Agentic work01
Reasoning09
Math02
Knowledge46
Web design06
General325
All shared boards853
CodingLike-for-likeFour of these boards feed the Vibe Coding Index13
Coding benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
Aider polyglot72.0%Not measuredOnly o4 Mini measured
SWE-bench Verified64.6%Not measuredOnly o4 Mini measured
SWE-bench Multimodal33.9%Not measuredOnly o4 Mini measured
LMArena WebDevNot measured1438Only MiMo-V2.5 measured
AA Coding IndexNot measured56.8Only MiMo-V2.5 measured
LiveCodeBench (Vals AI)82.2%81.5%o4 Mini
SWE-bench Verified (Vals AI)Not measured71.0%Only MiMo-V2.5 measured
Vibe Code Bench (Vals AI)Not measured42.2%Only MiMo-V2.5 measured
Code migration (Vals AI)Not measured14.2%Only MiMo-V2.5 measured
Terminal-Bench 2.1 (Vals AI)Not measured60.7%Only MiMo-V2.5 measured
LiveCodeBench (Artificial Analysis run)85.9%Not measuredOnly o4 Mini measured
SciCodeNot measured43.9%Only MiMo-V2.5 measured
Terminal-Bench Hard (Artificial Analysis run)15.2%41.7%MiMo-V2.5
GSO-Bench3.6%Not measuredOnly o4 Mini measured
WeirdML52.6%Not measuredOnly o4 Mini measured
ALE-BenchNot measured514.0Only MiMo-V2.5 measured
LMArena Text: coding13681469MiMo-V2.5
LMArena Text: software and IT13671463MiMo-V2.5
LMArena WebDev: ReactNot measured1425Only MiMo-V2.5 measured
LMArena WebDev: HTMLNot measured1429Only MiMo-V2.5 measured
Neither model has a result on the other 18 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
AA Intelligence Index16.721.8MiMo-V2.5
Epoch Capabilities Index145.5Not measuredOnly o4 Mini measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index01
Agentic work benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
AA Agentic IndexNot measured15.8Only MiMo-V2.5 measured
Finance Agent (Vals AI)Not measured36.7%Only MiMo-V2.5 measured
Tax Agent Bench (Vals AI)Not measured7.8%Only MiMo-V2.5 measured
Legal Research Bench (Vals AI)Not measured9.1%Only MiMo-V2.5 measured
Excel Modeling Benchmark (Vals AI)Not measured55.1%Only MiMo-V2.5 measured
τ²-Bench Telecom55.6%90.6%MiMo-V2.5
METR time horizons63.9%Not measuredOnly o4 Mini measured
Neither model has a result on the other 32 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index09
Reasoning benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
GPQA Diamond74.5%81.6%MiMo-V2.5
MMMU Pro (Vals AI)79.7%80.0%MiMo-V2.5
GPQA Diamond (Artificial Analysis run)78.4%84.9%MiMo-V2.5
Humanity's Last Exam (Artificial Analysis run)16.5%27.2%MiMo-V2.5
GPQA Diamond (Epoch AI run)79.6%Not measuredOnly o4 Mini measured
ARC-AGI58.7%Not measuredOnly o4 Mini measured
ARC-AGI-26.1%Not measuredOnly o4 Mini measured
SimpleBench38.7%Not measuredOnly o4 Mini measured
Chess puzzles22.0%Not measuredOnly o4 Mini measured
Mystery game puzzles5.0%Not measuredOnly o4 Mini measured
VPCT57.5%Not measuredOnly o4 Mini measured
LMArena Text: hard prompts13511450MiMo-V2.5
LMArena Text: expert13431459MiMo-V2.5
LMArena Text: hard prompts in English13661461MiMo-V2.5
LMArena Vision: diagrams11971269MiMo-V2.5
LMArena Vision: homework12341262MiMo-V2.5
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
AIME83.7%Not measuredOnly o4 Mini measured
MATH 500 (Vals AI)94.2%Not measuredOnly o4 Mini measured
MGSM (Vals AI)93.4%Not measuredOnly o4 Mini measured
AA Math Index90.7Not measuredOnly o4 Mini measured
AIME 2025 (Artificial Analysis run)90.7%Not measuredOnly o4 Mini measured
OTIS Mock AIME81.7%Not measuredOnly o4 Mini measured
FrontierMath, tiers 1 to 336.1%Not measuredOnly o4 Mini measured
FrontierMath, tier 44.9%Not measuredOnly o4 Mini measured
ProofBenchNot measured16.0%Only MiMo-V2.5 measured
MATH level 597.8%Not measuredOnly o4 Mini measured
LMArena Text: math13891436MiMo-V2.5
LMArena Text: mathematical work13791451MiMo-V2.5
Neither model has a result on the other 1 board here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index46
Knowledge benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
MMLU Pro80.6%82.9%MiMo-V2.5
LegalBench (Vals AI)79.2%78.9%o4 Mini
CorpFin (Vals AI)59.0%59.9%MiMo-V2.5
TaxEval (Vals AI)74.8%71.8%o4 Mini
MortgageTax (Vals AI)64.8%59.3%o4 Mini
MedQA (Vals AI)96.0%Not measuredOnly o4 Mini measured
MedCode (Vals AI)33.8%31.9%o4 Mini
MMLU Pro (Artificial Analysis run)83.2%Not measuredOnly o4 Mini measured
SimpleQA Verified19.6%Not measuredOnly o4 Mini measured
GeoBench64.0%Not measuredOnly o4 Mini measured
LMArena Text: science13541440MiMo-V2.5
LMArena Text: medicine and healthcare13611432MiMo-V2.5
LMArena Text: legal and government13501425MiMo-V2.5
LMArena Text: business and finance13251432MiMo-V2.5
Neither model has a result on the other 3 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index06
Web design benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
Design Arena: websites9851266MiMo-V2.5
Design Arena: UI components9831257MiMo-V2.5
Design Arena: game dev10041249MiMo-V2.5
Design Arena: data viz9901249MiMo-V2.5
Design Arena: 3D8541216MiMo-V2.5
Design Arena: all code categories9771260MiMo-V2.5
Design Arena: SVGNot measured1178Only MiMo-V2.5 measured
Design Arena: ASCII artNot measured1141Only MiMo-V2.5 measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index325
General benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
SAGE (Vals AI)41.1%43.3%MiMo-V2.5
MedScribe (Vals AI)69.1%72.2%MiMo-V2.5
Vals Multimodal IndexNot measured52.8%Only MiMo-V2.5 measured
IFBench68.7%67.1%o4 Mini
Long context reasoning (AA-LCR)61.0%73.0%MiMo-V2.5
DTBench77.6%Not measuredOnly o4 Mini measured
LMCA26.5%Not measuredOnly o4 Mini measured
Fiction.LiveBench77.8%Not measuredOnly o4 Mini measured
Creative writing (Lech Mazur)75.0%Not measuredOnly o4 Mini measured
LMArena Text13531428MiMo-V2.5
LMArena Text: instruction following13201435MiMo-V2.5
LMArena Text: creative writing12941393MiMo-V2.5
LMArena Vision11941247MiMo-V2.5
LMArena Text: English13671447MiMo-V2.5
LMArena Text: non-English13371405MiMo-V2.5
LMArena Text: Chinese13541469MiMo-V2.5
LMArena Text: German13361421MiMo-V2.5
LMArena Text: Japanese13081306o4 Mini
LMArena Text: Korean13121361MiMo-V2.5
LMArena Text: French13641448MiMo-V2.5
LMArena Text: Spanish13461414MiMo-V2.5
LMArena Text: Russian13341396MiMo-V2.5
LMArena Text: Polish13581413MiMo-V2.5
LMArena Text: multi-turn13501445MiMo-V2.5
LMArena Text: longer queries13151445MiMo-V2.5
LMArena Text: writing and language13161409MiMo-V2.5
LMArena Text: entertainment and media13081399MiMo-V2.5
LMArena Vision: English12001259MiMo-V2.5
LMArena Vision: Chinese12181326MiMo-V2.5
LMArena Vision: reading text11971256MiMo-V2.5
LMArena Vision: humor11991226MiMo-V2.5
LMArena Vision: captioning1204Not measuredOnly o4 Mini measured
LMArena Vision: recognizing things12181189o4 Mini
LMArena Vision: creative writing11661230MiMo-V2.5
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for o4 Mini and MiMo-V2.5
Benchmarko4 MiniMiMo-V2.5Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

o4 Mini$0.0033Fits in one request
MiMo-V2.5$0.0002Fits in one request

MiMo-V2.5 costs less

Repository review

50K input + 3K output tokens

o4 Mini$0.068Fits in one request
MiMo-V2.5$0.0067Fits in one request

MiMo-V2.5 costs less

Agent loop

200K input + 10K output tokens

o4 Mini$0.264Exceeds the context window
MiMo-V2.5$0.026Fits in one request

MiMo-V2.5 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of o4 Mini and MiMo-V2.5
SpecificationOpenAI o4 MiniXiaomi MiMo-V2.5
MakerOpenAIXiaomi
WeightsNo public weights listedOpen weights
ReleasedApril 16, 2025April 22, 2026
Context window200K1.05M
Input $/Mtok$1.10$0.119
Output $/Mtok$4.40$0.238
Coding index68.634.0
Independent measurements behind it21
Cost per solved taskNot computable$0.01
SourceOpenRouter listingOpenRouter listing

Questions

Is o4 Mini better than MiMo-V2.5 for coding?

Pick o4 Mini for coding: it scores 68.6 on the Vibe Coding Index against 34.0 for MiMo-V2.5. Pick MiMo-V2.5 when output tokens cost 18.5x less, or when the context window is larger, 1.05M against 200K tokens.

Which is cheaper, o4 Mini or MiMo-V2.5?

o4 Mini costs $1.10 per million input tokens and $4.40 per million output tokens; MiMo-V2.5 costs $0.119 and $0.238. Cost per solved task is known for MiMo-V2.5 only.

Which has the bigger context window, o4 Mini or MiMo-V2.5?

MiMo-V2.5, with 1.05M tokens against 200K.

How many benchmarks is the o4 Mini vs MiMo-V2.5 comparison based on?

61 benchmarks have a result for both models as of October 21, 2026. o4 Mini's coding index rests on 2 independent benchmarks and MiMo-V2.5's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next