LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

o3 vs MiMo-V2.5-Pro

Updated October 21, 2026. 51 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

o3OpenAI
Coding
70.7
Overall
20.2
Output $/M
$8.00
9
MiMo-V2.5-ProXiaomi
Coding
40.0
Overall
26.0
Output $/M
$0.609
42
vs boards won of 51 shared

Decision reading

Pick o3 for coding: it scores 70.7 on the Vibe Coding Index against 40.0 for MiMo-V2.5-Pro.

Pick MiMo-V2.5-Pro when output tokens cost 13.1x less, or when a solved task costs $0.03 against $0.571.

Shared results
51
o3 only
46
MiMo-V2.5-Pro only
19
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
o3 70.7 from 2 benchmarks, MiMo-V2.5-Pro 40.0 from 1 benchmark.
Widest category
Web design, 24.8 points apart on average over 5 shared benchmarks.
Widest single gap
Design Arena: all code categories: o3 1021 against MiMo-V2.5-Pro 1266, 30.6 points apart on a 0 to 100 scale.
Output price
o3 $8.00 against MiMo-V2.5-Pro $0.609 per million output tokens, 13.1x apart.
Context window
o3 takes 200K tokens, MiMo-V2.5-Pro 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
Categoryo3BarsMiMo-V2.5-ProTies
Coding23
Intelligence01
Agentic work01
Reasoning15
Math02
Knowledge45
Web design05
General220
All shared boards942
CodingLike-for-likeFour of these boards feed the Vibe Coding Index23
Coding benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
Aider polyglot81.3%Not measuredOnly o3 measured
SWE-bench Verified58.4%Not measuredOnly o3 measured
SWE-bench Multimodal36.0%Not measuredOnly o3 measured
LMArena WebDevNot measured1480Only MiMo-V2.5-Pro measured
AA Coding IndexNot measured60.2Only MiMo-V2.5-Pro measured
LiveCodeBench (Vals AI)83.9%81.3%o3
SWE-bench Verified (Vals AI)Not measured74.0%Only MiMo-V2.5-Pro measured
Terminal-Bench 4 (Vals AI)Not measured0.5%Only MiMo-V2.5-Pro measured
Vibe Code Bench (Vals AI)Not measured34.1%Only MiMo-V2.5-Pro measured
Code migration (Vals AI)Not measured21.6%Only MiMo-V2.5-Pro measured
Terminal-Bench 2.1 (Vals AI)Not measured57.3%Only MiMo-V2.5-Pro measured
LiveCodeBench (Artificial Analysis run)80.8%Not measuredOnly o3 measured
SciCodeNot measured50.6%Only MiMo-V2.5-Pro measured
Terminal-Bench Hard (Artificial Analysis run)37.1%43.2%MiMo-V2.5-Pro
GSO-Bench8.8%Not measuredOnly o3 measured
WeirdML52.4%Not measuredOnly o3 measured
ALE-Bench933.5899.8o3
LMArena Text: coding14071501MiMo-V2.5-Pro
LMArena Text: software and IT14151495MiMo-V2.5-Pro
LMArena WebDev: ReactNot measured1469Only MiMo-V2.5-Pro measured
LMArena WebDev: HTMLNot measured1473Only MiMo-V2.5-Pro measured
Neither model has a result on the other 17 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
AA Intelligence Index20.226.0MiMo-V2.5-Pro
Epoch Capabilities Index146.7Not measuredOnly o3 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index01
Agentic work benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
AA Agentic IndexNot measured21.3Only MiMo-V2.5-Pro measured
Finance Agent (Vals AI)Not measured41.5%Only MiMo-V2.5-Pro measured
Tax Agent Bench (Vals AI)Not measured11.5%Only MiMo-V2.5-Pro measured
Legal Research Bench (Vals AI)Not measured15.9%Only MiMo-V2.5-Pro measured
Excel Modeling Benchmark (Vals AI)Not measured55.2%Only MiMo-V2.5-Pro measured
τ²-Bench Telecom80.7%94.2%MiMo-V2.5-Pro
METR time horizons65.4%Not measuredOnly o3 measured
GDPval30.8%Not measuredOnly o3 measured
DeepResearch Bench45.2%Not measuredOnly o3 measured
OSWorld23.0%Not measuredOnly o3 measured
Neither model has a result on the other 29 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index15
Reasoning benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
GPQA Diamond84.1%82.6%o3
MMMU Pro (Vals AI)80.4%Not measuredOnly o3 measured
GPQA Diamond (Artificial Analysis run)82.7%86.6%MiMo-V2.5-Pro
Humanity's Last Exam (Artificial Analysis run)20.1%35.7%MiMo-V2.5-Pro
GPQA Diamond (Epoch AI run)81.8%Not measuredOnly o3 measured
ARC-AGI60.8%Not measuredOnly o3 measured
ARC-AGI-26.5%Not measuredOnly o3 measured
SimpleBench53.1%Not measuredOnly o3 measured
Chess puzzles37.0%Not measuredOnly o3 measured
Mystery game puzzles29.0%Not measuredOnly o3 measured
VPCT52.0%Not measuredOnly o3 measured
LMArena Text: hard prompts14021486MiMo-V2.5-Pro
LMArena Text: expert14021501MiMo-V2.5-Pro
LMArena Text: hard prompts in English14111494MiMo-V2.5-Pro
LMArena Vision: diagrams1220Not measuredOnly o3 measured
LMArena Vision: homework1234Not measuredOnly o3 measured
Neither model has a result on the other 5 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
AIME85.3%Not measuredOnly o3 measured
MATH 500 (Vals AI)94.6%Not measuredOnly o3 measured
MGSM (Vals AI)91.8%Not measuredOnly o3 measured
AA Math Index88.3Not measuredOnly o3 measured
AIME 2025 (Artificial Analysis run)88.3%Not measuredOnly o3 measured
OTIS Mock AIME84.4%Not measuredOnly o3 measured
FrontierMath, tiers 1 to 333.3%Not measuredOnly o3 measured
ProofBenchNot measured22.0%Only MiMo-V2.5-Pro measured
MATH level 597.8%Not measuredOnly o3 measured
LMArena Text: math14261481MiMo-V2.5-Pro
LMArena Text: mathematical work14231491MiMo-V2.5-Pro
Neither model has a result on the other 2 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index45
Knowledge benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
MMLU Pro85.6%84.6%o3
LegalBench (Vals AI)83.8%77.1%o3
CorpFin (Vals AI)59.7%61.4%MiMo-V2.5-Pro
TaxEval (Vals AI)74.6%73.8%o3
MortgageTax (Vals AI)65.7%Not measuredOnly o3 measured
MedQA (Vals AI)96.1%Not measuredOnly o3 measured
MedCode (Vals AI)47.3%32.5%o3
MMLU Pro (Artificial Analysis run)85.3%Not measuredOnly o3 measured
SimpleQA Verified49.4%Not measuredOnly o3 measured
GeoBench74.0%Not measuredOnly o3 measured
LMArena Text: science14291482MiMo-V2.5-Pro
LMArena Text: medicine and healthcare14481473MiMo-V2.5-Pro
LMArena Text: legal and government14281474MiMo-V2.5-Pro
LMArena Text: business and finance13931466MiMo-V2.5-Pro
Neither model has a result on the other 3 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index05
Web design benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
Design Arena: websites10361267MiMo-V2.5-Pro
Design Arena: UI components10161248MiMo-V2.5-Pro
Design Arena: game dev10341261MiMo-V2.5-Pro
Design Arena: data viz12001257MiMo-V2.5-Pro
Design Arena: 3DNot measured1244Only MiMo-V2.5-Pro measured
Design Arena: all code categories10211266MiMo-V2.5-Pro
Design Arena: SVGNot measured1181Only MiMo-V2.5-Pro measured
Design Arena: ASCII artNot measured1157Only MiMo-V2.5-Pro measured
Neither model has a result on the other 1 board here
GeneralLike-for-likePublic boards, shown as published, kept out of the index220
General benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
SAGE (Vals AI)41.8%Not measuredOnly o3 measured
MedScribe (Vals AI)76.7%83.7%MiMo-V2.5-Pro
IFBench71.4%79.9%MiMo-V2.5-Pro
Long context reasoning (AA-LCR)74.7%79.7%MiMo-V2.5-Pro
DTBench84.8%84.5%o3
LMCA39.7%29.5%o3
Fiction.LiveBench88.9%Not measuredOnly o3 measured
Creative writing (Lech Mazur)83.9%Not measuredOnly o3 measured
CL-bench17.8%Not measuredOnly o3 measured
LMArena Text14101464MiMo-V2.5-Pro
LMArena Text: instruction following13681475MiMo-V2.5-Pro
LMArena Text: creative writing13591438MiMo-V2.5-Pro
LMArena Vision1214Not measuredOnly o3 measured
LMArena Text: English14171477MiMo-V2.5-Pro
LMArena Text: non-English14011448MiMo-V2.5-Pro
LMArena Text: Chinese14371507MiMo-V2.5-Pro
LMArena Text: German14201459MiMo-V2.5-Pro
LMArena Text: Japanese14031410MiMo-V2.5-Pro
LMArena Text: Korean13701435MiMo-V2.5-Pro
LMArena Text: French14301487MiMo-V2.5-Pro
LMArena Text: Spanish13951469MiMo-V2.5-Pro
LMArena Text: Russian14061449MiMo-V2.5-Pro
LMArena Text: Polish14381464MiMo-V2.5-Pro
LMArena Text: multi-turn14051476MiMo-V2.5-Pro
LMArena Text: longer queries13721481MiMo-V2.5-Pro
LMArena Text: writing and language13721451MiMo-V2.5-Pro
LMArena Text: entertainment and media13731438MiMo-V2.5-Pro
LMArena Vision: English1221Not measuredOnly o3 measured
LMArena Vision: Chinese1237Not measuredOnly o3 measured
LMArena Vision: reading text1218Not measuredOnly o3 measured
LMArena Vision: humor1222Not measuredOnly o3 measured
LMArena Vision: captioning1210Not measuredOnly o3 measured
LMArena Vision: recognizing things1234Not measuredOnly o3 measured
LMArena Vision: creative writing1201Not measuredOnly o3 measured
Neither model has a result on the other 12 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for o3 and MiMo-V2.5-Pro
Benchmarko3MiMo-V2.5-ProLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

o3$0.0060Fits in one request
MiMo-V2.5-Pro$0.0006Fits in one request

MiMo-V2.5-Pro costs less

Repository review

50K input + 3K output tokens

o3$0.124Fits in one request
MiMo-V2.5-Pro$0.017Fits in one request

MiMo-V2.5-Pro costs less

Agent loop

200K input + 10K output tokens

o3$0.480Exceeds the context window
MiMo-V2.5-Pro$0.067Fits in one request

MiMo-V2.5-Pro costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of o3 and MiMo-V2.5-Pro
SpecificationOpenAI o3Xiaomi MiMo-V2.5-Pro
MakerOpenAIXiaomi
WeightsNo public weights listedOpen weights
ReleasedApril 16, 2025April 22, 2026
Context window200K1.05M
Input $/Mtok$2.00$0.3045
Output $/Mtok$8.00$0.609
Coding index70.740.0
Independent measurements behind it21
Cost per solved task$0.571$0.03
SourceOpenRouter listingOpenRouter listing

Questions

Is o3 better than MiMo-V2.5-Pro for coding?

Pick o3 for coding: it scores 70.7 on the Vibe Coding Index against 40.0 for MiMo-V2.5-Pro. Pick MiMo-V2.5-Pro when output tokens cost 13.1x less, or when a solved task costs $0.03 against $0.571.

Which is cheaper, o3 or MiMo-V2.5-Pro?

o3 costs $2.00 per million input tokens and $8.00 per million output tokens; MiMo-V2.5-Pro costs $0.3045 and $0.609. Per solved SWE-bench Verified task, o3 costs $0.571 and MiMo-V2.5-Pro $0.03.

Which has the bigger context window, o3 or MiMo-V2.5-Pro?

MiMo-V2.5-Pro, with 1.05M tokens against 200K.

How many benchmarks is the o3 vs MiMo-V2.5-Pro comparison based on?

51 benchmarks have a result for both models as of October 21, 2026. o3's coding index rests on 2 independent benchmarks and MiMo-V2.5-Pro's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next