LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Devstral 2 2512 vs Muse Spark 1.3

Updated October 21, 2026. 3 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Devstral 2 2512Mistral AI
Coding
53.8
Overall
8.6
Output $/M
$2.00
0
Muse Spark 1.3Meta
Coding
79.7
Overall
48.1
Output $/M
$4.25
3
vs boards won of 3 shared

Decision reading

Pick Muse Spark 1.3 for coding: it scores 79.7 on the Vibe Coding Index against 53.8 for Devstral 2 2512.

Pick Devstral 2 2512 when output tokens cost 2.1x less.

Shared results
3
Devstral 2 2512 only
3
Muse Spark 1.3 only
89
Like-for-like categories
3 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Devstral 2 2512 53.8 from 1 benchmark, Muse Spark 1.3 79.7 from 2 benchmarks.
Widest category
Agentic work, 53.2 points apart on average over 1 shared benchmark.
Widest single gap
AA Agentic Index: Devstral 2 2512 2.3 against Muse Spark 1.3 55.5, 53.2 points apart on a 0 to 100 scale.
Output price
Devstral 2 2512 $2.00 against Muse Spark 1.3 $4.25 per million output tokens, 2.1x apart.
Context window
Devstral 2 2512 takes 262K tokens, Muse Spark 1.3 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDevstral 2 2512BarsMuse Spark 1.3Ties
Coding01
Intelligence01
Agentic work01
All shared boards03
CodingLike-for-likeFour of these boards feed the Vibe Coding Index01
Coding benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
SWE-bench Verified53.8%Not measuredOnly Devstral 2 2512 measured
LiveBench codingNot measured90.2%Only Muse Spark 1.3 measured
LMArena WebDevNot measured1659Only Muse Spark 1.3 measured
AA Coding Index31.375.8Muse Spark 1.3
LiveCodeBench (Vals AI)51.8%Not measuredOnly Devstral 2 2512 measured
SWE-bench Verified (Vals AI)62.8%Not measuredOnly Devstral 2 2512 measured
Terminal-Bench 4 (Vals AI)Not measured10.6%Only Muse Spark 1.3 measured
Vibe Code Bench (Vals AI)Not measured82.9%Only Muse Spark 1.3 measured
Code migration (Vals AI)Not measured27.6%Only Muse Spark 1.3 measured
ProgramBench (Vals AI)Not measured0.5%Only Muse Spark 1.3 measured
IOI (Vals AI)Not measured43.9%Only Muse Spark 1.3 measured
Terminal-Bench 2.1 (Vals AI)Not measured72.3%Only Muse Spark 1.3 measured
CyberBench (Vals AI)Not measured69.4%Only Muse Spark 1.3 measured
SciCodeNot measured59.7%Only Muse Spark 1.3 measured
FrontierSWENot measured25.8%Only Muse Spark 1.3 measured
ALE-BenchNot measured1688.3Only Muse Spark 1.3 measured
LMArena Text: codingNot measured1510Only Muse Spark 1.3 measured
LMArena Text: software and ITNot measured1511Only Muse Spark 1.3 measured
LMArena WebDev: ReactNot measured1672Only Muse Spark 1.3 measured
LMArena WebDev: HTMLNot measured1653Only Muse Spark 1.3 measured
LMArena WebDev: from an imageNot measured1640Only Muse Spark 1.3 measured
Neither model has a result on the other 17 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
AA Intelligence Index8.648.1Muse Spark 1.3
Epoch Capabilities IndexNot measured157.2Only Muse Spark 1.3 measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index01
Agentic work benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
AA Agentic Index2.355.5Muse Spark 1.3
Design Arena: agents building web appsNot measured1297Only Muse Spark 1.3 measured
Design Arena: agents building full-stack appsNot measured1295Only Muse Spark 1.3 measured
Design Arena: agents building mobile appsNot measured1217Only Muse Spark 1.3 measured
Design Arena: agents building Godot gamesNot measured1241Only Muse Spark 1.3 measured
Design Arena: PowerPoint slidesNot measured1244Only Muse Spark 1.3 measured
Design Arena: spreadsheetsNot measured1048Only Muse Spark 1.3 measured
LiveBench researchNot measured68.6%Only Muse Spark 1.3 measured
LiveBench browserNot measured80.0%Only Muse Spark 1.3 measured
LiveBench long agenticNot measured40.4%Only Muse Spark 1.3 measured
Finance Agent (Vals AI)Not measured58.9%Only Muse Spark 1.3 measured
Tax Agent Bench (Vals AI)Not measured36.0%Only Muse Spark 1.3 measured
Legal Research Bench (Vals AI)Not measured40.9%Only Muse Spark 1.3 measured
Excel Modeling Benchmark (Vals AI)Not measured62.7%Only Muse Spark 1.3 measured
Terminal-Bench-Science (Vals AI)Not measured4.3%Only Muse Spark 1.3 measured
APEX-AgentsNot measured58.6%Only Muse Spark 1.3 measured
Neither model has a result on the other 23 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index10 boards, none shared
Reasoning benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
LiveBench reasoningNot measured89.7%Only Muse Spark 1.3 measured
GPQA Diamond (Artificial Analysis run)Not measured94.1%Only Muse Spark 1.3 measured
Humanity's Last Exam (Artificial Analysis run)Not measured48.7%Only Muse Spark 1.3 measured
Chess puzzlesNot measured37.0%Only Muse Spark 1.3 measured
Mystery game puzzlesNot measured25.0%Only Muse Spark 1.3 measured
LMArena Text: hard promptsNot measured1503Only Muse Spark 1.3 measured
LMArena Text: expertNot measured1519Only Muse Spark 1.3 measured
LMArena Text: hard prompts in EnglishNot measured1500Only Muse Spark 1.3 measured
LMArena Vision: diagramsNot measured1330Only Muse Spark 1.3 measured
LMArena Vision: homeworkNot measured1296Only Muse Spark 1.3 measured
Neither model has a result on the other 11 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index6 boards, none shared
Math benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
OTIS Mock AIMENot measured99.2%Only Muse Spark 1.3 measured
FrontierMath, tiers 1 to 3Not measured74.4%Only Muse Spark 1.3 measured
FrontierMath, tier 4Not measured46.3%Only Muse Spark 1.3 measured
ProofBenchNot measured58.0%Only Muse Spark 1.3 measured
LMArena Text: mathNot measured1497Only Muse Spark 1.3 measured
LMArena Text: mathematical workNot measured1491Only Muse Spark 1.3 measured
Neither model has a result on the other 7 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index4 boards, none shared
Knowledge benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
LMArena Text: scienceNot measured1507Only Muse Spark 1.3 measured
LMArena Text: medicine and healthcareNot measured1493Only Muse Spark 1.3 measured
LMArena Text: legal and governmentNot measured1499Only Muse Spark 1.3 measured
LMArena Text: business and financeNot measured1490Only Muse Spark 1.3 measured
Neither model has a result on the other 13 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
Design Arena: websitesNot measured1356Only Muse Spark 1.3 measured
Design Arena: UI componentsNot measured1352Only Muse Spark 1.3 measured
Design Arena: game devNot measured1329Only Muse Spark 1.3 measured
Design Arena: data vizNot measured1343Only Muse Spark 1.3 measured
Design Arena: 3DNot measured1359Only Muse Spark 1.3 measured
Design Arena: all code categoriesNot measured1353Only Muse Spark 1.3 measured
Design Arena: SVGNot measured1300Only Muse Spark 1.3 measured
Design Arena: ASCII artNot measured1280Only Muse Spark 1.3 measured
LiveBench designNot measured74.8%Only Muse Spark 1.3 measured
GeneralDirectional onlyPublic boards, shown as published, kept out of the index27 boards, none shared
General benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
LiveBench data analysisNot measured79.6%Only Muse Spark 1.3 measured
Long context reasoning (AA-LCR)Not measured83.0%Only Muse Spark 1.3 measured
DTBenchNot measured96.5%Only Muse Spark 1.3 measured
LMCANot measured53.9%Only Muse Spark 1.3 measured
LMArena TextNot measured1490Only Muse Spark 1.3 measured
LMArena Text: instruction followingNot measured1479Only Muse Spark 1.3 measured
LMArena Text: creative writingNot measured1462Only Muse Spark 1.3 measured
LMArena VisionNot measured1308Only Muse Spark 1.3 measured
LMArena Text: EnglishNot measured1495Only Muse Spark 1.3 measured
LMArena Text: non-EnglishNot measured1481Only Muse Spark 1.3 measured
LMArena Text: ChineseNot measured1532Only Muse Spark 1.3 measured
LMArena Text: GermanNot measured1513Only Muse Spark 1.3 measured
LMArena Text: JapaneseNot measured1470Only Muse Spark 1.3 measured
LMArena Text: KoreanNot measured1490Only Muse Spark 1.3 measured
LMArena Text: FrenchNot measured1511Only Muse Spark 1.3 measured
LMArena Text: SpanishNot measured1496Only Muse Spark 1.3 measured
LMArena Text: RussianNot measured1491Only Muse Spark 1.3 measured
LMArena Text: PolishNot measured1490Only Muse Spark 1.3 measured
LMArena Text: multi-turnNot measured1487Only Muse Spark 1.3 measured
LMArena Text: longer queriesNot measured1488Only Muse Spark 1.3 measured
LMArena Text: writing and languageNot measured1470Only Muse Spark 1.3 measured
LMArena Text: entertainment and mediaNot measured1457Only Muse Spark 1.3 measured
LMArena Vision: EnglishNot measured1298Only Muse Spark 1.3 measured
LMArena Vision: ChineseNot measured1384Only Muse Spark 1.3 measured
LMArena Vision: reading textNot measured1319Only Muse Spark 1.3 measured
LMArena Vision: humorNot measured1293Only Muse Spark 1.3 measured
LMArena Vision: creative writingNot measured1296Only Muse Spark 1.3 measured
Neither model has a result on the other 19 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Devstral 2 2512 and Muse Spark 1.3
BenchmarkDevstral 2 2512Muse Spark 1.3Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Devstral 2 2512$0.0014Fits in one request
Muse Spark 1.3$0.0034Fits in one request

Devstral 2 2512 costs less

Repository review

50K input + 3K output tokens

Devstral 2 2512$0.026Fits in one request
Muse Spark 1.3$0.075Fits in one request

Devstral 2 2512 costs less

Agent loop

200K input + 10K output tokens

Devstral 2 2512$0.100Fits in one request
Muse Spark 1.3$0.292Fits in one request

Devstral 2 2512 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Devstral 2 2512 and Muse Spark 1.3
SpecificationMistral Devstral 2 2512Meta Muse Spark 1.3
MakerMistral AIMeta
WeightsOpen weightsNo public weights listed
ReleasedDecember 9, 2025September 2, 2026
Context window262K1.05M
Input $/Mtok$0.40$1.25
Output $/Mtok$2.00$4.25
Coding index53.879.7
Independent measurements behind it12
Cost per solved task$1.19Not computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Devstral 2 2512 better than Muse Spark 1.3 for coding?

Pick Muse Spark 1.3 for coding: it scores 79.7 on the Vibe Coding Index against 53.8 for Devstral 2 2512. Pick Devstral 2 2512 when output tokens cost 2.1x less.

Which is cheaper, Devstral 2 2512 or Muse Spark 1.3?

Devstral 2 2512 costs $0.40 per million input tokens and $2.00 per million output tokens; Muse Spark 1.3 costs $1.25 and $4.25. Cost per solved task is known for Devstral 2 2512 only.

Which has the bigger context window, Devstral 2 2512 or Muse Spark 1.3?

Muse Spark 1.3, with 1.05M tokens against 262K.

How many benchmarks is the Devstral 2 2512 vs Muse Spark 1.3 comparison based on?

3 benchmarks have a result for both models as of October 21, 2026. Devstral 2 2512's coding index rests on 1 independent benchmark and Muse Spark 1.3's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next