LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Devstral 2 2512 vs Gemini 3.1 Flash Lite Preview

Updated October 21, 2026. 5 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Devstral 2 2512Mistral AI
Coding
53.8
Overall
8.6
Output $/M
$2.00
1
Gemini 3.1 Flash Lite PreviewGoogle
Coding
8.1
Overall
15.6
Output $/M
$1.50
3
vs boards won of 5 shared, 1 tied

Decision reading

Pick Devstral 2 2512 for coding: it scores 53.8 on the Vibe Coding Index against 8.1 for Gemini 3.1 Flash Lite Preview.

Pick Gemini 3.1 Flash Lite Preview when output tokens cost 1.3x less, or when a solved task costs $0.18 against $1.19.

Shared results
5
Devstral 2 2512 only
1
Gemini 3.1 Flash Lite Preview only
72
Like-for-like categories
3 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Devstral 2 2512 53.8 from 1 benchmark, Gemini 3.1 Flash Lite Preview 8.1 from 1 benchmark.
Widest category
Coding, 10.6 points apart on average over 3 shared benchmarks.
Widest single gap
LiveCodeBench (Vals AI): Devstral 2 2512 51.8% against Gemini 3.1 Flash Lite Preview 80.1%, 28.3 points apart on a 0 to 100 scale.
Output price
Devstral 2 2512 $2.00 against Gemini 3.1 Flash Lite Preview $1.50 per million output tokens, 1.3x apart.
Context window
Devstral 2 2512 takes 262K tokens, Gemini 3.1 Flash Lite Preview 1.05M.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryDevstral 2 2512BarsGemini 3.1 Flash Lite PreviewTies
Coding021 tie
Intelligence01
Agentic work10
All shared boards131 tie
CodingLike-for-likeFour of these boards feed the Vibe Coding Index02
Coding benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
SWE-bench Verified53.8%Not measuredOnly Devstral 2 2512 measured
LMArena WebDevNot measured1257Only Gemini 3.1 Flash Lite Preview measured
AA Coding Index31.334.7Gemini 3.1 Flash Lite Preview
LiveCodeBench (Vals AI)51.8%80.1%Gemini 3.1 Flash Lite Preview
SWE-bench Verified (Vals AI)62.8%62.8%Tie
Vibe Code Bench (Vals AI)Not measured0.0%Only Gemini 3.1 Flash Lite Preview measured
Code migration (Vals AI)Not measured4.6%Only Gemini 3.1 Flash Lite Preview measured
ProgramBench (Vals AI)Not measured0.0%Only Gemini 3.1 Flash Lite Preview measured
Terminal-Bench 2.1 (Vals AI)Not measured34.1%Only Gemini 3.1 Flash Lite Preview measured
ALE-BenchNot measured797.7Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: codingNot measured1400Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: software and ITNot measured1413Only Gemini 3.1 Flash Lite Preview measured
LMArena WebDev: ReactNot measured1245Only Gemini 3.1 Flash Lite Preview measured
LMArena WebDev: HTMLNot measured1276Only Gemini 3.1 Flash Lite Preview measured
LMArena WebDev: from an imageNot measured1336Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 23 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
AA Intelligence Index8.615.6Gemini 3.1 Flash Lite Preview
Neither model has a result on the other 1 board here
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
AA Agentic Index2.31.6Devstral 2 2512
Finance Agent (Vals AI)Not measured30.0%Only Gemini 3.1 Flash Lite Preview measured
Tax Agent Bench (Vals AI)Not measured3.1%Only Gemini 3.1 Flash Lite Preview measured
Legal Research Bench (Vals AI)Not measured3.4%Only Gemini 3.1 Flash Lite Preview measured
Excel Modeling Benchmark (Vals AI)Not measured8.6%Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 34 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index7 boards, none shared
Reasoning benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
GPQA DiamondNot measured81.1%Only Gemini 3.1 Flash Lite Preview measured
MMMU Pro (Vals AI)Not measured82.5%Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: hard promptsNot measured1407Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: expertNot measured1398Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: hard prompts in EnglishNot measured1403Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: diagramsNot measured1242Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: homeworkNot measured1271Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 14 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index3 boards, none shared
Math benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
AIMENot measured83.3%Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: mathNot measured1428Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: mathematical workNot measured1417Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 10 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index11 boards, none shared
Knowledge benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
MMLU ProNot measured86.2%Only Gemini 3.1 Flash Lite Preview measured
LegalBench (Vals AI)Not measured83.8%Only Gemini 3.1 Flash Lite Preview measured
CaseLaw (Vals AI)Not measured55.0%Only Gemini 3.1 Flash Lite Preview measured
CorpFin (Vals AI)Not measured59.4%Only Gemini 3.1 Flash Lite Preview measured
TaxEval (Vals AI)Not measured71.8%Only Gemini 3.1 Flash Lite Preview measured
MortgageTax (Vals AI)Not measured68.0%Only Gemini 3.1 Flash Lite Preview measured
MedCode (Vals AI)Not measured47.6%Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: scienceNot measured1425Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: medicine and healthcareNot measured1428Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: legal and governmentNot measured1418Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: business and financeNot measured1389Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 6 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
Design Arena: websitesNot measured1083Only Gemini 3.1 Flash Lite Preview measured
Design Arena: UI componentsNot measured1071Only Gemini 3.1 Flash Lite Preview measured
Design Arena: game devNot measured1029Only Gemini 3.1 Flash Lite Preview measured
Design Arena: data vizNot measured1045Only Gemini 3.1 Flash Lite Preview measured
Design Arena: 3DNot measured1048Only Gemini 3.1 Flash Lite Preview measured
Design Arena: all code categoriesNot measured1072Only Gemini 3.1 Flash Lite Preview measured
Design Arena: SVGNot measured1052Only Gemini 3.1 Flash Lite Preview measured
Design Arena: ASCII artNot measured1166Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 1 board here
GeneralDirectional onlyPublic boards, shown as published, kept out of the index28 boards, none shared
General benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
SAGE (Vals AI)Not measured49.5%Only Gemini 3.1 Flash Lite Preview measured
MedScribe (Vals AI)Not measured63.9%Only Gemini 3.1 Flash Lite Preview measured
Vals Multimodal IndexNot measured41.4%Only Gemini 3.1 Flash Lite Preview measured
LMArena TextNot measured1416Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: instruction followingNot measured1377Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: creative writingNot measured1401Only Gemini 3.1 Flash Lite Preview measured
LMArena VisionNot measured1240Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: EnglishNot measured1414Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: non-EnglishNot measured1410Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: ChineseNot measured1460Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: GermanNot measured1430Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: JapaneseNot measured1413Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: KoreanNot measured1392Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: FrenchNot measured1424Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: SpanishNot measured1421Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: RussianNot measured1420Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: PolishNot measured1443Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: multi-turnNot measured1417Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: longer queriesNot measured1394Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: writing and languageNot measured1408Only Gemini 3.1 Flash Lite Preview measured
LMArena Text: entertainment and mediaNot measured1386Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: EnglishNot measured1232Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: ChineseNot measured1278Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: reading textNot measured1246Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: humorNot measured1266Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: captioningNot measured1259Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: recognizing thingsNot measured1308Only Gemini 3.1 Flash Lite Preview measured
LMArena Vision: creative writingNot measured1248Only Gemini 3.1 Flash Lite Preview measured
Neither model has a result on the other 18 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
BenchmarkDevstral 2 2512Gemini 3.1 Flash Lite PreviewLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Devstral 2 2512$0.0014Fits in one request
Gemini 3.1 Flash Lite Preview$0.0010Fits in one request

Gemini 3.1 Flash Lite Preview costs less

Repository review

50K input + 3K output tokens

Devstral 2 2512$0.026Fits in one request
Gemini 3.1 Flash Lite Preview$0.017Fits in one request

Gemini 3.1 Flash Lite Preview costs less

Agent loop

200K input + 10K output tokens

Devstral 2 2512$0.100Fits in one request
Gemini 3.1 Flash Lite Preview$0.065Fits in one request

Gemini 3.1 Flash Lite Preview costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Devstral 2 2512 and Gemini 3.1 Flash Lite Preview
SpecificationMistral Devstral 2 2512Google Gemini 3.1 Flash Lite Preview
MakerMistral AIGoogle
WeightsOpen weightsNo public weights listed
ReleasedDecember 9, 2025March 3, 2026
Context window262K1.05M
Input $/Mtok$0.40$0.25
Output $/Mtok$2.00$1.50
Coding index53.88.1
Independent measurements behind it11
Cost per solved task$1.19$0.18
SourceOpenRouter listingOpenRouter listing

Questions

Is Devstral 2 2512 better than Gemini 3.1 Flash Lite Preview for coding?

Pick Devstral 2 2512 for coding: it scores 53.8 on the Vibe Coding Index against 8.1 for Gemini 3.1 Flash Lite Preview. Pick Gemini 3.1 Flash Lite Preview when output tokens cost 1.3x less, or when a solved task costs $0.18 against $1.19.

Which is cheaper, Devstral 2 2512 or Gemini 3.1 Flash Lite Preview?

Devstral 2 2512 costs $0.40 per million input tokens and $2.00 per million output tokens; Gemini 3.1 Flash Lite Preview costs $0.25 and $1.50. Per solved SWE-bench Verified task, Devstral 2 2512 costs $1.19 and Gemini 3.1 Flash Lite Preview $0.18.

Which has the bigger context window, Devstral 2 2512 or Gemini 3.1 Flash Lite Preview?

Gemini 3.1 Flash Lite Preview, with 1.05M tokens against 262K.

How many benchmarks is the Devstral 2 2512 vs Gemini 3.1 Flash Lite Preview comparison based on?

5 benchmarks have a result for both models as of October 21, 2026. Devstral 2 2512's coding index rests on 1 independent benchmark and Gemini 3.1 Flash Lite Preview's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next