LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Trinity Large Thinking vs Devstral 2 2512

Updated October 21, 2026. 3 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Trinity Large ThinkingArcee AI
Coding
5.4
Overall
10.8
Output $/M
$0.80
1
Devstral 2 2512Mistral AI
Coding
53.8
Overall
8.6
Output $/M
$2.00
2
vs boards won of 3 shared

Decision reading

Pick Devstral 2 2512 for coding: it scores 53.8 on the Vibe Coding Index against 5.4 for Trinity Large Thinking.

Pick Trinity Large Thinking when output tokens cost 2.5x less, or when the benchmark that matters is AA Intelligence Index, where it leads.

Shared results
3
Trinity Large Thinking only
49
Devstral 2 2512 only
3
Like-for-like categories
3 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Trinity Large Thinking 5.4 from 1 benchmark, Devstral 2 2512 53.8 from 1 benchmark.
Widest category
Coding, 5.5 points apart on average over 1 shared benchmark.
Widest single gap
AA Coding Index: Trinity Large Thinking 25.8 against Devstral 2 2512 31.3, 5.5 points apart on a 0 to 100 scale.
Output price
Trinity Large Thinking $0.80 against Devstral 2 2512 $2.00 per million output tokens, 2.5x apart.
Context window
Both take 262K tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryTrinity Large ThinkingBarsDevstral 2 2512Ties
Coding01
Intelligence10
Agentic work01
All shared boards12
CodingLike-for-likeFour of these boards feed the Vibe Coding Index01
Coding benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
SWE-bench VerifiedNot measured53.8%Only Devstral 2 2512 measured
LMArena WebDev1238Not measuredOnly Trinity Large Thinking measured
AA Coding Index25.831.3Devstral 2 2512
LiveCodeBench (Vals AI)Not measured51.8%Only Devstral 2 2512 measured
SWE-bench Verified (Vals AI)Not measured62.8%Only Devstral 2 2512 measured
SciCode40.6%Not measuredOnly Trinity Large Thinking measured
Terminal-Bench Hard (Artificial Analysis run)22.7%Not measuredOnly Trinity Large Thinking measured
LMArena Text: coding1357Not measuredOnly Trinity Large Thinking measured
LMArena Text: software and IT1362Not measuredOnly Trinity Large Thinking measured
LMArena WebDev: React1231Not measuredOnly Trinity Large Thinking measured
LMArena WebDev: HTML1240Not measuredOnly Trinity Large Thinking measured
Neither model has a result on the other 27 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
AA Intelligence Index10.88.6Trinity Large Thinking
Neither model has a result on the other 1 board here
Agentic workLike-for-likePublic boards, shown as published, kept out of the index01
Agentic work benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
AA Agentic Index1.02.3Devstral 2 2512
τ²-Bench Telecom90.1%Not measuredOnly Trinity Large Thinking measured
Neither model has a result on the other 37 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index5 boards, none shared
Reasoning benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
GPQA Diamond (Artificial Analysis run)75.2%Not measuredOnly Trinity Large Thinking measured
Humanity's Last Exam (Artificial Analysis run)15.8%Not measuredOnly Trinity Large Thinking measured
LMArena Text: hard prompts1342Not measuredOnly Trinity Large Thinking measured
LMArena Text: expert1359Not measuredOnly Trinity Large Thinking measured
LMArena Text: hard prompts in English1356Not measuredOnly Trinity Large Thinking measured
Neither model has a result on the other 16 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index2 boards, none shared
Math benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
LMArena Text: math1365Not measuredOnly Trinity Large Thinking measured
LMArena Text: mathematical work1350Not measuredOnly Trinity Large Thinking measured
Neither model has a result on the other 11 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index6 boards, none shared
Knowledge benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
CaseLaw (Vals AI)57.9%Not measuredOnly Trinity Large Thinking measured
CorpFin (Vals AI)54.7%Not measuredOnly Trinity Large Thinking measured
LMArena Text: science1355Not measuredOnly Trinity Large Thinking measured
LMArena Text: medicine and healthcare1349Not measuredOnly Trinity Large Thinking measured
LMArena Text: legal and government1345Not measuredOnly Trinity Large Thinking measured
LMArena Text: business and finance1329Not measuredOnly Trinity Large Thinking measured
Neither model has a result on the other 11 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index8 boards, none shared
Web design benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
Design Arena: websites1137Not measuredOnly Trinity Large Thinking measured
Design Arena: UI components1045Not measuredOnly Trinity Large Thinking measured
Design Arena: game dev1079Not measuredOnly Trinity Large Thinking measured
Design Arena: data viz1098Not measuredOnly Trinity Large Thinking measured
Design Arena: 3D1082Not measuredOnly Trinity Large Thinking measured
Design Arena: all code categories1117Not measuredOnly Trinity Large Thinking measured
Design Arena: SVG1016Not measuredOnly Trinity Large Thinking measured
Design Arena: ASCII art1041Not measuredOnly Trinity Large Thinking measured
Neither model has a result on the other 1 board here
GeneralDirectional onlyPublic boards, shown as published, kept out of the index20 boards, none shared
General benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
IFBench56.3%Not measuredOnly Trinity Large Thinking measured
Long context reasoning (AA-LCR)38.0%Not measuredOnly Trinity Large Thinking measured
Surface Evolver Bench15.6%Not measuredOnly Trinity Large Thinking measured
LMArena Text1340Not measuredOnly Trinity Large Thinking measured
LMArena Text: instruction following1326Not measuredOnly Trinity Large Thinking measured
LMArena Text: creative writing1308Not measuredOnly Trinity Large Thinking measured
LMArena Text: English1356Not measuredOnly Trinity Large Thinking measured
LMArena Text: non-English1325Not measuredOnly Trinity Large Thinking measured
LMArena Text: Chinese1371Not measuredOnly Trinity Large Thinking measured
LMArena Text: German1356Not measuredOnly Trinity Large Thinking measured
LMArena Text: Japanese1312Not measuredOnly Trinity Large Thinking measured
LMArena Text: Korean1306Not measuredOnly Trinity Large Thinking measured
LMArena Text: French1366Not measuredOnly Trinity Large Thinking measured
LMArena Text: Spanish1327Not measuredOnly Trinity Large Thinking measured
LMArena Text: Russian1338Not measuredOnly Trinity Large Thinking measured
LMArena Text: Polish1312Not measuredOnly Trinity Large Thinking measured
LMArena Text: multi-turn1320Not measuredOnly Trinity Large Thinking measured
LMArena Text: longer queries1318Not measuredOnly Trinity Large Thinking measured
LMArena Text: writing and language1317Not measuredOnly Trinity Large Thinking measured
LMArena Text: entertainment and media1296Not measuredOnly Trinity Large Thinking measured
Neither model has a result on the other 26 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Trinity Large Thinking and Devstral 2 2512
BenchmarkTrinity Large ThinkingDevstral 2 2512Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Trinity Large Thinking$0.0006Fits in one request
Devstral 2 2512$0.0014Fits in one request

Trinity Large Thinking costs less

Repository review

50K input + 3K output tokens

Trinity Large Thinking$0.015Fits in one request
Devstral 2 2512$0.026Fits in one request

Trinity Large Thinking costs less

Agent loop

200K input + 10K output tokens

Trinity Large Thinking$0.058Fits in one request
Devstral 2 2512$0.100Fits in one request

Trinity Large Thinking costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Trinity Large Thinking and Devstral 2 2512
SpecificationArcee AI Trinity Large ThinkingMistral Devstral 2 2512
MakerArcee AIMistral AI
WeightsOpen weightsOpen weights
ReleasedApril 1, 2026December 9, 2025
Context window262K262K
Input $/Mtok$0.25$0.40
Output $/Mtok$0.80$2.00
Coding index5.453.8
Independent measurements behind it11
Cost per solved taskNot computable$1.19
SourceOpenRouter listingOpenRouter listing

Questions

Is Trinity Large Thinking better than Devstral 2 2512 for coding?

Pick Devstral 2 2512 for coding: it scores 53.8 on the Vibe Coding Index against 5.4 for Trinity Large Thinking. Pick Trinity Large Thinking when output tokens cost 2.5x less, or when the benchmark that matters is AA Intelligence Index, where it leads.

Which is cheaper, Trinity Large Thinking or Devstral 2 2512?

Trinity Large Thinking costs $0.25 per million input tokens and $0.80 per million output tokens; Devstral 2 2512 costs $0.40 and $2.00. Cost per solved task is known for Devstral 2 2512 only.

Which has the bigger context window, Trinity Large Thinking or Devstral 2 2512?

Neither: both take 262K tokens.

How many benchmarks is the Trinity Large Thinking vs Devstral 2 2512 comparison based on?

3 benchmarks have a result for both models as of October 21, 2026. Trinity Large Thinking's coding index rests on 1 independent benchmark and Devstral 2 2512's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next