LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Trinity Large Thinking vs Gemma 4 31B

Updated October 21, 2026. 40 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

Trinity Large ThinkingArcee AI
Coding
5.4
Overall
10.8
Output $/M
$0.80
2
Gemma 4 31BGoogle
Coding
38.3
Overall
14.7
Output $/M
$0.40
38
vs boards won of 40 shared

Decision reading

Pick Gemma 4 31B for coding: it scores 38.3 on the Vibe Coding Index against 5.4 for Trinity Large Thinking.

Pick Trinity Large Thinking when what matters is τ²-Bench Telecom or CaseLaw (Vals AI), where it leads.

Shared results
40
Trinity Large Thinking only
12
Gemma 4 31B only
28
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
Trinity Large Thinking 5.4 from 1 benchmark, Gemma 4 31B 38.3 from 2 benchmarks.
Widest category
General, 18.9 points apart on average over 17 shared benchmarks.
Widest single gap
Long context reasoning (AA-LCR): Trinity Large Thinking 38.0% against Gemma 4 31B 69.7%, 31.7 points apart on a 0 to 100 scale.
Output price
Trinity Large Thinking $0.80 against Gemma 4 31B $0.40 per million output tokens, 2.0x apart.
Context window
Both take 262K tokens.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryTrinity Large ThinkingBarsGemma 4 31BTies
Coding08
Intelligence01
Agentic work11
Reasoning05
Math02
Knowledge14
General017
All shared boards238
CodingLike-for-likeFour of these boards feed the Vibe Coding Index08
Coding benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
LiveBench codingNot measured49.0%Only Gemma 4 31B measured
LMArena WebDev12381367Gemma 4 31B
AA Coding Index25.843.4Gemma 4 31B
SciCode40.6%45.5%Gemma 4 31B
Terminal-Bench Hard (Artificial Analysis run)22.7%36.4%Gemma 4 31B
WeirdMLNot measured52.3%Only Gemma 4 31B measured
ALE-BenchNot measured925.5Only Gemma 4 31B measured
LMArena Text: coding13571459Gemma 4 31B
LMArena Text: software and IT13621463Gemma 4 31B
LMArena WebDev: React12311359Gemma 4 31B
LMArena WebDev: HTML12401380Gemma 4 31B
Neither model has a result on the other 27 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
AA Intelligence Index10.814.7Gemma 4 31B
Epoch Capabilities IndexNot measured143.0Only Gemma 4 31B measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index11
Agentic work benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
AA Agentic Index1.04.2Gemma 4 31B
LiveBench researchNot measured44.4%Only Gemma 4 31B measured
LiveBench browserNot measured4.0%Only Gemma 4 31B measured
LiveBench long agenticNot measured13.3%Only Gemma 4 31B measured
τ²-Bench Telecom90.1%65.5%Trinity Large Thinking
Neither model has a result on the other 34 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index05
Reasoning benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
LiveBench reasoningNot measured68.3%Only Gemma 4 31B measured
GPQA Diamond (Artificial Analysis run)75.2%85.7%Gemma 4 31B
Humanity's Last Exam (Artificial Analysis run)15.8%23.6%Gemma 4 31B
GPQA Diamond (Epoch AI run)Not measured75.8%Only Gemma 4 31B measured
LMArena Text: hard prompts13421448Gemma 4 31B
LMArena Text: expert13591464Gemma 4 31B
LMArena Text: hard prompts in English13561456Gemma 4 31B
LMArena Vision: diagramsNot measured1283Only Gemma 4 31B measured
LMArena Vision: homeworkNot measured1310Only Gemma 4 31B measured
Neither model has a result on the other 12 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
OTIS Mock AIMENot measured73.3%Only Gemma 4 31B measured
LMArena Text: math13651463Gemma 4 31B
LMArena Text: mathematical work13501465Gemma 4 31B
Neither model has a result on the other 10 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index14
Knowledge benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
CaseLaw (Vals AI)57.9%52.6%Trinity Large Thinking
CorpFin (Vals AI)54.7%Not measuredOnly Trinity Large Thinking measured
MortgageTax (Vals AI)Not measured61.4%Only Gemma 4 31B measured
SimpleQA VerifiedNot measured10.4%Only Gemma 4 31B measured
LMArena Text: science13551457Gemma 4 31B
LMArena Text: medicine and healthcare13491451Gemma 4 31B
LMArena Text: legal and government13451438Gemma 4 31B
LMArena Text: business and finance13291430Gemma 4 31B
Neither model has a result on the other 9 boards here
Web designDirectional onlyPublic boards, shown as published, kept out of the index9 boards, none shared
Web design benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
Design Arena: websites1137Not measuredOnly Trinity Large Thinking measured
Design Arena: UI components1045Not measuredOnly Trinity Large Thinking measured
Design Arena: game dev1079Not measuredOnly Trinity Large Thinking measured
Design Arena: data viz1098Not measuredOnly Trinity Large Thinking measured
Design Arena: 3D1082Not measuredOnly Trinity Large Thinking measured
Design Arena: all code categories1117Not measuredOnly Trinity Large Thinking measured
Design Arena: SVG1016Not measuredOnly Trinity Large Thinking measured
Design Arena: ASCII art1041Not measuredOnly Trinity Large Thinking measured
LiveBench designNot measured58.4%Only Gemma 4 31B measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index017
General benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
LiveBench data analysisNot measured53.3%Only Gemma 4 31B measured
SAGE (Vals AI)Not measured55.0%Only Gemma 4 31B measured
IFBench56.3%75.6%Gemma 4 31B
Long context reasoning (AA-LCR)38.0%69.7%Gemma 4 31B
DTBenchNot measured82.7%Only Gemma 4 31B measured
LMCANot measured39.3%Only Gemma 4 31B measured
Surface Evolver Bench15.6%30.6%Gemma 4 31B
LMArena Text13401443Gemma 4 31B
LMArena Text: instruction following13261433Gemma 4 31B
LMArena Text: creative writing13081417Gemma 4 31B
LMArena VisionNot measured1276Only Gemma 4 31B measured
LMArena Text: English13561451Gemma 4 31B
LMArena Text: non-English13251430Gemma 4 31B
LMArena Text: Chinese13711475Gemma 4 31B
LMArena Text: German1356Not measuredOnly Trinity Large Thinking measured
LMArena Text: Japanese1312Not measuredOnly Trinity Large Thinking measured
LMArena Text: Korean1306Not measuredOnly Trinity Large Thinking measured
LMArena Text: French13661436Gemma 4 31B
LMArena Text: Spanish13271442Gemma 4 31B
LMArena Text: Russian13381460Gemma 4 31B
LMArena Text: Polish13121433Gemma 4 31B
LMArena Text: multi-turn13201452Gemma 4 31B
LMArena Text: longer queries13181446Gemma 4 31B
LMArena Text: writing and language13171432Gemma 4 31B
LMArena Text: entertainment and media12961405Gemma 4 31B
LMArena Vision: EnglishNot measured1271Only Gemma 4 31B measured
LMArena Vision: ChineseNot measured1326Only Gemma 4 31B measured
LMArena Vision: reading textNot measured1282Only Gemma 4 31B measured
LMArena Vision: humorNot measured1280Only Gemma 4 31B measured
LMArena Vision: captioningNot measured1218Only Gemma 4 31B measured
LMArena Vision: recognizing thingsNot measured1226Only Gemma 4 31B measured
LMArena Vision: creative writingNot measured1285Only Gemma 4 31B measured
LMArena DocumentNot measured1425Only Gemma 4 31B measured
Neither model has a result on the other 13 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for Trinity Large Thinking and Gemma 4 31B
BenchmarkTrinity Large ThinkingGemma 4 31BLeader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

Trinity Large Thinking$0.0006Fits in one request
Gemma 4 31B$0.0004Fits in one request

Gemma 4 31B costs less

Repository review

50K input + 3K output tokens

Trinity Large Thinking$0.015Fits in one request
Gemma 4 31B$0.011Fits in one request

Gemma 4 31B costs less

Agent loop

200K input + 10K output tokens

Trinity Large Thinking$0.058Fits in one request
Gemma 4 31B$0.044Fits in one request

Gemma 4 31B costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of Trinity Large Thinking and Gemma 4 31B
SpecificationArcee AI Trinity Large ThinkingGoogle Gemma 4 31B
MakerArcee AIGoogle
WeightsOpen weightsOpen weights
ReleasedApril 1, 2026April 2, 2026
Context window262K262K
Input $/Mtok$0.25$0.20
Output $/Mtok$0.80$0.40
Coding index5.438.3
Independent measurements behind it12
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is Trinity Large Thinking better than Gemma 4 31B for coding?

Pick Gemma 4 31B for coding: it scores 38.3 on the Vibe Coding Index against 5.4 for Trinity Large Thinking. Pick Trinity Large Thinking when what matters is τ²-Bench Telecom or CaseLaw (Vals AI), where it leads.

Which is cheaper, Trinity Large Thinking or Gemma 4 31B?

Trinity Large Thinking costs $0.25 per million input tokens and $0.80 per million output tokens; Gemma 4 31B costs $0.20 and $0.40. Cost per solved task is known for neither of them.

Which has the bigger context window, Trinity Large Thinking or Gemma 4 31B?

Neither: both take 262K tokens.

How many benchmarks is the Trinity Large Thinking vs Gemma 4 31B comparison based on?

40 benchmarks have a result for both models as of October 21, 2026. Trinity Large Thinking's coding index rests on 1 independent benchmark and Gemma 4 31B's on 2. Where only one model has a result, the page says so instead of naming a winner.

Compare next