LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

GPT-5 Nano vs Solar Pro 4

Updated October 21, 2026. 37 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

GPT-5 NanoOpenAI
Coding
34.8
Overall
13.0
Output $/M
$0.40
1
Solar Pro 4Upstage
Coding
24.4
Overall
28.2
Output $/M
$0.60
36
vs boards won of 37 shared

Decision reading

Pick GPT-5 Nano for coding: it scores 34.8 on the Vibe Coding Index against 24.4 for Solar Pro 4.

Pick Solar Pro 4 when the context window is larger, 524K against 400K tokens, or when what matters is LMArena Text: coding or LMArena Text: software and IT, where it leads.

Shared results
37
GPT-5 Nano only
48
Solar Pro 4 only
8
Like-for-like categories
7 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-5 Nano 34.8 from 1 benchmark, Solar Pro 4 24.4 from 1 benchmark.
Widest category
Reasoning, 17.2 points apart on average over 5 shared benchmarks.
Widest single gap
Design Arena: 3D: GPT-5 Nano 966 against Solar Pro 4 1178, 26.5 points apart on a 0 to 100 scale.
Output price
GPT-5 Nano $0.40 against Solar Pro 4 $0.60 per million output tokens, 1.5x apart.
Context window
GPT-5 Nano takes 400K tokens, Solar Pro 4 524K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-5 NanoBarsSolar Pro 4Ties
Coding02
Intelligence01
Reasoning05
Math02
Knowledge04
Web design06
General116
All shared boards136
CodingLike-for-likeFour of these boards feed the Vibe Coding Index02
Coding benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
SWE-bench Verified34.8%Not measuredOnly GPT-5 Nano measured
LMArena WebDevNot measured1371Only Solar Pro 4 measured
AA Coding IndexNot measured52.7Only Solar Pro 4 measured
LiveCodeBench (Vals AI)70.2%Not measuredOnly GPT-5 Nano measured
LiveCodeBench (Artificial Analysis run)78.9%Not measuredOnly GPT-5 Nano measured
SciCodeNot measured48.0%Only Solar Pro 4 measured
Terminal-Bench Hard (Artificial Analysis run)17.4%Not measuredOnly GPT-5 Nano measured
Terminal-Bench21.8%Not measuredOnly GPT-5 Nano measured
WeirdML38.1%Not measuredOnly GPT-5 Nano measured
ALE-BenchNot measured179.3Only Solar Pro 4 measured
LMArena Text: coding13511438Solar Pro 4
LMArena Text: software and IT13451431Solar Pro 4
LMArena WebDev: ReactNot measured1363Only Solar Pro 4 measured
LMArena WebDev: HTMLNot measured1371Only Solar Pro 4 measured
Neither model has a result on the other 24 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index01
Intelligence benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
AA Intelligence Index13.028.2Solar Pro 4
Epoch Capabilities Index139.2Not measuredOnly GPT-5 Nano measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index2 boards, none shared
Agentic work benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
Design Arena: agents building web appsNot measured1105Only Solar Pro 4 measured
τ²-Bench Telecom36.5%Not measuredOnly GPT-5 Nano measured
Neither model has a result on the other 37 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index05
Reasoning benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
GPQA Diamond63.4%Not measuredOnly GPT-5 Nano measured
MMMU Pro (Vals AI)70.9%Not measuredOnly GPT-5 Nano measured
GPQA Diamond (Artificial Analysis run)67.6%89.1%Solar Pro 4
Humanity's Last Exam (Artificial Analysis run)9.5%29.8%Solar Pro 4
GPQA Diamond (Epoch AI run)69.4%Not measuredOnly GPT-5 Nano measured
ARC-AGI20.7%Not measuredOnly GPT-5 Nano measured
ARC-AGI-22.6%Not measuredOnly GPT-5 Nano measured
Chess puzzles22.0%Not measuredOnly GPT-5 Nano measured
Mystery game puzzles9.0%Not measuredOnly GPT-5 Nano measured
VPCT37.2%Not measuredOnly GPT-5 Nano measured
LMArena Text: hard prompts13281400Solar Pro 4
LMArena Text: expert13211428Solar Pro 4
LMArena Text: hard prompts in English13381427Solar Pro 4
LMArena Vision: diagrams1141Not measuredOnly GPT-5 Nano measured
LMArena Vision: homework1157Not measuredOnly GPT-5 Nano measured
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
AIME81.2%Not measuredOnly GPT-5 Nano measured
MATH 500 (Vals AI)93.8%Not measuredOnly GPT-5 Nano measured
MGSM (Vals AI)89.3%Not measuredOnly GPT-5 Nano measured
AA Math Index83.7Not measuredOnly GPT-5 Nano measured
AIME 2025 (Artificial Analysis run)83.7%Not measuredOnly GPT-5 Nano measured
OTIS Mock AIME81.1%Not measuredOnly GPT-5 Nano measured
FrontierMath, tiers 1 to 320.0%Not measuredOnly GPT-5 Nano measured
FrontierMath, tier 42.4%Not measuredOnly GPT-5 Nano measured
ProofBench12.0%Not measuredOnly GPT-5 Nano measured
MATH level 595.2%Not measuredOnly GPT-5 Nano measured
LMArena Text: math13171421Solar Pro 4
LMArena Text: mathematical work13261427Solar Pro 4
Neither model has a result on the other 1 board here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index04
Knowledge benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
MMLU Pro76.1%Not measuredOnly GPT-5 Nano measured
LegalBench (Vals AI)50.1%Not measuredOnly GPT-5 Nano measured
CaseLaw (Vals AI)52.6%Not measuredOnly GPT-5 Nano measured
TaxEval (Vals AI)67.4%Not measuredOnly GPT-5 Nano measured
MortgageTax (Vals AI)53.6%Not measuredOnly GPT-5 Nano measured
MedQA (Vals AI)93.3%Not measuredOnly GPT-5 Nano measured
MedCode (Vals AI)30.4%Not measuredOnly GPT-5 Nano measured
MMLU Pro (Artificial Analysis run)78.0%Not measuredOnly GPT-5 Nano measured
SimpleQA Verified11.7%Not measuredOnly GPT-5 Nano measured
LMArena Text: science13181404Solar Pro 4
LMArena Text: medicine and healthcare13351374Solar Pro 4
LMArena Text: legal and government12981383Solar Pro 4
LMArena Text: business and finance13111381Solar Pro 4
Neither model has a result on the other 4 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index06
Web design benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
Design Arena: websites11011176Solar Pro 4
Design Arena: UI components10661150Solar Pro 4
Design Arena: game dev10451170Solar Pro 4
Design Arena: data viz10561177Solar Pro 4
Design Arena: 3D9661178Solar Pro 4
Design Arena: all code categories10841182Solar Pro 4
Neither model has a result on the other 3 boards here
GeneralLike-for-likePublic boards, shown as published, kept out of the index116
General benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
SAGE (Vals AI)30.4%Not measuredOnly GPT-5 Nano measured
MedScribe (Vals AI)72.9%Not measuredOnly GPT-5 Nano measured
IFBench67.6%Not measuredOnly GPT-5 Nano measured
Long context reasoning (AA-LCR)45.0%70.7%Solar Pro 4
DTBench62.7%Not measuredOnly GPT-5 Nano measured
LMCA7.9%Not measuredOnly GPT-5 Nano measured
Fiction.LiveBench44.4%Not measuredOnly GPT-5 Nano measured
LMArena Text13201388Solar Pro 4
LMArena Text: instruction following13061375Solar Pro 4
LMArena Text: creative writing12491317Solar Pro 4
LMArena Vision1159Not measuredOnly GPT-5 Nano measured
LMArena Text: English13211414Solar Pro 4
LMArena Text: non-English13131363Solar Pro 4
LMArena Text: Chinese13561422Solar Pro 4
LMArena Text: German13271358Solar Pro 4
LMArena Text: Japanese12271320Solar Pro 4
LMArena Text: Korean12691383Solar Pro 4
LMArena Text: FrenchNot measured1400Only Solar Pro 4 measured
LMArena Text: Spanish13601409Solar Pro 4
LMArena Text: Russian12961357Solar Pro 4
LMArena Text: Polish13141304GPT-5 Nano
LMArena Text: multi-turn13111385Solar Pro 4
LMArena Text: longer queries13121382Solar Pro 4
LMArena Text: writing and language12831344Solar Pro 4
LMArena Text: entertainment and media12681332Solar Pro 4
LMArena Vision: English1170Not measuredOnly GPT-5 Nano measured
LMArena Vision: Chinese1176Not measuredOnly GPT-5 Nano measured
LMArena Vision: reading text1152Not measuredOnly GPT-5 Nano measured
LMArena Vision: humor1110Not measuredOnly GPT-5 Nano measured
Neither model has a result on the other 17 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-5 Nano and Solar Pro 4
BenchmarkGPT-5 NanoSolar Pro 4Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-5 Nano$0.0003Fits in one request
Solar Pro 4$0.0004Fits in one request

GPT-5 Nano costs less

Repository review

50K input + 3K output tokens

GPT-5 Nano$0.0037Fits in one request
Solar Pro 4$0.0093Fits in one request

GPT-5 Nano costs less

Agent loop

200K input + 10K output tokens

GPT-5 Nano$0.014Fits in one request
Solar Pro 4$0.036Fits in one request

GPT-5 Nano costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-5 Nano and Solar Pro 4
SpecificationOpenAI GPT-5 NanoUpstage Solar Pro 4
MakerOpenAIUpstage
WeightsNo public weights listedNo public weights listed
ReleasedAugust 7, 2025August 10, 2026
Context window400K524K
Input $/Mtok$0.05$0.15
Output $/Mtok$0.40$0.60
Coding index34.824.4
Independent measurements behind it11
Cost per solved task$0.109Not computable
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-5 Nano better than Solar Pro 4 for coding?

Pick GPT-5 Nano for coding: it scores 34.8 on the Vibe Coding Index against 24.4 for Solar Pro 4. Pick Solar Pro 4 when the context window is larger, 524K against 400K tokens, or when what matters is LMArena Text: coding or LMArena Text: software and IT, where it leads.

Which is cheaper, GPT-5 Nano or Solar Pro 4?

GPT-5 Nano costs $0.05 per million input tokens and $0.40 per million output tokens; Solar Pro 4 costs $0.15 and $0.60. Cost per solved task is known for GPT-5 Nano only.

Which has the bigger context window, GPT-5 Nano or Solar Pro 4?

Solar Pro 4, with 524K tokens against 400K.

How many benchmarks is the GPT-5 Nano vs Solar Pro 4 comparison based on?

37 benchmarks have a result for both models as of October 21, 2026. GPT-5 Nano's coding index rests on 1 independent benchmark and Solar Pro 4's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next