LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

GPT-6 Sol vs Solar Pro 4

Updated October 21, 2026. 43 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

GPT-6 SolOpenAI
Coding
82.8
Overall
47.6
Output $/M
$10.00
32
Solar Pro 4Upstage
Coding
24.4
Overall
28.2
Output $/M
$0.60
11
vs boards won of 43 shared

Decision reading

Pick GPT-6 Sol for coding: it scores 82.8 on the Vibe Coding Index against 24.4 for Solar Pro 4.

Pick Solar Pro 4 when output tokens cost 16.7x less, or when what matters is LMArena Text: hard prompts in English or LMArena Text: math, where it leads.

Shared results
43
GPT-6 Sol only
57
Solar Pro 4 only
2
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-6 Sol 82.8 from 2 benchmarks, Solar Pro 4 24.4 from 1 benchmark.
Widest category
Coding, 30.0 points apart on average over 7 shared benchmarks.
Widest single gap
ALE-Bench: GPT-6 Sol 2462.0 against Solar Pro 4 179.3, 76.1 points apart on a 0 to 100 scale.
Output price
GPT-6 Sol $10.00 against Solar Pro 4 $0.60 per million output tokens, 16.7x apart.
Context window
GPT-6 Sol takes 1.05M tokens, Solar Pro 4 524K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-6 SolBarsSolar Pro 4Ties
Coding70
Intelligence10
Agentic work10
Reasoning31
Math02
Knowledge13
Web design60
General135
All shared boards3211
CodingLike-for-likeFour of these boards feed the Vibe Coding Index70
Coding benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
LiveBench coding93.1%Not measuredOnly GPT-6 Sol measured
LMArena WebDev16831371GPT-6 Sol
AA Coding IndexNot measured52.7Only Solar Pro 4 measured
Terminal-Bench 4 (Vals AI)44.4%Not measuredOnly GPT-6 Sol measured
Vibe Code Bench (Vals AI)87.8%Not measuredOnly GPT-6 Sol measured
Code migration (Vals AI)57.2%Not measuredOnly GPT-6 Sol measured
ProgramBench (Vals AI)2.0%Not measuredOnly GPT-6 Sol measured
IOI (Vals AI)82.6%Not measuredOnly GPT-6 Sol measured
Terminal-Bench 2.1 (Vals AI)83.2%Not measuredOnly GPT-6 Sol measured
CyberBench (Vals AI)78.0%Not measuredOnly GPT-6 Sol measured
SciCode57.6%48.0%GPT-6 Sol
FrontierCode49.3%Not measuredOnly GPT-6 Sol measured
ALE-Bench2462.0179.3GPT-6 Sol
LMArena Text: coding14481438GPT-6 Sol
LMArena Text: software and IT14331431GPT-6 Sol
LMArena WebDev: React16851363GPT-6 Sol
LMArena WebDev: HTML16851371GPT-6 Sol
LMArena WebDev: from an image1660Not measuredOnly GPT-6 Sol measured
Neither model has a result on the other 20 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
AA Intelligence Index47.628.2GPT-6 Sol
Epoch Capabilities Index163.7Not measuredOnly GPT-6 Sol measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
Design Arena: agents building web apps12321105GPT-6 Sol
Design Arena: agents building full-stack apps1238Not measuredOnly GPT-6 Sol measured
Design Arena: agents building mobile apps1216Not measuredOnly GPT-6 Sol measured
LiveBench research69.3%Not measuredOnly GPT-6 Sol measured
LiveBench browser92.0%Not measuredOnly GPT-6 Sol measured
LiveBench long agentic66.9%Not measuredOnly GPT-6 Sol measured
SREBench (Vals AI)30.5%Not measuredOnly GPT-6 Sol measured
Finance Agent (Vals AI)49.0%Not measuredOnly GPT-6 Sol measured
Tax Agent Bench (Vals AI)15.0%Not measuredOnly GPT-6 Sol measured
Legal Research Bench (Vals AI)28.9%Not measuredOnly GPT-6 Sol measured
Excel Modeling Benchmark (Vals AI)71.5%Not measuredOnly GPT-6 Sol measured
BioMysteryBench (Vals AI)74.8%Not measuredOnly GPT-6 Sol measured
Terminal-Bench-Science (Vals AI)30.0%Not measuredOnly GPT-6 Sol measured
Vals Science Index45.0%Not measuredOnly GPT-6 Sol measured
APEX-Agents54.3%Not measuredOnly GPT-6 Sol measured
SpireClimb7.5%Not measuredOnly GPT-6 Sol measured
Vending-Bench 2$14,428Not measuredOnly GPT-6 Sol measured
Neither model has a result on the other 22 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index31
Reasoning benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
LiveBench reasoning88.7%Not measuredOnly GPT-6 Sol measured
MysteryMechanism (Vals AI)30.2%Not measuredOnly GPT-6 Sol measured
GPQA Diamond (Artificial Analysis run)Not measured89.1%Only Solar Pro 4 measured
Humanity's Last Exam (Artificial Analysis run)47.9%29.8%GPT-6 Sol
GPQA Diamond (Epoch AI run)94.3%Not measuredOnly GPT-6 Sol measured
ARC-AGI95.5%Not measuredOnly GPT-6 Sol measured
ARC-AGI-289.6%Not measuredOnly GPT-6 Sol measured
Chess puzzles56.0%Not measuredOnly GPT-6 Sol measured
Mystery game puzzles56.0%Not measuredOnly GPT-6 Sol measured
EBR-bench53.3%Not measuredOnly GPT-6 Sol measured
LMArena Text: hard prompts14221400GPT-6 Sol
LMArena Text: expert14371428GPT-6 Sol
LMArena Text: hard prompts in English14201427Solar Pro 4
LMArena Vision: diagrams1270Not measuredOnly GPT-6 Sol measured
LMArena Vision: homework1286Not measuredOnly GPT-6 Sol measured
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index02
Math benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
OTIS Mock AIME100.0%Not measuredOnly GPT-6 Sol measured
FrontierMath, tiers 1 to 389.8%Not measuredOnly GPT-6 Sol measured
FrontierMath, tier 490.0%Not measuredOnly GPT-6 Sol measured
ProofBench83.0%Not measuredOnly GPT-6 Sol measured
LMArena Text: math14071421Solar Pro 4
LMArena Text: mathematical work14241427Solar Pro 4
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index13
Knowledge benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
MedCode (Vals AI)47.1%Not measuredOnly GPT-6 Sol measured
SimpleQA Verified60.7%Not measuredOnly GPT-6 Sol measured
LMArena Text: science13891404Solar Pro 4
LMArena Text: medicine and healthcare13661374Solar Pro 4
LMArena Text: legal and government13961383GPT-6 Sol
LMArena Text: business and finance13801381Solar Pro 4
Neither model has a result on the other 11 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index60
Web design benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
Design Arena: websites12921176GPT-6 Sol
Design Arena: UI components12921150GPT-6 Sol
Design Arena: game dev13131170GPT-6 Sol
Design Arena: data viz12691177GPT-6 Sol
Design Arena: 3D13221178GPT-6 Sol
Design Arena: all code categories13011182GPT-6 Sol
Design Arena: SVG1318Not measuredOnly GPT-6 Sol measured
Design Arena: ASCII art1226Not measuredOnly GPT-6 Sol measured
LiveBench design82.2%Not measuredOnly GPT-6 Sol measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index135
General benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
LiveBench data analysis81.2%Not measuredOnly GPT-6 Sol measured
Public Benefits Bench (Vals AI)56.6%Not measuredOnly GPT-6 Sol measured
SAGE (Vals AI)44.8%Not measuredOnly GPT-6 Sol measured
MedScribe (Vals AI)82.0%Not measuredOnly GPT-6 Sol measured
Long context reasoning (AA-LCR)83.7%70.7%GPT-6 Sol
DTBench97.3%Not measuredOnly GPT-6 Sol measured
LMCA59.1%Not measuredOnly GPT-6 Sol measured
Furniture assembly58.3%Not measuredOnly GPT-6 Sol measured
LMArena Text13981388GPT-6 Sol
LMArena Text: instruction following14131375GPT-6 Sol
LMArena Text: creative writing13781317GPT-6 Sol
LMArena Vision1240Not measuredOnly GPT-6 Sol measured
LMArena Text: English13961414Solar Pro 4
LMArena Text: non-English13881363GPT-6 Sol
LMArena Text: Chinese14121422Solar Pro 4
LMArena Text: German13791358GPT-6 Sol
LMArena Text: Japanese13771320GPT-6 Sol
LMArena Text: Korean13361383Solar Pro 4
LMArena Text: French13991400Solar Pro 4
LMArena Text: Spanish13871409Solar Pro 4
LMArena Text: Russian14021357GPT-6 Sol
LMArena Text: Polish13721304GPT-6 Sol
LMArena Text: multi-turn14141385GPT-6 Sol
LMArena Text: longer queries14161382GPT-6 Sol
LMArena Text: writing and language13891344GPT-6 Sol
LMArena Text: entertainment and media13731332GPT-6 Sol
LMArena Vision: English1229Not measuredOnly GPT-6 Sol measured
LMArena Vision: reading text1258Not measuredOnly GPT-6 Sol measured
LMArena Vision: creative writing1219Not measuredOnly GPT-6 Sol measured
Neither model has a result on the other 17 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-6 Sol and Solar Pro 4
BenchmarkGPT-6 SolSolar Pro 4Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-6 Sol$0.0070Fits in one request
Solar Pro 4$0.0004Fits in one request

Solar Pro 4 costs less

Repository review

50K input + 3K output tokens

GPT-6 Sol$0.130Fits in one request
Solar Pro 4$0.0093Fits in one request

Solar Pro 4 costs less

Agent loop

200K input + 10K output tokens

GPT-6 Sol$0.500Fits in one request
Solar Pro 4$0.036Fits in one request

Solar Pro 4 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-6 Sol and Solar Pro 4
SpecificationOpenAI GPT-6 SolUpstage Solar Pro 4
MakerOpenAIUpstage
WeightsNo public weights listedNo public weights listed
ReleasedSeptember 22, 2026August 10, 2026
Context window1.05M524K
Input $/Mtok$2.00$0.15
Output $/Mtok$10.00$0.60
Coding index82.824.4
Independent measurements behind it21
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-6 Sol better than Solar Pro 4 for coding?

Pick GPT-6 Sol for coding: it scores 82.8 on the Vibe Coding Index against 24.4 for Solar Pro 4. Pick Solar Pro 4 when output tokens cost 16.7x less, or when what matters is LMArena Text: hard prompts in English or LMArena Text: math, where it leads.

Which is cheaper, GPT-6 Sol or Solar Pro 4?

GPT-6 Sol costs $2.00 per million input tokens and $10.00 per million output tokens; Solar Pro 4 costs $0.15 and $0.60. Cost per solved task is known for neither of them.

Which has the bigger context window, GPT-6 Sol or Solar Pro 4?

GPT-6 Sol, with 1.05M tokens against 524K.

How many benchmarks is the GPT-6 Sol vs Solar Pro 4 comparison based on?

43 benchmarks have a result for both models as of October 21, 2026. GPT-6 Sol's coding index rests on 2 independent benchmarks and Solar Pro 4's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next