LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

GPT-6 Astra vs Solar Pro 4

Updated October 21, 2026. 45 benchmarks have a result for both. Coding is ranked on the Vibe Coding Index; every other board is shown as published.

GPT-6 AstraOpenAI
Coding
88.7
Overall
52.7
Output $/M
$50.00
45
Solar Pro 4Upstage
Coding
24.4
Overall
28.2
Output $/M
$0.60
0
vs boards won of 45 shared

Decision reading

Pick GPT-6 Astra for coding: it scores 88.7 on the Vibe Coding Index against 24.4 for Solar Pro 4.

Pick Solar Pro 4 when output tokens cost 83.3x less.

Shared results
45
GPT-6 Astra only
74
Solar Pro 4 only
0
Like-for-like categories
8 of 9

Shared results can support a head-to-head reading. Results only one model has describe coverage, not superiority.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
GPT-6 Astra 88.7 from 2 benchmarks, Solar Pro 4 24.4 from 1 benchmark.
Widest category
Coding, 34.5 points apart on average over 8 shared benchmarks.
Widest single gap
ALE-Bench: GPT-6 Astra 2951.3 against Solar Pro 4 179.3, 92.4 points apart on a 0 to 100 scale.
Output price
GPT-6 Astra $50.00 against Solar Pro 4 $0.60 per million output tokens, 83.3x apart.
Context window
GPT-6 Astra takes 1.05M tokens, Solar Pro 4 524K.

Benchmark by benchmark

First the score: boards each model leads, per category, where both have a result. Then every board, a category to a fold; bars are each result on a 0 to 100 scale, so compare the two in a row, not one row with another.

Boards won, where both have a result
CategoryGPT-6 AstraBarsSolar Pro 4Ties
Coding80
Intelligence10
Agentic work10
Reasoning50
Math20
Knowledge40
Web design60
General180
All shared boards450
CodingLike-for-likeFour of these boards feed the Vibe Coding Index80
Coding benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
LiveBench coding93.7%Not measuredOnly GPT-6 Astra measured
LMArena WebDev17741371GPT-6 Astra
AA Coding Index76.952.7GPT-6 Astra
Terminal-Bench 4 (Vals AI)59.6%Not measuredOnly GPT-6 Astra measured
Vibe Code Bench (Vals AI)89.6%Not measuredOnly GPT-6 Astra measured
Code migration (Vals AI)67.7%Not measuredOnly GPT-6 Astra measured
ProgramBench (Vals AI)5.5%Not measuredOnly GPT-6 Astra measured
IOI (Vals AI)100.0%Not measuredOnly GPT-6 Astra measured
Terminal-Bench 2.1 (Vals AI)87.3%Not measuredOnly GPT-6 Astra measured
SWE-bench Multimodal (Vals AI)43.3%Not measuredOnly GPT-6 Astra measured
Vibe Code Bench 1-100 (Vals AI)27.6%Not measuredOnly GPT-6 Astra measured
CyberBench (Vals AI)41.1%Not measuredOnly GPT-6 Astra measured
SciCode56.5%48.0%GPT-6 Astra
FrontierCode53.3%Not measuredOnly GPT-6 Astra measured
FrontierSWE65.5%Not measuredOnly GPT-6 Astra measured
GSO-Bench79.4%Not measuredOnly GPT-6 Astra measured
WeirdML93.3%Not measuredOnly GPT-6 Astra measured
MirrorCode46.7%Not measuredOnly GPT-6 Astra measured
ALE-Bench2951.3179.3GPT-6 Astra
LMArena Text: coding14891438GPT-6 Astra
LMArena Text: software and IT14741431GPT-6 Astra
LMArena WebDev: React17981363GPT-6 Astra
LMArena WebDev: HTML17751371GPT-6 Astra
LMArena WebDev: from an image1726Not measuredOnly GPT-6 Astra measured
Neither model has a result on the other 14 boards here
IntelligenceLike-for-likePublic boards, shown as published, kept out of the index10
Intelligence benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
AA Intelligence Index52.728.2GPT-6 Astra
Epoch Capabilities Index168.8Not measuredOnly GPT-6 Astra measured
Agentic workLike-for-likePublic boards, shown as published, kept out of the index10
Agentic work benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
AA Agentic Index51.0Not measuredOnly GPT-6 Astra measured
Design Arena: agents building web apps13721105GPT-6 Astra
Design Arena: agents building full-stack apps1357Not measuredOnly GPT-6 Astra measured
Design Arena: agents building mobile apps1312Not measuredOnly GPT-6 Astra measured
Design Arena: agents building Godot games1348Not measuredOnly GPT-6 Astra measured
Design Arena: PowerPoint slides1245Not measuredOnly GPT-6 Astra measured
Design Arena: spreadsheets1380Not measuredOnly GPT-6 Astra measured
LiveBench research85.2%Not measuredOnly GPT-6 Astra measured
LiveBench browser84.0%Not measuredOnly GPT-6 Astra measured
LiveBench long agentic82.4%Not measuredOnly GPT-6 Astra measured
SREBench (Vals AI)56.9%Not measuredOnly GPT-6 Astra measured
Finance Agent (Vals AI)53.5%Not measuredOnly GPT-6 Astra measured
Tax Agent Bench (Vals AI)20.7%Not measuredOnly GPT-6 Astra measured
Legal Research Bench (Vals AI)39.4%Not measuredOnly GPT-6 Astra measured
Harvey's Legal Agent Benchmark (Vals AI)7.1%Not measuredOnly GPT-6 Astra measured
Excel Modeling Benchmark (Vals AI)71.7%Not measuredOnly GPT-6 Astra measured
BioMysteryBench (Vals AI)79.3%Not measuredOnly GPT-6 Astra measured
Terminal-Bench-Science (Vals AI)62.9%Not measuredOnly GPT-6 Astra measured
Vals Science Index65.1%Not measuredOnly GPT-6 Astra measured
Time Horizon Index (Vals AI)90.5%Not measuredOnly GPT-6 Astra measured
CUA-bench (Vals AI)19.2%Not measuredOnly GPT-6 Astra measured
Robo-bench (Vals AI)23.3%Not measuredOnly GPT-6 Astra measured
APEX-Agents64.7%Not measuredOnly GPT-6 Astra measured
Remote Labor Index20.8%Not measuredOnly GPT-6 Astra measured
BALROG68.3%Not measuredOnly GPT-6 Astra measured
SpireClimb25.7%Not measuredOnly GPT-6 Astra measured
Vending-Bench 2$15,515Not measuredOnly GPT-6 Astra measured
Neither model has a result on the other 12 boards here
ReasoningLike-for-likePublic boards, shown as published, kept out of the index50
Reasoning benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
LiveBench reasoning92.7%Not measuredOnly GPT-6 Astra measured
MysteryMechanism (Vals AI)53.1%Not measuredOnly GPT-6 Astra measured
GPQA Diamond (Artificial Analysis run)96.3%89.1%GPT-6 Astra
Humanity's Last Exam (Artificial Analysis run)54.7%29.8%GPT-6 Astra
GPQA Diamond (Epoch AI run)95.8%Not measuredOnly GPT-6 Astra measured
ARC-AGI98.5%Not measuredOnly GPT-6 Astra measured
ARC-AGI-295.0%Not measuredOnly GPT-6 Astra measured
Chess puzzles74.0%Not measuredOnly GPT-6 Astra measured
Mystery game puzzles84.0%Not measuredOnly GPT-6 Astra measured
EBR-bench76.2%Not measuredOnly GPT-6 Astra measured
LMArena Text: hard prompts14631400GPT-6 Astra
LMArena Text: expert14891428GPT-6 Astra
LMArena Text: hard prompts in English14641427GPT-6 Astra
LMArena Vision: diagrams1297Not measuredOnly GPT-6 Astra measured
LMArena Vision: homework1337Not measuredOnly GPT-6 Astra measured
Neither model has a result on the other 6 boards here
MathLike-for-likePublic boards, shown as published, kept out of the index20
Math benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
OTIS Mock AIME100.0%Not measuredOnly GPT-6 Astra measured
FrontierMath, tiers 1 to 393.7%Not measuredOnly GPT-6 Astra measured
FrontierMath, tier 497.6%Not measuredOnly GPT-6 Astra measured
ProofBench99.0%Not measuredOnly GPT-6 Astra measured
LMArena Text: math14651421GPT-6 Astra
LMArena Text: mathematical work14841427GPT-6 Astra
Neither model has a result on the other 7 boards here
KnowledgeLike-for-likePublic boards, shown as published, kept out of the index40
Knowledge benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
MedCode (Vals AI)48.5%Not measuredOnly GPT-6 Astra measured
SimpleQA Verified75.6%Not measuredOnly GPT-6 Astra measured
LMArena Text: science14511404GPT-6 Astra
LMArena Text: medicine and healthcare14251374GPT-6 Astra
LMArena Text: legal and government14621383GPT-6 Astra
LMArena Text: business and finance14391381GPT-6 Astra
Neither model has a result on the other 11 boards here
Web designLike-for-likePublic boards, shown as published, kept out of the index60
Web design benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
Design Arena: websites13371176GPT-6 Astra
Design Arena: UI components13941150GPT-6 Astra
Design Arena: game dev14741170GPT-6 Astra
Design Arena: data viz13351177GPT-6 Astra
Design Arena: 3D15011178GPT-6 Astra
Design Arena: all code categories13791182GPT-6 Astra
Design Arena: SVG1431Not measuredOnly GPT-6 Astra measured
Design Arena: ASCII art1359Not measuredOnly GPT-6 Astra measured
LiveBench design82.0%Not measuredOnly GPT-6 Astra measured
GeneralLike-for-likePublic boards, shown as published, kept out of the index180
General benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
Vals Index65.0%Not measuredOnly GPT-6 Astra measured
LiveBench data analysis83.0%Not measuredOnly GPT-6 Astra measured
SAGE (Vals AI)46.4%Not measuredOnly GPT-6 Astra measured
MedScribe (Vals AI)87.9%Not measuredOnly GPT-6 Astra measured
Long context reasoning (AA-LCR)80.7%70.7%GPT-6 Astra
DTBench97.3%Not measuredOnly GPT-6 Astra measured
LMCA64.4%Not measuredOnly GPT-6 Astra measured
Furniture assembly80.0%Not measuredOnly GPT-6 Astra measured
LMArena Text14411388GPT-6 Astra
LMArena Text: instruction following14551375GPT-6 Astra
LMArena Text: creative writing14201317GPT-6 Astra
LMArena Vision1280Not measuredOnly GPT-6 Astra measured
LMArena Text: English14471414GPT-6 Astra
LMArena Text: non-English14321363GPT-6 Astra
LMArena Text: Chinese14891422GPT-6 Astra
LMArena Text: German14591358GPT-6 Astra
LMArena Text: Japanese14051320GPT-6 Astra
LMArena Text: Korean14281383GPT-6 Astra
LMArena Text: French14321400GPT-6 Astra
LMArena Text: Spanish14221409GPT-6 Astra
LMArena Text: Russian14381357GPT-6 Astra
LMArena Text: Polish14221304GPT-6 Astra
LMArena Text: multi-turn14471385GPT-6 Astra
LMArena Text: longer queries14601382GPT-6 Astra
LMArena Text: writing and language14371344GPT-6 Astra
LMArena Text: entertainment and media14271332GPT-6 Astra
LMArena Vision: English1280Not measuredOnly GPT-6 Astra measured
LMArena Vision: Chinese1361Not measuredOnly GPT-6 Astra measured
LMArena Vision: reading text1292Not measuredOnly GPT-6 Astra measured
LMArena Vision: creative writing1286Not measuredOnly GPT-6 Astra measured
Neither model has a result on the other 16 boards here
Image generationNot comparablePublic boards, shown as published, kept out of the index0 boards, none shared
Image generation benchmarks for GPT-6 Astra and Solar Pro 4
BenchmarkGPT-6 AstraSolar Pro 4Leader
Neither model has a result on 5 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

GPT-6 Astra$0.035Fits in one request
Solar Pro 4$0.0004Fits in one request

Solar Pro 4 costs less

Repository review

50K input + 3K output tokens

GPT-6 Astra$0.650Fits in one request
Solar Pro 4$0.0093Fits in one request

Solar Pro 4 costs less

Agent loop

200K input + 10K output tokens

GPT-6 Astra$2.50Fits in one request
Solar Pro 4$0.036Fits in one request

Solar Pro 4 costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of GPT-6 Astra and Solar Pro 4
SpecificationOpenAI GPT-6 AstraUpstage Solar Pro 4
MakerOpenAIUpstage
WeightsNo public weights listedNo public weights listed
ReleasedSeptember 4, 2026August 10, 2026
Context window1.05M524K
Input $/Mtok$10.00$0.15
Output $/Mtok$50.00$0.60
Coding index88.724.4
Independent measurements behind it21
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is GPT-6 Astra better than Solar Pro 4 for coding?

Pick GPT-6 Astra for coding: it scores 88.7 on the Vibe Coding Index against 24.4 for Solar Pro 4. Pick Solar Pro 4 when output tokens cost 83.3x less.

Which is cheaper, GPT-6 Astra or Solar Pro 4?

GPT-6 Astra costs $10.00 per million input tokens and $50.00 per million output tokens; Solar Pro 4 costs $0.15 and $0.60. Cost per solved task is known for neither of them.

Which has the bigger context window, GPT-6 Astra or Solar Pro 4?

GPT-6 Astra, with 1.05M tokens against 524K.

How many benchmarks is the GPT-6 Astra vs Solar Pro 4 comparison based on?

45 benchmarks have a result for both models as of October 21, 2026. GPT-6 Astra's coding index rests on 2 independent benchmarks and Solar Pro 4's on 1. Where only one model has a result, the page says so instead of naming a winner.

Compare next