LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

OpenAI GPT-6 Sol

  • OpenAI
  • Released September 22, 2026
  • No public weights listed
  • 1.05M context

As of October 20, 2026, OpenAI GPT-6 Sol ranks #10 of 213 models overall with 47.6 on the Artificial Analysis Intelligence Index. Its strongest category is math, where it ranks #1 of 116. OpenAI GPT-6 Sol costs $2.00 per million input tokens and $10.00 per million output tokens. It was released on September 22, 2026.

Its output price ranks 282 of 349 priced models, counting from the cheapest.

  • Coding index 82.8 Partial, 2 benchmarks
  • Cost per solved task Not computable No published attempt cost
  • Output, per million tokens $10.00 282 of 349 from the cheapest
  • Input, per million tokens $2.00 OpenRouter list price
  • Context window 1.05M Tokens per request
New model

GPT-6 Sol launch tracker

Listed on OpenRouter September 22, 2026, 28 days before our data. Results so far on 72 of 190 public boards; this page updates every day as boards publish.

About and specs

GPT-6 Sol is the cost-efficient high-end model in OpenAI's GPT-6 series, positioned below the flagship GPT-6 Astra and above the fast GPT-6 Luna tier. It is suited for demanding professional...

API model id openai/gpt-6-sol
  • Tool callingListed
  • Structured outputsListed
  • JSON modeListed
  • Reasoning modeListed
  • Web searchNot listed
Takes in
Files, Images, Text
Gives back
Text
Context window
1.05M tokens
Max output
128K tokens
Knowledge cutoff
April 20, 2026, per OpenAI model documentation
Cached input $/Mtok
$0.20
Cache write $/Mtok
$2.50
Reasoning $/Mtok
Not priced apart
Web search, per request
$0.01
Tokenizer
GPT
Requests moderated
Yes, by the provider
Withdrawn on
No date announced
Parameters
Not published
Downloads, all time
No public weights
Training compute
No estimate published
Output speed
Not measured
Time to first token
Not measured
Speed on OpenRouter
56 tokens/s via OpenAI, 30-minute median
First token on OpenRouter
2.1 s via OpenAI, 30-minute median

Benchmarks: 72 of 190 measured

The tick on a coding bar is the median of every model measured on it. Outside coding, the place is this model's rank on that board. A board that never ran the model says so.

Coding index

82.8
  • Aider polyglot Not measured
  • SWE-bench Verified Not measured
  • LiveBench coding 93.1% 93 of 100
  • LMArena WebDev Elo, scaled from 1200 to 1900 1683 Elo 69 of 100

The index averages only the coding benchmarks that have a result; the others are skipped, never filled in. How it is weighted

Other public boards

All rankings

Best placings

  1. OTIS Mock AIME1#1 of 116
  2. Vending-Bench 22#2 of 60
  3. ALE-Bench3#3 of 104
  4. Design Arena: SVG3#3 of 87

Lowest placings

  1. Public Benefits Bench (Vals AI)#38 of 46
  2. LMArena Vision: creative writing#52 of 70
  3. Tax Agent Bench (Vals AI)#50 of 68

Coding13 of 34 boards

7 more coding boards

Not measured on SWE-bench Lite, SWE-bench (full test set), SWE-bench Multimodal, SWE-bench Multilingual, AA Coding Index, LiveCodeBench (Vals AI), SWE-bench Verified (Vals AI), SWE-bench Multimodal (Vals AI), Vibe Code Bench 1-100 (Vals AI), SkillsBench (Vals AI), LiveCodeBench (Artificial Analysis run), Terminal-Bench Hard (Artificial Analysis run), Terminal-Bench, DeepSWE, FrontierSWE, GSO-Bench, WeirdML, MirrorCode, Cybench, LMArena Text: coding, LMArena Text: software and IT

Intelligence2 of 2 boards

Agentic work17 of 39 boards

11 more agentic work boards

Not measured on AA Agentic Index, Design Arena: agents building Android apps, Design Arena: agents building Godot games, Design Arena: agents building games, Design Arena: HTML slides, Design Arena: PowerPoint slides, Design Arena: spreadsheets, Harvey's Legal Agent Benchmark (Vals AI), Time Horizon Index (Vals AI), CUA-bench (Vals AI), Robo-bench (Vals AI), τ²-Bench Telecom, METR time horizons, Remote Labor Index, GDPval, OSWorld 2.0, BALROG, DeepResearch Bench, PostTrainBench, TheAgentCompany, OSWorld, LMArena Search

Reasoning11 of 21 boards

5 more reasoning boards

Not measured on GPQA Diamond, MMMU Pro (Vals AI), GPQA Diamond (Artificial Analysis run), Humanity's Last Exam, SimpleBench, VPCT, BIG-Bench Hard, LMArena Text: hard prompts, LMArena Text: expert, LMArena Text: hard prompts in English

Math4 of 13 boards

Not measured on AIME, MATH 500 (Vals AI), MGSM (Vals AI), AA Math Index, AIME 2025 (Artificial Analysis run), MATH level 5, GSM8K, LMArena Text: math, LMArena Text: mathematical work

Knowledge2 of 17 boards

Not measured on MMLU Pro, LegalBench (Vals AI), CaseLaw (Vals AI), CorpFin (Vals AI), TaxEval (Vals AI), MortgageTax (Vals AI), MedQA (Vals AI), MMLU Pro (Artificial Analysis run), MMLU, GeoBench, AI2 Reasoning Challenge, LMArena Text: science, LMArena Text: medicine and healthcare, LMArena Text: legal and government, LMArena Text: business and finance

Web design9 of 9 boards

3 more web design boards

General12 of 46 boards

6 more general boards

Not measured on Vals Index, Vals Multimodal Index, IFBench, Fiction.LiveBench, Creative writing (Lech Mazur), CL-bench, Surface Evolver Bench, ExploitBench, HellaSwag, WinoGrande, PIQA, CL-bench Life, LMArena Text, LMArena Text: instruction following, LMArena Text: creative writing, LMArena Text: English, LMArena Text: non-English, LMArena Text: Chinese, LMArena Text: German, LMArena Text: Japanese, LMArena Text: Korean, LMArena Text: French, LMArena Text: Spanish, LMArena Text: Russian, LMArena Text: Polish, LMArena Text: multi-turn, LMArena Text: longer queries, LMArena Text: writing and language, LMArena Text: entertainment and media, LMArena Vision: Chinese, LMArena Vision: humor, LMArena Vision: captioning, LMArena Vision: recognizing things, LMArena Document

Image generation0 of 5 boards

Not measured on Design Arena: images, Design Arena: graphic design, Design Arena: logos, LMArena Text to Image, LMArena Image Edit

Public boards shown as published (Vals AI, Artificial Analysis, Design Arena) and kept out of the coding index. Each links to its source on the benchmark page.

All 190 benchmarks as a table
Benchmark results for OpenAI GPT-6 Sol
BenchmarkResultIndex weight
Aider polyglotCoding Not measured 35%
SWE-bench VerifiedCoding Not measured 30%
SWE-bench LiteCoding Not measured Not in index
SWE-bench (full test set)Coding Not measured Not in index
SWE-bench MultimodalCoding Not measured Not in index
SWE-bench MultilingualCoding Not measured Not in index
LiveBench codingCoding 93.1% 20%
LMArena WebDevCoding 1683 15%
Vals IndexGeneral Not measured Not in index
GPQA DiamondReasoning Not measured Not in index
AIMEMath Not measured Not in index
MMLU ProKnowledge Not measured Not in index
AA Intelligence IndexIntelligence 47.6 Not in index
AA Coding IndexCoding Not measured Not in index
AA Agentic IndexAgentic work Not measured Not in index
Design Arena: websitesWeb design 1292 Not in index
Design Arena: UI componentsWeb design 1291 Not in index
Design Arena: game devWeb design 1310 Not in index
Design Arena: data vizWeb design 1271 Not in index
Design Arena: 3DWeb design 1321 Not in index
Design Arena: all code categoriesWeb design 1300 Not in index
Design Arena: SVGWeb design 1323 Not in index
Design Arena: ASCII artWeb design 1223 Not in index
Design Arena: agents building web appsAgentic work 1226 Not in index
Design Arena: agents building full-stack appsAgentic work 1238 Not in index
Design Arena: agents building mobile appsAgentic work 1233 Not in index
Design Arena: agents building Android appsAgentic work Not measured Not in index
Design Arena: agents building Godot gamesAgentic work Not measured Not in index
Design Arena: agents building gamesAgentic work Not measured Not in index
Design Arena: HTML slidesAgentic work Not measured Not in index
Design Arena: PowerPoint slidesAgentic work Not measured Not in index
Design Arena: spreadsheetsAgentic work Not measured Not in index
Design Arena: imagesImage generation Not measured Not in index
Design Arena: graphic designImage generation Not measured Not in index
Design Arena: logosImage generation Not measured Not in index
LiveBench reasoningReasoning 88.7% Not in index
LiveBench data analysisGeneral 81.2% Not in index
LiveBench researchAgentic work 69.3% Not in index
LiveBench browserAgentic work 92.0% Not in index
LiveBench long agenticAgentic work 66.9% Not in index
LiveBench designWeb design 82.2% Not in index
LiveCodeBench (Vals AI)Coding Not measured Not in index
SWE-bench Verified (Vals AI)Coding Not measured Not in index
Terminal-Bench 4 (Vals AI)Coding 44.4% Not in index
Vibe Code Bench (Vals AI)Coding 87.8% Not in index
Code migration (Vals AI)Coding 57.2% Not in index
ProgramBench (Vals AI)Coding 2.0% Not in index
SREBench (Vals AI)Agentic work 30.5% Not in index
IOI (Vals AI)Coding 82.6% Not in index
Terminal-Bench 2.1 (Vals AI)Coding 83.2% Not in index
SWE-bench Multimodal (Vals AI)Coding Not measured Not in index
Vibe Code Bench 1-100 (Vals AI)Coding Not measured Not in index
SkillsBench (Vals AI)Coding Not measured Not in index
CyberBench (Vals AI)Coding 78.0% Not in index
Finance Agent (Vals AI)Agentic work 49.0% Not in index
Tax Agent Bench (Vals AI)Agentic work 15.0% Not in index
Legal Research Bench (Vals AI)Agentic work 28.9% Not in index
Harvey's Legal Agent Benchmark (Vals AI)Agentic work Not measured Not in index
Excel Modeling Benchmark (Vals AI)Agentic work 71.5% Not in index
BioMysteryBench (Vals AI)Agentic work 74.8% Not in index
Terminal-Bench-Science (Vals AI)Agentic work 30.0% Not in index
Vals Science IndexAgentic work 45.0% Not in index
Time Horizon Index (Vals AI)Agentic work Not measured Not in index
CUA-bench (Vals AI)Agentic work Not measured Not in index
Robo-bench (Vals AI)Agentic work Not measured Not in index
Public Benefits Bench (Vals AI)General 56.6% Not in index
MysteryMechanism (Vals AI)Reasoning 30.2% Not in index
MMMU Pro (Vals AI)Reasoning Not measured Not in index
MATH 500 (Vals AI)Math Not measured Not in index
MGSM (Vals AI)Math Not measured Not in index
SAGE (Vals AI)General 44.8% Not in index
LegalBench (Vals AI)Knowledge Not measured Not in index
CaseLaw (Vals AI)Knowledge Not measured Not in index
CorpFin (Vals AI)Knowledge Not measured Not in index
TaxEval (Vals AI)Knowledge Not measured Not in index
MortgageTax (Vals AI)Knowledge Not measured Not in index
MedQA (Vals AI)Knowledge Not measured Not in index
MedCode (Vals AI)Knowledge 47.1% Not in index
MedScribe (Vals AI)General 82.0% Not in index
Vals Multimodal IndexGeneral Not measured Not in index
AA Math IndexMath Not measured Not in index
GPQA Diamond (Artificial Analysis run)Reasoning Not measured Not in index
Humanity's Last Exam (Artificial Analysis run)Reasoning 47.9% Not in index
MMLU Pro (Artificial Analysis run)Knowledge Not measured Not in index
LiveCodeBench (Artificial Analysis run)Coding Not measured Not in index
SciCodeCoding 57.6% Not in index
Terminal-Bench Hard (Artificial Analysis run)Coding Not measured Not in index
IFBenchGeneral Not measured Not in index
Long context reasoning (AA-LCR)General 83.7% Not in index
τ²-Bench TelecomAgentic work Not measured Not in index
AIME 2025 (Artificial Analysis run)Math Not measured Not in index
Terminal-BenchCoding Not measured Not in index
DeepSWECoding Not measured Not in index
FrontierCodeCoding 49.3% Not in index
FrontierSWECoding Not measured Not in index
GSO-BenchCoding Not measured Not in index
WeirdMLCoding Not measured Not in index
MirrorCodeCoding Not measured Not in index
APEX-AgentsAgentic work 54.3% Not in index
METR time horizonsAgentic work Not measured Not in index
Remote Labor IndexAgentic work Not measured Not in index
GDPvalAgentic work Not measured Not in index
OSWorld 2.0Agentic work Not measured Not in index
BALROGAgentic work Not measured Not in index
DeepResearch BenchAgentic work Not measured Not in index
PostTrainBenchAgentic work Not measured Not in index
GPQA Diamond (Epoch AI run)Reasoning 94.3% Not in index
ARC-AGIReasoning 95.5% Not in index
ARC-AGI-2Reasoning 89.6% Not in index
Humanity's Last ExamReasoning Not measured Not in index
SimpleBenchReasoning Not measured Not in index
Chess puzzlesReasoning 56.0% Not in index
Mystery game puzzlesReasoning 56.0% Not in index
EBR-benchReasoning 53.3% Not in index
OTIS Mock AIMEMath 100.0% Not in index
FrontierMath, tiers 1 to 3Math 89.8% Not in index
FrontierMath, tier 4Math 90.0% Not in index
ProofBenchMath 83.0% Not in index
MATH level 5Math Not measured Not in index
GSM8KMath Not measured Not in index
SimpleQA VerifiedKnowledge 60.7% Not in index
MMLUKnowledge Not measured Not in index
GeoBenchKnowledge Not measured Not in index
DTBenchGeneral 97.3% Not in index
LMCAGeneral 59.1% Not in index
Fiction.LiveBenchGeneral Not measured Not in index
Creative writing (Lech Mazur)General Not measured Not in index
CL-benchGeneral Not measured Not in index
Surface Evolver BenchGeneral Not measured Not in index
Furniture assemblyGeneral 58.3% Not in index
ExploitBenchGeneral Not measured Not in index
CybenchCoding Not measured Not in index
TheAgentCompanyAgentic work Not measured Not in index
OSWorldAgentic work Not measured Not in index
SpireClimbAgentic work 7.5% Not in index
VPCTReasoning Not measured Not in index
BIG-Bench HardReasoning Not measured Not in index
AI2 Reasoning ChallengeKnowledge Not measured Not in index
HellaSwagGeneral Not measured Not in index
WinoGrandeGeneral Not measured Not in index
PIQAGeneral Not measured Not in index
CL-bench LifeGeneral Not measured Not in index
ALE-BenchCoding 2462.0 Not in index
Vending-Bench 2Agentic work $14,428 Not in index
Epoch Capabilities IndexIntelligence 162.6 Not in index
LMArena TextGeneral Not measured Not in index
LMArena Text: codingCoding Not measured Not in index
LMArena Text: hard promptsReasoning Not measured Not in index
LMArena Text: mathMath Not measured Not in index
LMArena Text: instruction followingGeneral Not measured Not in index
LMArena Text: creative writingGeneral Not measured Not in index
LMArena VisionGeneral 1240 Not in index
LMArena Text: EnglishGeneral Not measured Not in index
LMArena Text: non-EnglishGeneral Not measured Not in index
LMArena Text: ChineseGeneral Not measured Not in index
LMArena Text: GermanGeneral Not measured Not in index
LMArena Text: JapaneseGeneral Not measured Not in index
LMArena Text: KoreanGeneral Not measured Not in index
LMArena Text: FrenchGeneral Not measured Not in index
LMArena Text: SpanishGeneral Not measured Not in index
LMArena Text: RussianGeneral Not measured Not in index
LMArena Text: PolishGeneral Not measured Not in index
LMArena Text: multi-turnGeneral Not measured Not in index
LMArena Text: longer queriesGeneral Not measured Not in index
LMArena Text: expertReasoning Not measured Not in index
LMArena Text: hard prompts in EnglishReasoning Not measured Not in index
LMArena Text: software and ITCoding Not measured Not in index
LMArena Text: mathematical workMath Not measured Not in index
LMArena Text: scienceKnowledge Not measured Not in index
LMArena Text: medicine and healthcareKnowledge Not measured Not in index
LMArena Text: legal and governmentKnowledge Not measured Not in index
LMArena Text: business and financeKnowledge Not measured Not in index
LMArena Text: writing and languageGeneral Not measured Not in index
LMArena Text: entertainment and mediaGeneral Not measured Not in index
LMArena WebDev: ReactCoding 1685 Not in index
LMArena WebDev: HTMLCoding 1685 Not in index
LMArena WebDev: from an imageCoding 1660 Not in index
LMArena Vision: EnglishGeneral 1229 Not in index
LMArena Vision: ChineseGeneral Not measured Not in index
LMArena Vision: reading textGeneral 1258 Not in index
LMArena Vision: diagramsReasoning 1270 Not in index
LMArena Vision: homeworkReasoning 1286 Not in index
LMArena Vision: humorGeneral Not measured Not in index
LMArena Vision: captioningGeneral Not measured Not in index
LMArena Vision: recognizing thingsGeneral Not measured Not in index
LMArena Vision: creative writingGeneral 1219 Not in index
LMArena SearchAgentic work Not measured Not in index
LMArena DocumentGeneral Not measured Not in index
LMArena Text to ImageImage generation Not measured Not in index
LMArena Image EditImage generation Not measured Not in index

What it costs

A list price says what a token costs. The cost per solved task says what a working answer costs, which is the number that decides.

Output price against the market

GPT-6 Sol pricing
$0.0112Dashed line: median $1.80, log scale$600.00
$10.00 per million output tokens is cheaper than 14% of the 344 paid models in the catalog.

Cost per solved task

How it is computed

Neither board that publishes what a SWE-bench Verified attempt costs, Vals AI and swebench.com, has run this model. We leave the number out rather than estimate it.

LiveBench, on its own coding tasks, publishes what one task cost this model: $0.977, at a score of 93.1%. LiveBench counts that as $1.049 per successful task. Different tasks from SWE-bench, so it is not our number and does not enter its ranking. LiveBench coding

Nearly as good as GPT-6 Sol, for less

What the boards say about its runs

Beside a result, many boards publish what the run cost, how long it took, the tokens it spent or the votes behind a rating. Each figure as its board printed it, one board per row.

What each board publishes about the runs behind OpenAI: GPT-6 Sol's results
BoardResultWhat the run costAlso published
LiveBench coding 93.1% $0.9769 per task Output tokens per task 27,853
LiveBench reasoning 88.7% $0.1209 per task Output tokens per task 11,871
LiveBench data analysis 81.2% $0.1989 per task Output tokens per task 19,154
LiveBench research 69.3% $3.5051 per task Output tokens per task 42,995
LiveBench browser 92.0% $3.2838 per task Output tokens per task 7,523
LiveBench long agentic 66.9% $8.6215 per task Output tokens per task 212,220
LiveBench design 82.2% $0.4254 per task Output tokens per task 28,387
Terminal-Bench 4 (Vals AI) 44.4% $5.79 per test Duration, as printed 34m 56s
Vibe Code Bench (Vals AI) 87.8% $26.36 per test Duration, as printed 38m 56s
Code migration (Vals AI) 57.2% $15.68 per test Duration, as printed 1h 26m
ProgramBench (Vals AI) 2.0% $11.67 per test Duration, as printed 46m 11s
SREBench (Vals AI) 30.5% $20.65 per test Duration, as printed 1h 03m
39 more boards
What each board publishes about the runs behind OpenAI: GPT-6 Sol's results, continued
IOI (Vals AI) 82.6% $2.70 per test Duration, as printed 30m 38s
Terminal-Bench 2.1 (Vals AI) 83.2% $0.37 per test Duration, as printed 4m 59s
CyberBench (Vals AI) 78.0% $1.34 per test Duration, as printed 12m 14s
Finance Agent (Vals AI) 49.0% $2.12 per test Duration, as printed 9m 00s
Tax Agent Bench (Vals AI) 15.0% $2.28 per test Duration, as printed 17m 32s
Legal Research Bench (Vals AI) 28.9% $4.90 per test Duration, as printed 24m 09s
Excel Modeling Benchmark (Vals AI) 71.5% $1.28 per test Duration, as printed 10m 22s
BioMysteryBench (Vals AI) 74.8% $0.66 per test Duration, as printed 5m 24s
Terminal-Bench-Science (Vals AI) 30.0% $5.82 per test Duration, as printed 1h 22m
Vals Science Index 45.0% $2.31 per test Duration, as printed 31m 16s
Public Benefits Bench (Vals AI) 56.6% $2.49 per test Nothing else
MysteryMechanism (Vals AI) 30.2% $0.46 per test Duration, as printed 6m 13s
ProofBench 83.0% $0.4763 per test Time per proof 5m 05s
ALE-Bench 2462.0 $0.844 per problem Tokens per problem 87,318
LMArena WebDev 1683 Elo Not published Votes 4,608 · Interval (±) ±10.4
Design Arena: websites 1292 Elo Not published Battles 2,685
Design Arena: UI components 1291 Elo Not published Battles 893
Design Arena: game dev 1310 Elo Not published Battles 1,310
Design Arena: data viz 1271 Elo Not published Battles 394
Design Arena: 3D 1321 Elo Not published Battles 483
Design Arena: all code categories 1300 Elo Not published Battles 5,367
Design Arena: SVG 1323 Elo Not published Battles 577
Design Arena: ASCII art 1223 Elo Not published Battles 239
Design Arena: agents building web apps 1226 Elo Not published Battles 582
Design Arena: agents building full-stack apps 1238 Elo Not published Battles 1,172
Design Arena: agents building mobile apps 1233 Elo Not published Battles 225
SAGE (Vals AI) 44.8% Not published Latency, as printed 31 s
MedCode (Vals AI) 47.1% Not published Latency, as printed 1m 03s
MedScribe (Vals AI) 82.0% Not published Latency, as printed 1m 21s
APEX-Agents 54.3% Not published Mean score 68.7%
LMArena Vision 1240 Elo Not published Votes 3,221 · Interval (±) ±11.3
LMArena WebDev: React 1685 Elo Not published Votes 2,719 · Interval (±) ±13.1
LMArena WebDev: HTML 1685 Elo Not published Votes 852 · Interval (±) ±23.8
LMArena WebDev: from an image 1660 Elo Not published Votes 2,948 · Interval (±) ±12.0
LMArena Vision: English 1229 Elo Not published Votes 1,058 · Interval (±) ±19.1
LMArena Vision: reading text 1258 Elo Not published Votes 2,285 · Interval (±) ±12.9
LMArena Vision: diagrams 1270 Elo Not published Votes 844 · Interval (±) ±20.9
LMArena Vision: homework 1286 Elo Not published Votes 518 · Interval (±) ±25.8
LMArena Vision: creative writing 1219 Elo Not published Votes 286 · Interval (±) ±37.7

On these lists

Compare with models of a similar score

All 135 comparisons for GPT-6 Sol