Enter opens the highlighted result. Esc closes.

o1 vs Llama 3 8B Lunaris

Llama 3 8B Lunaris costs 1200.0x less per output token than o1 ($0.05 vs $60.00 per million). Updated October 22, 2026; no benchmark has tested both models yet.

o1OpenAI
Coding
No data
Overall
44.6
Output $/M
$60.00
S Llama 3 8B LunarisSao10K
Coding
No data
Overall
No data
Output $/M
$0.05
vs $60.00 vs $0.05 per 1M output tokens. Llama 3 8B Lunaris is 1200.0x cheaper.

o1 or Llama 3 8B Lunaris: which to pick

Neither model has a coding score yet, so the two cannot be ranked on coding.

Pick o1 for a larger context window (200K against 8K tokens).

No benchmark has tested both yet. o1 has results on Aider polyglot, AA Coding Index and LiveCodeBench (Vals AI); Llama 3 8B Lunaris has none yet. Compare them on price and context instead.

Which one for your work

Each card is decided by one number both models carry. Where only one has it, the card says so and makes no call.

At a glance

Coding index
o1 not benchmarked, Llama 3 8B Lunaris not benchmarked.
Widest category
None yet: no category has been tested on both models.
Widest single gap
None yet: no benchmark has tested both models.
Output price
o1 $60.00 against Llama 3 8B Lunaris $0.05 per million output tokens, 1200.0x apart.
Context window
o1 takes 200K tokens, Llama 3 8B Lunaris 8K.

Benchmark by benchmark

Every board either model has a result on, a category to a fold; bars are each result on a 0 to 100 scale. Only one model is measured on each, so no row names a leader.

CodingDirectional onlySix of these boards feed the Vibe Coding Index9 boards measured
Coding benchmarks for o1 and Llama 3 8B Lunaris
Benchmarko1Llama 3 8B LunarisLeader
Aider polyglot61.7%Not measuredOnly o1 measured
AA Coding Index39.7Not measuredOnly o1 measured
LiveCodeBench (Vals AI)50.3%Not measuredOnly o1 measured
LiveCodeBench (Artificial Analysis run)67.9%Not measuredOnly o1 measured
Terminal-Bench Hard (Artificial Analysis run)12.9%Not measuredOnly o1 measured
WeirdML46.1%Not measuredOnly o1 measured
LMArena Text: coding1367Not measuredOnly o1 measured
LMArena Text: software and IT1366Not measuredOnly o1 measured
SciCode4.6%Not measuredOnly o1 measured
Neither model has a result on the other 34 boards here
IntelligenceDirectional onlyPublic boards, shown as published, kept out of the index2 boards measured
Intelligence benchmarks for o1 and Llama 3 8B Lunaris
Benchmarko1Llama 3 8B LunarisLeader
AA Intelligence Index15.2Not measuredOnly o1 measured
Epoch Capabilities Index141.7Not measuredOnly o1 measured
Agentic workDirectional onlyPublic boards, shown as published, kept out of the index2 boards measured
Agentic work benchmarks for o1 and Llama 3 8B Lunaris
Benchmarko1Llama 3 8B LunarisLeader
τ²-Bench Telecom62.6%Not measuredOnly o1 measured
METR time horizons51.1%Not measuredOnly o1 measured
Neither model has a result on the other 40 boards here
ReasoningDirectional onlyPublic boards, shown as published, kept out of the index12 boards measured
Reasoning benchmarks for o1 and Llama 3 8B Lunaris
Benchmarko1Llama 3 8B LunarisLeader
GPQA Diamond73.2%Not measuredOnly o1 measured
MMMU Pro (Vals AI)77.4%Not measuredOnly o1 measured
GPQA Diamond (Artificial Analysis run)74.7%Not measuredOnly o1 measured
Humanity's Last Exam (Artificial Analysis run)7.0%Not measuredOnly o1 measured
GPQA Diamond (Epoch AI run)76.8%Not measuredOnly o1 measured
ARC-AGI30.7%Not measuredOnly o1 measured
SimpleBench40.1%Not measuredOnly o1 measured
Chess puzzles10.0%Not measuredOnly o1 measured
VPCT37.0%Not measuredOnly o1 measured
LMArena Text: hard prompts1371Not measuredOnly o1 measured
LMArena Text: expert1361Not measuredOnly o1 measured
LMArena Text: hard prompts in English1372Not measuredOnly o1 measured
Neither model has a result on the other 11 boards here
MathDirectional onlyPublic boards, shown as published, kept out of the index9 boards measured
Math benchmarks for o1 and Llama 3 8B Lunaris
Benchmarko1Llama 3 8B LunarisLeader
AIME71.5%Not measuredOnly o1 measured
MATH 500 (Vals AI)90.4%Not measuredOnly o1 measured
MGSM (Vals AI)89.3%Not measuredOnly o1 measured
OTIS Mock AIME73.3%Not measuredOnly o1 measured
FrontierMath, tiers 1 to 314.7%Not measuredOnly o1 measured
MATH level 594.7%Not measuredOnly o1 measured
LMArena Text: math1388Not measuredOnly o1 measured
LMArena Text: mathematical work1390Not measuredOnly o1 measured
MathArena10.2%Not measuredOnly o1 measured
Neither model has a result on the other 5 boards here
KnowledgeDirectional onlyPublic boards, shown as published, kept out of the index11 boards measured
Knowledge benchmarks for o1 and Llama 3 8B Lunaris
Benchmarko1Llama 3 8B LunarisLeader
MMLU Pro83.5%Not measuredOnly o1 measured
LegalBench (Vals AI)80.4%Not measuredOnly o1 measured
TaxEval (Vals AI)74.3%Not measuredOnly o1 measured
MedQA (Vals AI)96.5%Not measuredOnly o1 measured
MMLU Pro (Artificial Analysis run)84.1%Not measuredOnly o1 measured
SimpleQA Verified41.1%Not measuredOnly o1 measured
GeoBench80.0%Not measuredOnly o1 measured
LMArena Text: science1369Not measuredOnly o1 measured
LMArena Text: medicine and healthcare1355Not measuredOnly o1 measured
LMArena Text: legal and government1368Not measuredOnly o1 measured
LMArena Text: business and finance1328Not measuredOnly o1 measured
Neither model has a result on the other 9 boards here
GeneralDirectional onlyPublic boards, shown as published, kept out of the index25 boards measured
General benchmarks for o1 and Llama 3 8B Lunaris
Benchmarko1Llama 3 8B LunarisLeader
IFBench70.3%Not measuredOnly o1 measured
Long context reasoning (AA-LCR)65.0%Not measuredOnly o1 measured
DTBench74.7%Not measuredOnly o1 measured
LMCA22.3%Not measuredOnly o1 measured
Fiction.LiveBench83.3%Not measuredOnly o1 measured
Creative writing (Lech Mazur)70.2%Not measuredOnly o1 measured
LMArena Text1366Not measuredOnly o1 measured
LMArena Text: instruction following1367Not measuredOnly o1 measured
LMArena Text: creative writing1347Not measuredOnly o1 measured
LMArena Vision1168Not measuredOnly o1 measured
LMArena Text: English1372Not measuredOnly o1 measured
LMArena Text: non-English1358Not measuredOnly o1 measured
LMArena Text: Chinese1394Not measuredOnly o1 measured
LMArena Text: German1337Not measuredOnly o1 measured
LMArena Text: Japanese1346Not measuredOnly o1 measured
LMArena Text: Korean1396Not measuredOnly o1 measured
LMArena Text: French1344Not measuredOnly o1 measured
LMArena Text: Spanish1345Not measuredOnly o1 measured
LMArena Text: Russian1356Not measuredOnly o1 measured
LMArena Text: multi-turn1355Not measuredOnly o1 measured
LMArena Text: longer queries1378Not measuredOnly o1 measured
LMArena Text: writing and language1360Not measuredOnly o1 measured
LMArena Text: entertainment and media1358Not measuredOnly o1 measured
LMArena Vision: English1162Not measuredOnly o1 measured
LMArena Vision: Chinese1235Not measuredOnly o1 measured
Neither model has a result on the other 23 boards here

What each workload costs

Three fixed token mixes at each model's listed price, so per-token rates become a bill.

Chat turn

1K input + 500 output tokens

o1$0.045Fits in one request
Llama 3 8B Lunaris$0.0001Fits in one request

Llama 3 8B Lunaris costs less

Repository review

50K input + 3K output tokens

o1$0.930Fits in one request
Llama 3 8B Lunaris$0.0022Exceeds the context window

Llama 3 8B Lunaris costs less

Agent loop

200K input + 10K output tokens

o1$3.60Exceeds the context window
Llama 3 8B Lunaris$0.0085Exceeds the context window

Llama 3 8B Lunaris costs less

Listed OpenRouter rates, without cache or batch discounts. A workload that does not fit a model's context window would need splitting.

Specification differences

The leading value in a row is marked; a row with a missing value names no leader. Our two rows are marked in red.

Specifications of o1 and Llama 3 8B Lunaris
SpecificationOpenAI o1Sao10K Llama 3 8B Lunaris
MakerOpenAISao10K
WeightsNo public weights listedOpen weights
ReleasedDecember 17, 2024August 13, 2024
Context window200K8K
Input $/Mtok$15.00$0.04
Output $/Mtok$60.00$0.05
Coding indexNot benchmarkedNot benchmarked
Independent measurements behind it00
Cost per solved taskNot computableNot computable
SourceOpenRouter listingOpenRouter listing

Questions

Is o1 better than Llama 3 8B Lunaris for coding?

Neither model has a coding score yet, so the two cannot be ranked on coding. Pick o1 for a larger context window (200K against 8K tokens).

Which is cheaper, o1 or Llama 3 8B Lunaris?

o1 costs $15.00 per million input tokens and $60.00 per million output tokens; Llama 3 8B Lunaris costs $0.04 and $0.05. Cost per solved task is known for neither of them.

Which has the bigger context window, o1 or Llama 3 8B Lunaris?

o1, with 200K tokens against 8K.

Has any benchmark tested both o1 and Llama 3 8B Lunaris?

No benchmark has tested both yet. o1 has results on Aider polyglot, AA Coding Index and LiveCodeBench (Vals AI); Llama 3 8B Lunaris has none yet. Compare them on price and context instead. Data as of October 22, 2026.

Compare next