# OpenAI GPT-4o-mini (2024-07-18)

OpenAI GPT-4o-mini (2024-07-18) costs $0.15 per million input tokens and $0.60 per million output tokens, as of October 22, 2026. None of the 6 coding benchmarks behind the index has measured it, so it has no coding index, but 46 benchmarks outside the index have a result below.

Page: https://llmbenchmark.ai/models/gpt-4o-mini-2024-07-18
Data from October 22, 2026. Every figure below names the board it was read from and the day.

- Maker: OpenAI
- Released: July 18, 2024
- Price per million input tokens: $0.15
- Price per million output tokens: $0.60
- Context window: 128K tokens

Benchmark results (46 of 195):

- Aider polyglot: 3.6% (source: Aider polyglot leaderboard, read October 22, 2026)
- WeirdML: 11.8% (source: Epoch AI benchmarking hub, read October 22, 2026)
- BALROG: 17.4% (source: Epoch AI benchmarking hub, read October 22, 2026)
- GPQA Diamond (Epoch AI run): 37.7% (source: Epoch AI benchmarking hub, read October 22, 2026)
- SimpleBench: 10.7% (source: Epoch AI benchmarking hub, read October 22, 2026)
- Chess puzzles: 3.0% (source: Epoch AI benchmarking hub, read October 22, 2026)
- Mystery game puzzles: 12.0% (source: Epoch AI benchmarking hub, read October 22, 2026)
- OTIS Mock AIME: 6.9% (source: Epoch AI benchmarking hub, read October 22, 2026)
- FrontierMath, tiers 1 to 3: 0.7% (source: Epoch AI benchmarking hub, read October 22, 2026)
- MATH level 5: 52.6% (source: Epoch AI benchmarking hub, read October 22, 2026)
- SimpleQA Verified: 8.3% (source: Epoch AI benchmarking hub, read October 22, 2026)
- MMLU: 76.7% (source: Epoch AI benchmarking hub, read October 22, 2026)
- GeoBench: 64.0% (source: Epoch AI benchmarking hub, read October 22, 2026)
- Creative writing (Lech Mazur): 67.2% (source: Epoch AI benchmarking hub, read October 22, 2026)
- VPCT: 34.0% (source: Epoch AI benchmarking hub, read October 22, 2026)
- LMArena Text: 1286 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: coding: 1290 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: hard prompts: 1267 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: math: 1267 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: instruction following: 1258 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: creative writing: 1268 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Vision: 1066 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: English: 1301 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: non-English: 1266 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: Chinese: 1265 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: German: 1272 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: Japanese: 1216 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: Korean: 1195 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: French: 1297 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: Spanish: 1276 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: Russian: 1275 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: Polish: 1244 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: multi-turn: 1285 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: longer queries: 1289 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: expert: 1234 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: hard prompts in English: 1278 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: software and IT: 1291 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: mathematical work: 1271 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: science: 1286 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: medicine and healthcare: 1282 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: legal and government: 1305 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: business and finance: 1265 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: writing and language: 1282 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Text: entertainment and media: 1253 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Vision: English: 1072 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
- LMArena Vision: Chinese: 1033 Elo (source: LMArena (Hugging Face dataset), read October 22, 2026)
