LLMBenchmark.ai

Enter opens the highlighted result. Esc closes.

Coding leaderboard

Claude Opus 5.5 leads
92.2
of 356 models have a score
136
rest on three benchmarks
2
coding boards in the index
4

Vibe Coding Index · read October 20

vibe_coding_index.py


        # Vibe Coding Index, read October 20
        leaders = {
            "Claude Opus 5.5": 92.2,    "Claude Fable 5.1": 89.1,    "Claude Sonnet 5.5": 88.9,
        }

As of October 20, 2026, Anthropic Claude Opus 5.5 leads coding with 92.2 on the Vibe Coding Index, ahead of Anthropic Claude Fable 5.1 (89.1) and Anthropic Claude Sonnet 5.5 (88.9). 136 of 356 LLMs have a score. 2 of 356 models have three independent coding benchmarks behind their score.

Ranking table

Ranked by index, highest first. The dots count the benchmarks behind each score: a score from one benchmark is a single reading, so filter to two or more for the harder ranking.

136 of 136 shown

Full data (JSON)
Scored LLMs, sortable by column
Rank
1
Claude Opus 5.5 Anthropic
92.2 $20.00 No SWE-bench cost LiveBench: $5.224 per solved
2
Claude Fable 5.1 Anthropic
89.1 $50.00 No SWE-bench cost LiveBench: $5.407 per solved
3
Claude Sonnet 5.5 Anthropic
88.9 $10.00 No SWE-bench cost LiveBench: $4.247 per solved
4
GPT-6 Astra OpenAI
88.7 $50.00 No SWE-bench cost LiveBench: $3.538 per solved
5
GPT-6.1 Sol OpenAI
88.7 $10.00 No SWE-bench cost LiveBench: $0.502 per solved
6
Qwen3.8 Flash Qwen
87.4 $0.47 No SWE-bench cost LiveBench: $0.121 per solved
7
o3 Pro OpenAI
84.9 $80.00 No run cost
8
DeepSeek V4.1 Flash 1017 DeepSeek
83.3 $0.60 No SWE-bench cost LiveBench: $0.204 per solved
9
Gemini 2.5 Pro Preview 06-05 Google
83.1 $10.00 No run cost
10
GPT-6 Sol OpenAI
82.8 $10.00 No SWE-bench cost LiveBench: $1.049 per solved
11
Claude Fable 5 Anthropic
82.1 $50.00 $2.16
12
Claude Opus 5 Anthropic
81.8 $25.00 $1.33
13
Gemini 4 Argon Google
80.5 $10.00 No SWE-bench cost LiveBench: $5.659 per solved
14
Muse Spark 1.3 Meta
79.7 $4.25 No SWE-bench cost LiveBench: $1.521 per solved
15
DeepSeek V4.1 Flash DeepSeek
77.2 $0.01 No SWE-bench cost LiveBench: $0.264 per solved
16
GPT-5.6 Sol OpenAI
76.7 $20.00 $1.20
17
Grok 4.6 xAI
76.4 $6.00 $0.82
18
Claude Haiku 5.5 Anthropic
75.9 $0.50 No SWE-bench cost LiveBench: $0.956 per solved
19
Gemini 3 Flash Preview Google
75.8 $3.00 $0.37
20
Grok 4.5 xAI
75.5 $6.00 $0.62
21
Grok 4.7 xAI
75.0 $6.00 No SWE-bench cost LiveBench: $5.775 per solved
22
Qwen3.8 27B Qwen
73.6 $2.20 $1.26
23
GLM 5.3 Z.ai
73.1 $1.40 $0.36
24
MiMo-V2.6-Pro Xiaomi
72.6 $0.87 No SWE-bench cost LiveBench: $0.275 per solved
25
GPT-5 OpenAI
72.2 $10.00 $0.39
26
GPT-6 Luna OpenAI
71.4 $0.50 No SWE-bench cost LiveBench: $0.112 per solved
27
Step 5 Preview StepFun
71.4 $2.70 No SWE-bench cost LiveBench: $1.28 per solved
28
R1 0528 DeepSeek
71.4 $2.15 No run cost
29
GLM 5.3 Flash Z.ai
71.0 $0.16 $0.02
30
o3 OpenAI
70.7 $8.00 $0.571
31
Gemini 3.8 Flash Google
70.5 $4.13 $2.74
32
DeepSeek V3 DeepSeek
70.2 $1.03 No run cost
33
Gemini 3.7 Flash Google
69.9 $3.75 $1.78
34
GPT-5.6 Terra OpenAI
69.0 $12.00 $0.42
35
o4 Mini OpenAI
68.6 $4.40 No run cost
36
GPT-5.5 OpenAI
67.8 $30.00 $1.65
37
Claude Opus 4.6 Anthropic
66.9 $25.00 $1.56
38
Claude Opus 4.5 Anthropic
66.8 $25.00 $1.37
39
Claude Opus 4.8 Anthropic
66.0 $25.00 $2.17
40
Nemotron 3.5 Super VL NVIDIA
65.5 $0.50 No SWE-bench cost LiveBench: $0.505 per solved
41
Muse Spark 1.2 Meta
65.1 $4.25 $0.64
42
Kimi K2 0711 Moonshot AI
64.7 $2.30 No run cost
43
Muse Wonder Meta
64.5 $20.00 No run cost
44
GLM 4.5 Z.ai
64.2 $2.20 No run cost
45
Claude Sonnet 5 Anthropic
63.5 $10.00 $1.87
46
Qwen3.8 Max (0902) Qwen
63.5 $6.00 $1.32
47
Kimi K2 Thinking Moonshot AI
63.4 $2.50 $0.61
48
Muse Spark Open Meta
62.1 $4.25 No SWE-bench cost LiveBench: $1.702 per solved
49
MiMo-V2.6-Flash Xiaomi
61.9 $0.28 No run cost
50
Kimi K3 Moonshot AI
61.8 $11.94 $0.81
51
o1 OpenAI
61.7 $60.00 No run cost
52
Hy4 preview Tencent
61.6 $2.50 No run cost
53
GPT-5.6 Luna OpenAI
61.5 $1.20 $0.04
54
Qwen3 Coder 30B A3B Instruct Qwen
60.4 $0.28 No run cost
55
GPT-5 Mini OpenAI
59.8 $2.00 $0.08
56
GLM 5 Z.ai
59.7 $1.92 $0.63
57
MiniMax M2.5 MiniMax
59.4 $0.95 $0.62
58
Claude Sonnet 4.5 Anthropic
59.1 $15.00 $1.16
59
GPT-5.2 OpenAI
58.9 $14.00 $1.91
60
Kimi K2.5 Moonshot AI
58.5 $2.50 $0.24
61
Claude Sonnet 4.6 Anthropic
57.8 $15.00 $1.68
62
MiniMax M3 MiniMax
57.8 $1.20 $0.56
63
GLM 5.2 Z.ai
57.7 $2.42 $0.86
64
Mistral Large 4 Mistral AI
55.3 $2.09 No SWE-bench cost LiveBench: $1.638 per solved
65
GPT-5.2-Codex OpenAI
55.1 $14.00 $0.43
66
DeepSeek V3.2 Exp DeepSeek
55.0 $0.41 No run cost
67
DeepSeek V4 Flash 0423 DeepSeek
54.6 $0.18 No run cost
68
DeepSeek V4 Pro 0813 DeepSeek
54.6 $1.98 $0.10
69
DeepSeek V3.2 DeepSeek
54.4 $0.42 $0.99
70
Devstral 2 2512 Mistral AI
53.8 $2.00 $1.19
71
GPT-5.1 OpenAI
53.3 $10.00 $1.02
72
GLM 4.6 Z.ai
52.2 $2.20 No run cost
73
o3 Mini OpenAI
52.1 $4.40 No run cost
74
Claude Opus 4.7 Anthropic
51.1 $25.00 $2.95
75
GPT-5.1-Codex OpenAI
50.5 $10.00 $0.892
76
Qwen3 Coder 480B A35B Qwen
50.0 $1.00 No run cost
77
Claude Haiku 4.5 Anthropic
49.8 $5.00 $0.56
78
T Inkling Thinking Machines
49.7 $4.05 $0.76
79
Muse Spark 1.1 Meta
48.9 $4.25 $0.43
80
Gemini 3.6 Flash Google
48.3 $3.75 $1.49
81
GPT-4.1 OpenAI
46.5 $8.00 $0.37
82
MiniMax M2 MiniMax
45.3 $1.02 $0.702
83
Qwen3.7 Max Qwen
45.1 $4.42 $4.69
84
Kimi K2.6 Moonshot AI
44.2 $3.41 $0.35
85
GLM 5.1 Z.ai
44.0 $3.04 $0.60
86
Hy3 Tencent
43.9 $0.53 No run cost
87
Gemini 3.5 Flash Google
42.8 $9.00 $1.21
88
DeepSeek V3 0324 DeepSeek
42.0 $1.14 No run cost
89
Qwen3 32B Qwen
40.0 $0.28 No run cost
90
MiMo-V2.5-Pro Xiaomi
40.0 $0.87 $0.03
91
Kimi K2.7 Code Moonshot AI
39.1 $3.35 $0.35
92
GPT-4o OpenAI
38.8 $10.00 No run cost
93
Gemma 4 31B Google
38.3 $0.40 No SWE-bench cost LiveBench: $0.475 per solved
94
GPT-5.4 OpenAI
37.7 $15.00 $1.02
95
DeepSeek V4 Flash Vision Exp DeepSeek
37.6 $0.65 No SWE-bench cost LiveBench: $0.107 per solved
96
Qwen3.6 Plus Qwen
37.4 $1.95 $1.19
97
Gemini 2.5 Pro Google
37.0 $10.00 $0.64
98
DeepSeek V4 Pro 0423 DeepSeek
35.3 $1.91 $0.57
99
Gemini 3.1 Pro Preview Google
35.3 $12.00 $0.99
100
GPT-5 Nano OpenAI
34.8 $0.40 $0.109
101
gpt-oss-120b OpenAI
34.5 $0.60 $0.51
102
MiMo-V2.5 Xiaomi
34.0 $0.28 $0.01
103
R Beam 1.0 501B A23B Reflection
33.8 $1.00 No run cost
104
Gemini 3.5 Flash Lite Google
33.6 $2.50 $0.41
105
GLM 4.7 Z.ai
33.6 $1.98 $0.29
106
Qwen2.5 Coder 32B Instruct Qwen
30.5 $1.00 No run cost
107
T Inkling Small Thinking Machines
29.9 $1.20 $0.16
108
GPT-5.3-Codex OpenAI
29.5 $14.00 $0.59
109
GLM 5V Turbo Z.ai
28.8 $4.00 No run cost
110
Gemini 2.5 Flash Google
28.7 $2.50 $0.466
111
Qwen3.5 397B A17B Qwen
28.6 $2.34 No run cost
112
GPT-4.1 Mini OpenAI
28.5 $1.60 $1.818
113
MiniMax M2.7 MiniMax
28.4 $1.20 $0.64
114
GPT-5.4 Mini OpenAI
28.2 $4.50 $0.70
115
Claude Opus 4.1 Anthropic
27.2 $75.00 No run cost
116
Solar Pro 4 Upstage
24.4 $0.60 No run cost
117
GPT-4o (2024-08-06) OpenAI
23.1 $10.00 No run cost
118
Qwen3.5-122B-A10B Qwen
22.9 $2.08 No run cost
119
Gemma 4 26B A4B Google
22.8 $0.26 No run cost
120
Qwen3.5-27B Qwen
22.6 $2.16 No run cost
121
Grok 4.3 xAI
22.5 $2.50 $0.31
122
GPT-4 OpenAI
22.4 $60.00 No run cost
123
Hy3 preview Tencent
22.4 $0.60 No run cost
124
GPT-4o (2024-11-20) OpenAI
18.2 $10.00 No run cost
125
Llama 4 Maverick Meta Llama
18.1 $0.65 $1.491
126
Mistral Medium 3.5 Mistral AI
9.2 $7.50 $6.02
127
Llama 4 Scout Meta Llama
9.1 $0.30 $1.276
128
GPT-4.1 Nano OpenAI
8.9 $0.40 No run cost
129
Gemini 3.1 Flash Lite Preview Google
8.1 $1.50 $0.18
130
Qwen3.5-35B-A3B Qwen
7.7 $1.00 No run cost
131
GPT-5.1-Codex-Mini OpenAI
6.2 $2.00 No run cost
132
Qwen3.5-Flash Qwen
6.2 $0.26 $0.40
133
Trinity Large Thinking Arcee AI
5.4 $0.80 No run cost
134
Gemma 3 27B Google
4.9 $0.35 No run cost
135
GPT-4o-mini (2024-07-18) OpenAI
3.6 $0.60 No run cost
136
Mercury 2 Inception
0.0 $0.75 No run cost

A small "LiveBench" figure under No run cost is LiveBench's own cost per successful task on its coding tasks: another benchmark, shown for reference and not ranked with the column.

220 models have no benchmark data yet
Models with no benchmark data
Rank Model Evidence Index Output $/Mtok Cost per solved task
A Aion 3.5Aion Labs
Not benchmarked $6.00 No run cost
A Aion 3.5 MiniAion Labs
Not benchmarked $1.40 No run cost
A Aion-2.0Aion Labs
Not benchmarked $1.60 No run cost
A Aion-3.0Aion Labs
Not benchmarked $6.00 No run cost
A Aion-3.0-MiniAion Labs
Not benchmarked $1.40 No run cost
A Aion-RP 1.0 (8B)Aion Labs
Not benchmarked $1.60 No run cost
Nova 2 LiteAmazon
Not benchmarked $2.50 No run cost
Nova Lite 1.0Amazon
Not benchmarked $0.24 No run cost
Nova Micro 1.0Amazon
Not benchmarked $0.14 No run cost
Nova Premier 1.0Amazon
Not benchmarked $12.50 No run cost
Nova Pro 1.0Amazon
Not benchmarked $3.20 No run cost
Auto RouterOpenRouter
Not benchmarked Not published No run cost
Auto Router (Beta)OpenRouter
Not benchmarked Not published No run cost
Body Builder (beta)OpenRouter
Not benchmarked Not published No run cost
Seed 1.6ByteDance Seed
Not benchmarked $2.00 No run cost
Seed 1.6 FlashByteDance Seed
Not benchmarked $0.30 No run cost
Seed 2.1 TurboByteDance Seed
Not benchmarked $2.50 No run cost
Seed-2.0-CodeByteDance Seed
Not benchmarked $3.00 No run cost
Seed-2.0-LiteByteDance Seed
Not benchmarked $2.00 No run cost
Seed-2.0-MiniByteDance Seed
Not benchmarked $0.40 No run cost
UI-TARS 7BByteDance
Not benchmarked $0.20 No run cost
Command ACohere
Not benchmarked $10.00 $2.69
Command A+Cohere
Not benchmarked $1.50 No run cost
Command R (08-2024)Cohere
Not benchmarked $0.60 No run cost
Command R+ (08-2024)Cohere
Not benchmarked $10.00 No run cost
Command R7B (12-2024)Cohere
Not benchmarked $0.15 No run cost
DeepSeek V3.1DeepSeek
Not benchmarked $0.95 No run cost
DeepSeek V3.1 TerminusDeepSeek
Not benchmarked $1.00 No run cost
DeepSeek V4 Flash 0731DeepSeek
Not benchmarked $1.32 $0.01
E GlimpseElorian
Not benchmarked $3.00 No run cost
Ember-1Fireworks
Not benchmarked $15.00 No run cost
Free Models RouterOpenRouter
Not benchmarked Free No run cost
Gemini 2.5 Flash LiteGoogle
Not benchmarked $0.40 No run cost
Gemini 3.1 Flash LiteGoogle
Not benchmarked $1.50 No run cost
Gemini 3.1 Pro Preview Custom ToolsGoogle
Not benchmarked $12.00 No run cost
Gemma 2 27BGoogle
Not benchmarked $0.65 No run cost
Gemma 3 12BGoogle
Not benchmarked $0.15 No run cost
Gemma 3 4BGoogle
Not benchmarked $0.05 No run cost
Lyria 3 Clip PreviewGoogle
Not benchmarked Free No run cost
Lyria 3 Pro PreviewGoogle
Not benchmarked Free No run cost
Nano Banana (Gemini 2.5 Flash Image)Google
Not benchmarked $2.50 No run cost
Nano Banana 2 (Gemini 3.1 Flash Image Preview)Google
Not benchmarked $3.00 No run cost
Nano Banana 2 (Gemini 3.1 Flash Image)Google
Not benchmarked $3.00 No run cost
Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)Google
Not benchmarked $1.50 No run cost
Nano Banana 2.1Google
Not benchmarked $7.50 No run cost
Nano Banana Pro (Gemini 3 Pro Image Preview)Google
Not benchmarked $12.00 No run cost
Nano Banana Pro (Gemini 3 Pro Image)Google
Not benchmarked $12.00 No run cost
Granite 4.0 MicroIBM Granite
Not benchmarked $0.11 No run cost
Granite 4.2 8BIBM Granite
Not benchmarked $0.25 No run cost
Mercury 2.5Inception
Not benchmarked $0.15 No run cost
Mercury 3Inception
Not benchmarked $0.35 No run cost
Ling 3.0 FlashinclusionAI
Not benchmarked $0.06 $0.05
Ling 3.0 Flash VLinclusionAI
Not benchmarked $0.18 No run cost
Ling 3.1 FlashinclusionAI
Not benchmarked $0.23 No run cost
Schematron V2 SmallInference.net
Not benchmarked $0.23 No run cost
Schematron V2 TurboInference.net
Not benchmarked $0.15 No run cost
LFM2.5-24B-A2BLiquid
Not benchmarked $0.70 No run cost
A Magnum v4 72BAnthracite
Not benchmarked $5.00 No run cost
M Weaver (alpha)Mancer
Not benchmarked $0.75 No run cost
LongCat 2.0Meituan
Not benchmarked $1.20 No run cost
Llama 3.1 70B InstructMeta Llama
Not benchmarked $0.40 No run cost
Llama 3.1 8B InstructMeta Llama
Not benchmarked $0.08 No run cost
Llama 3.2 1B InstructMeta Llama
Not benchmarked $0.20 No run cost
Llama 3.2 3B InstructMeta Llama
Not benchmarked $0.34 No run cost
Llama 3.3 70B InstructMeta Llama
Not benchmarked $0.32 No run cost
Llama Guard 4 12BMeta Llama
Not benchmarked $0.18 No run cost
Muse Glimmer 30BMeta
Not benchmarked $1.20 No run cost
Muse Spark 1.2 ContributorMeta
Not benchmarked $0.20 No run cost
Muse Spark 1.3 ContributorMeta
Not benchmarked $0.20 No run cost
Phi 4Microsoft
Not benchmarked $0.14 No run cost
MiniMax M1MiniMax
Not benchmarked $2.20 No run cost
MiniMax M2-herMiniMax
Not benchmarked $1.20 No run cost
MiniMax M2.1MiniMax
Not benchmarked $1.20 $0.59
MiniMax-01MiniMax
Not benchmarked $1.10 No run cost
Mistral LargeMistral AI
Not benchmarked $6.00 No run cost
Mistral Large 2407Mistral AI
Not benchmarked $6.00 No run cost
Codestral 2508Mistral AI
Not benchmarked $0.90 No run cost
Ministral 3 14B 2512Mistral AI
Not benchmarked $0.20 No run cost
Ministral 3 3B 2512Mistral AI
Not benchmarked $0.10 No run cost
Ministral 3 8B 2512Mistral AI
Not benchmarked $0.15 No run cost
Mistral Large 3 2512Mistral AI
Not benchmarked $1.50 $0.77
Mistral Medium 3Mistral AI
Not benchmarked $2.00 No run cost
Mistral Medium 3.1Mistral AI
Not benchmarked $2.00 No run cost
Mistral NemoMistral AI
Not benchmarked $0.03 No run cost
Mistral Small 3Mistral AI
Not benchmarked $0.08 No run cost
Mistral Small 3.1 24BMistral AI
Not benchmarked $0.56 No run cost
Mistral Small 3.2 24BMistral AI
Not benchmarked $0.25 No run cost
Mistral Small 4Mistral AI
Not benchmarked $0.60 No run cost
Mixtral 8x22B InstructMistral AI
Not benchmarked $6.00 No run cost
SabaMistral AI
Not benchmarked $0.60 No run cost
Voxtral Small 24B 2507Mistral AI
Not benchmarked $0.30 No run cost
M Moondream 3 PreviewMoondream
Not benchmarked $2.50 No run cost
M Moondream 3.1Moondream
Not benchmarked $2.50 No run cost
Kimi K2 0905Moonshot AI
Not benchmarked $2.50 No run cost
Morph V3 FastMorph
Not benchmarked $1.20 No run cost
Morph V3 LargeMorph
Not benchmarked $1.90 No run cost
G MythoMax 13BGryphe
Not benchmarked $0.11 No run cost
N Nex-N2.5-MiniNex AGI
Not benchmarked $0.10 No run cost
N Nex-N2.5-ProNex AGI
Not benchmarked $0.25 No run cost
N Hermes 3 405B InstructNous Research
Not benchmarked $1.00 No run cost
N Hermes 3 70B InstructNous Research
Not benchmarked $0.70 No run cost
N Hermes 4 405BNous Research
Not benchmarked $3.00 No run cost
Nemotron 3 Nano 30B A3BNVIDIA
Not benchmarked $0.24 No run cost
Nemotron 3 SuperNVIDIA
Not benchmarked $0.45 No run cost
Nemotron 3 UltraNVIDIA
Not benchmarked $2.40 No run cost
Nemotron 3.5 Content SafetyNVIDIA
Not benchmarked $0.20 No run cost
Nemotron 3.5 LightningNVIDIA
Not benchmarked $0.20 $0.06
SwitchyardNVIDIA
Not benchmarked Not published No run cost
GPT AudioOpenAI
Not benchmarked $10.00 No run cost
GPT Audio MiniOpenAI
Not benchmarked $2.40 No run cost
GPT Chat LatestOpenAI
Not benchmarked $30.00 No run cost
GPT-3.5 TurboOpenAI
Not benchmarked $1.50 No run cost
GPT-3.5 Turbo (older v0613)OpenAI
Not benchmarked $2.00 No run cost
GPT-3.5 Turbo 16kOpenAI
Not benchmarked $4.00 No run cost
GPT-3.5 Turbo InstructOpenAI
Not benchmarked $2.00 No run cost
GPT-4 TurboOpenAI
Not benchmarked $30.00 No run cost
GPT-4o (2024-05-13)OpenAI
Not benchmarked $15.00 No run cost
GPT-4o-miniOpenAI
Not benchmarked $0.60 No run cost
GPT-5 ImageOpenAI
Not benchmarked $10.00 No run cost
GPT-5 Image MiniOpenAI
Not benchmarked $2.00 No run cost
GPT-5 ProOpenAI
Not benchmarked $120.00 No run cost
GPT-5.1-Codex-MaxOpenAI
Not benchmarked $10.00 No run cost
GPT-5.2 ChatOpenAI
Not benchmarked $14.00 No run cost
GPT-5.2 ProOpenAI
Not benchmarked $168.00 No run cost
GPT-5.4 Image 2OpenAI
Not benchmarked $15.00 No run cost
GPT-5.4 NanoOpenAI
Not benchmarked $1.25 $0.14
GPT-5.4 ProOpenAI
Not benchmarked $180.00 No run cost
GPT-5.5 ProOpenAI
Not benchmarked $180.00 No run cost
GPT-5.6 Luna ProOpenAI
Not benchmarked $1.20 No run cost
GPT-5.6 Sol ProOpenAI
Not benchmarked $20.00 No run cost
GPT-5.6 Terra ProOpenAI
Not benchmarked $12.00 No run cost
GPT-6 Astra ProOpenAI
Not benchmarked $50.00 No run cost
GPT-6 Luna ProOpenAI
Not benchmarked $0.50 No run cost
GPT-6 Sol ProOpenAI
Not benchmarked $10.00 No run cost
GPT-6.1 Sol ProOpenAI
Not benchmarked $10.00 No run cost
gpt-oss-20bOpenAI
Not benchmarked $0.09 No run cost
gpt-oss-safeguard-20bOpenAI
Not benchmarked $0.30 No run cost
o1-proOpenAI
Not benchmarked $600.00 No run cost
o3 Mini HighOpenAI
Not benchmarked $4.40 No run cost
o4 Mini HighOpenAI
Not benchmarked $4.40 No run cost
FusionOpenRouter
Not benchmarked Not published No run cost
U Pareto 26.10Unbiased
Not benchmarked $3.20 No run cost
U Pareto 26.9Unbiased
Not benchmarked $7.50 No run cost
Pareto Code RouterOpenRouter
Not benchmarked Not published No run cost
Perceptron Mk1Perceptron
Not benchmarked $1.50 No run cost
Perceptron Mk1.5Perceptron
Not benchmarked $1.50 No run cost
SonarPerplexity
Not benchmarked $1.00 No run cost
Sonar Deep ResearchPerplexity
Not benchmarked $8.00 No run cost
Sonar ProPerplexity
Not benchmarked $15.00 No run cost
Sonar Pro SearchPerplexity
Not benchmarked $15.00 No run cost
Sonar Reasoning ProPerplexity
Not benchmarked $8.00 No run cost
P Laguna S 2.1Poolside
Not benchmarked $0.18 No run cost
P Laguna XS 2.1Poolside
Not benchmarked $0.12 No run cost
P Ternary Bonsai 2 27BPrism-ml
Not benchmarked $0.50 No run cost
Qwen-PlusQwen
Not benchmarked $0.78 No run cost
Qwen2.5 7B InstructQwen
Not benchmarked $0.20 No run cost
Qwen2.5 VL 72B InstructQwen
Not benchmarked $1.00 No run cost
Qwen3 14BQwen
Not benchmarked $0.24 No run cost
Qwen3 235B A22B Instruct 2507Qwen
Not benchmarked $0.55 No run cost
Qwen3 235B A22B Thinking 2507Qwen
Not benchmarked $3.50 No run cost
Qwen3 30B A3BQwen
Not benchmarked $0.50 No run cost
Qwen3 30B A3B Instruct 2507Qwen
Not benchmarked $0.30 No run cost
Qwen3 Coder FlashQwen
Not benchmarked $0.97 No run cost
Qwen3 Coder NextQwen
Not benchmarked $0.80 No run cost
Qwen3 Next 80B A3B InstructQwen
Not benchmarked $1.10 No run cost
Qwen3 Next 80B A3B ThinkingQwen
Not benchmarked $1.20 No run cost
Qwen3 VL 235B A22B InstructQwen
Not benchmarked $1.90 No run cost
Qwen3 VL 30B A3B InstructQwen
Not benchmarked $0.60 No run cost
Qwen3 VL 30B A3B ThinkingQwen
Not benchmarked $1.00 No run cost
Qwen3 VL 8B InstructQwen
Not benchmarked $0.75 No run cost
Qwen3.5 Plus 2026-02-15Qwen
Not benchmarked $1.56 No run cost
Qwen3.5 Plus 2026-04-20Qwen
Not benchmarked $1.80 $1.35
Qwen3.5-9BQwen
Not benchmarked $0.15 No run cost
Qwen3.6 27BQwen
Not benchmarked $2.00 $1.30
Qwen3.6 35B A3BQwen
Not benchmarked $0.95 No run cost
Qwen3.6 FlashQwen
Not benchmarked $1.13 No run cost
Qwen3.7 FlashQwen
Not benchmarked $0.13 No run cost
Qwen3.7 PlusQwen
Not benchmarked $1.28 No run cost
Qwen3.8 2.4T A95BQwen
Not benchmarked $6.00 No run cost
Qwen3.8 Max PrimeQwen
Not benchmarked $12.00 No run cost
Qwen3.8 Omni FlashQwen
Not benchmarked $0.47 No run cost
Qwen2.5 72B InstructQwen
Not benchmarked $0.40 No run cost
Reka EdgeReka
Not benchmarked $0.10 No run cost
Reka Flash 3Reka
Not benchmarked $0.20 No run cost
Relace Apply 3Relace
Not benchmarked $1.25 No run cost
Relace SearchRelace
Not benchmarked $3.00 No run cost
U ReMM SLERP 13BUndi95
Not benchmarked $0.65 No run cost
Fugu MaxSakana
Not benchmarked $6.00 No run cost
Fugu UltraSakana
Not benchmarked $30.00 No run cost
Fugu Ultra v2Sakana
Not benchmarked $30.00 No run cost
Sakana NamazuSakana
Not benchmarked $4.00 No run cost
S Llama 3 8B LunarisSao10K
Not benchmarked $0.05 No run cost
S Llama 3.1 Euryale 70B v2.2Sao10K
Not benchmarked $0.85 No run cost
S ExtractScaledown
Not benchmarked Free No run cost
S SummarizeScaledown
Not benchmarked Free No run cost
Grok 4.20xAI
Not benchmarked $2.50 $0.72
Grok 4.20 Multi-AgentxAI
Not benchmarked $2.50 No run cost
Grok Build 0.1xAI
Not benchmarked $2.00 No run cost
Step 3.5 FlashStepFun
Not benchmarked $0.30 No run cost
Step 3.7 FlashStepFun
Not benchmarked $1.15 No run cost
Hunyuan A13B InstructTencent
Not benchmarked $0.57 No run cost
Hy-MT2-1.8BTencent
Not benchmarked $0.18 No run cost
Hy-MT2-30B-A3BTencent
Not benchmarked $0.29 No run cost
Hy-MT2-7BTencent
Not benchmarked $0.29 No run cost
T Cydonia 24B V4.1TheDrummer
Not benchmarked $0.50 No run cost
T Skyfall 36B V2TheDrummer
Not benchmarked $0.80 No run cost
T UnslopNemo 12BTheDrummer
Not benchmarked $0.40 No run cost
T Jev RouterTypesafe
Not benchmarked Not published No run cost
Solar Mini 4Upstage
Not benchmarked $0.20 No run cost
Solar Pro 3Upstage
Not benchmarked $0.60 No run cost
C UncensoredCognitive Computations
Not benchmarked $0.90 No run cost
W Palmyra X5Writer
Not benchmarked $6.00 No run cost
MiMo-V2.6-Pro-UltraSpeedXiaomi
Not benchmarked $8.70 No run cost
GLM 4.5 AirZ.ai
Not benchmarked $0.85 No run cost
GLM 4.5VZ.ai
Not benchmarked $1.80 No run cost
GLM 4.6VZ.ai
Not benchmarked $0.90 No run cost
GLM 4.7 FlashZ.ai
Not benchmarked $0.40 No run cost
GLM 5 TurboZ.ai
Not benchmarked $4.00 No run cost
GLM 5.3 FlashXZ.ai
Not benchmarked $1.25 No run cost
GLM 5.3 PrimeZ.ai
Not benchmarked $8.80 No run cost

How the index is weighted

Each benchmark result is rescaled to 0 to 100 and averaged with these weights. When a model lacks a benchmark, the remaining weights are renormalized, so it is not punished with zeros. Models sort by index; on a tie, the one with more benchmarks goes first.

Read the methodology

Benchmarks in the Vibe Coding Index and the weight of each
Benchmark Weight
Aider polyglot pass rate 35%
SWE-bench Verified resolved rate 30%
LiveBench coding score 20%
WebDev Arena Elo 15%