SWE-bench Multimodal leaderboard
- o3 leads
- 36.0%
- models measured
- 4
- lead over #2
- +2.1 pts
- median
- 32.5%
Leader on SWE-bench Multimodal · read October 21
# SWE-bench Multimodal, read October 21
leaders = {
"o3": 36.0%, "o4 Mini": 33.9%, "GPT-4.1": 31.1%,
}
On October 21, 2026, 4 of our catalog's models had a SWE-bench Multimodal result, and OpenAI o3 led with 36.0%.
GitHub issues from JavaScript projects with a visual side, such as web interfaces and charting libraries, where the issue comes with images. The number is the share of issues resolved, as swebench.com publishes it.
Role in the index
A coding board we show beside the Vibe Coding Index, not inside it: the index keeps the four boards it was defined on, so a score does not move every time a board is added. Read the methodology
| # | Model | Result | Evidence | Coding index | Output $/Mtok |
|---|---|---|---|---|---|
| 1 | o3OpenAI | 36.0% | 70.7 | $8.00 | |
| 2 | o4 MiniOpenAI | 33.9% | 68.6 | $4.40 | |
| 3 | GPT-4.1OpenAI | 31.1% | 46.5 | $8.00 | |
| 4 | GPT-4oOpenAI | 30.4% | 38.8 | $10.00 |
Only models in our catalog are listed, and each appears once with its best published run. 38 rows were read from the source on October 21, 2026, and rows that match no catalog model are left out.