AutomationBench-AA leaderboard
As of November 22, 2026, among the results listed here, Google Gemini 4 Hydrogen has the highest reported AutomationBench-AA score, 76.1%, published by Google on November 12, 2026, ahead of Qwen4 Max at 72.5%. 5 models have a AutomationBench-AA result in our records.
Scores as the model makers published them, not re-run by us; each row links to its announcement.
5 models ranked · 4 makers
| Rank | Model | Score | Setting | Reported by | Date |
|---|---|---|---|---|---|
| 1 | Gemini 4 Hydrogen | 76.1% | Not published | November 12, 2026 · read from the maker's chart | |
| 2 | Qwen4 Max | 72.5% | Not published | Qwen | August 3, 2026 · read from the maker's chart |
| 3 | Qwen3.8 Max (0902) | 56.2% | Not published | Qwen | August 3, 2026 · read from the maker's chart |
| 4 | Step 5 Preview | 51.0% | High | StepFun | October 8, 2026 (model release) |
| 5 | Solar Mini 4 | 22.3% | Not published | Upstage | September 23, 2026 (model release) |
How much to trust these numbers
- Source
- Reported by the model makers themselves. Not re-run by LLMBenchmark or anyone independent.
- Settings
- Settings differ between makers. Check the Setting column before comparing two scores.
- Spread
- 76.1% to 22.3% across 5 models.
- Freshness
- Newest result published November 12, 2026; oldest August 3, 2026.
- Charts
- Some values were read from charts in the announcements. Two independent readings had to match exactly.
What AutomationBench-AA measures
AutomationBench-AA appears in the release announcements of Google, Qwen, StepFun, and Upstage. We have not found a public write-up of the benchmark itself yet.