Enter opens the highlighted result. Esc closes.

AutomationBench-AA leaderboard

As of November 22, 2026, among the results listed here, Google Gemini 4 Hydrogen has the highest reported AutomationBench-AA score, 76.1%, published by Google on November 12, 2026, ahead of Qwen4 Max at 72.5%. 5 models have a AutomationBench-AA result in our records.

Scores as the model makers published them, not re-run by us; each row links to its announcement.

Best reported score

76.1%

Google Gemini 4 Hydrogen

Reported by Google, November 12, 2026

Runner-up

72.5%

Qwen4 Max

Reported by Qwen, August 3, 2026

5 models ranked · 4 makers

Reported AutomationBench-AA scores

AutomationBench-AA scores reported by model makers
Rank Model Score Setting Reported by Date
1 Gemini 4 Hydrogen 76.1% Not published Google November 12, 2026 · read from the maker's chart
2 Qwen4 Max 72.5% Not published Qwen August 3, 2026 · read from the maker's chart
3 Qwen3.8 Max (0902) 56.2% Not published Qwen August 3, 2026 · read from the maker's chart
4 Step 5 Preview 51.0% High StepFun October 8, 2026 (model release)
5 Solar Mini 4 22.3% Not published Upstage September 23, 2026 (model release)

How much to trust these numbers

Source
Reported by the model makers themselves. Not re-run by LLMBenchmark or anyone independent.
Settings
Settings differ between makers. Check the Setting column before comparing two scores.
Spread
76.1% to 22.3% across 5 models.
Freshness
Newest result published November 12, 2026; oldest August 3, 2026.
Charts
Some values were read from charts in the announcements. Two independent readings had to match exactly.

What AutomationBench-AA measures

AutomationBench-AA appears in the release announcements of Google, Qwen, StepFun, and Upstage. We have not found a public write-up of the benchmark itself yet.