| Benchmark | Description | Gemini 3.1 Pro Thinking (High) |
Gemini 3 Pro Thinking (High) |
Sonnet 4.6 Thinking (Max) |
Opus 4.6 Thinking (Max) |
GPT-5.2 Thinking (High) |
GPT-5.3-Codex Thinking (High) |
|
|---|---|---|---|---|---|---|---|---|
| Humanity’s Last Exam | Academic reasoning (full set, text + MM) |
No tools Search (blocklist) + code execution |
44.4% 51.4% |
37.5% 45.8% |
33.2% 49.0% |
40.0% 53.1% |
34.5% 45.5% |
— — |
| ARC-AGI-2 | Abstract reasoning puzzles | ARC Prize Verified | 77.1% | 31.1% | 58.3% | 68.8% | 52.9% | — |
| GPQA Diamond | Scientific knowledge | No tools | 94.3% | 91.9% | 89.9% | 91.3% | 92.4% | — |
| Terminal-Bench 2.0 | Agentic terminal coding | Terminus-2 harness Other best self-reported harness |
68.5% — |
56.9% — |
59.1% — |
65.4% — |
54.0% 62.2% (Codex) |
64.7% 77.3% (Codex) |
| SWE-Bench Verified | Agentic coding | Single attempt | 80.6% | 76.2% | 79.6% | 80.8% | 80.0% | — |
| SWE-Bench Pro (Public) | Diverse agentic coding tasks | Single attempt | 54.2% | 43.3% | — | — | 55.6% | 56.8% |
| LiveCodeBench Pro | Competitive coding problems from Codeforces, ICPC, and IOI |
Elo Rating | 2,887 | 2,439 | — | — | 2,393 | — |
| SciCode | Scientific research coding | 59% | 56% | 47% | 52% | 52% | — | |
| APEX-Agents | Long-horizon professional tasks | 33.5% | 18.4% | — | 29.8% | 23.0% | — | |
| GDPval-AA Elo | Expert tasks | Elo Rating | 1,317 | 1,195 | 1,633 | 1,606 | 1,462 | — |
| τ2-bench | Agentic tool use | Retail Telecom |
90.8% 99.3% |
85.3% 98.0% |
91.7% 97.9% |
91.9% 99.3% |
82.0% 98.7% |
— — |
| MCP Atlas | Multi-step workflows using MCP |
69.2% | 54.1% | 61.3% | 59.5% | 60.6% | — | |
| BrowseComp | Agentic search | Search + Python + Browse |
85.9% | 59.2% | 74.7% | 84.0% | 65.8% | — |
| MMMU Pro | Multimodal understanding and reasoning |
No tools | 80.5% | 81.0% | 74.5% | 73.9% | 79.5% | — |
| MMMLU | Multilingual Q&A | 92.6% | 91.8% | 89.3% | 91.1% | 89.6% | — | |
| MRCR v2 (B-needle) | Long context performance | 128k (average) 1M (pointwise) |
84.9% 26.3% |
77.0% 26.3% |
84.9% not supported |
84.0% not supported |
83.8% not supported |
— — |