| Benchmark | Description | Gemini 3.8 Flash | Gemini 3.7 Flash | Claude Opus 5 | Claude Sonnet 5 | GPT-5.6 Sol | GPT-5.6 Terra | |
|---|---|---|---|---|---|---|---|---|
| Input price | $/1M tokens, no caching | Lower is better | $0.75 ($1.50 regular) | $0.75 ($1.50 regular) | $5.00 | $2.00 | $4.00 | $2.00 |
| Output price | $/1M tokens | Lower is better | $3.75 ($7.50 regular) | $3.75 ($7.50 regular) | $25.00 | $10.00 | $20.00 | $12.00 |
| DeepSWE v1.1 | Long-horizon software engineering | 73.7% | 65.3% | 74.0% | 53.8% | 72.7% | 69.6% | |
| GDPval-AA v2 | Knowledge work | 1,545 | 1,482 | 1,824 | 1,584 | 1,710 | 1,528 | |
| Vals Finance Agent v2 | Financial analyst tasks | 61.4% | 59.0% | 58.6% | 53.9% | 53.8% | 54.4% | |
| Harvey's Legal Agent Benchmark | Complex legal workflows | 10.0% | 8.8% | 6.7% | 5.0% | 2.5% | 0.8% | |
| Terminal-Bench 2.1 | Agentic terminal coding | 89.4% | 85.8% | 89.1% | 80.4% | 88.8% | 87.4% | |
| Terminal-Bench 4.0 | General agent capabilities | 19.1% | 11.2% | 51.8% | 12.4% | 37.3% | 23.6% | |
| GDP.PDF | Expert PDF document comprehension | 35.0% | 34.0% | 37.0% | 28.0% | 40.0% | 29.0% | |
| CharXiv Reasoning | Information synthesis from complex charts |
86.2% | 84.5% | 83.7% | 70.1% | 85.8% | 85.9% | |
| LVBench | Long video understanding | Agentic Static |
87.8% (agentic) 87.1% (static) |
85.4% | 75.4% | 68.5% | 82.1% | 78.9% |
| HLE-Verified | Multidisciplinary expert reasoning | 54.9% | 53.6% | 54.4% | 31.0% | 54.5% | 51.1% | |
| OSWorld-2.0 | Agentic computer use | 59.0% | 50.6% | 75.4% | 42.6% | 62.6% | 50.2% | |
| BioMysteryBench | Bioinformatics research workflows | Overall Human difficult |
88.8% 56.5% |
87.1% 43.5% |
90.1% 49.4% |
87.5% 34.1% |
79.5% 44.7% |
83.8% 49.4% |
| LABBench2 | Biology real-world research tasks | 86.2% | 82.1% | 84.2% | 80.1% | 82.1% | 81.2% |