---
title: "Anthropic's large language models"
source: "https://systems-analysis.info/eng/Anthropic's_large_language_models"
wiki: "systems-analysis.info/eng"
article: "Anthropic's_large_language_models"
language: "en"
categories:
  - "Category:Anthropic"
  - "Category:English"
  - "Category:Large language models"
  - "Category:LLM families"
  - "Category:Machine learning"
  - "Category:Technology"
revision_id: 67
wiki_created_at: 2026-09-06T22:16:58Z
wiki_modified_at: 2026-09-06T22:16:58Z
downloaded_at: 2026-09-07T22:20:46Z
---

# Anthropic's large language models

**Anthropic's large language models** are a family of [large language models](https://systems-analysis.info/eng/Large_language_model "Large language model") developed by the American artificial intelligence company **<a href="https://www.anthropic.com/" class="external text" rel="nofollow">Anthropic</a>** and released under the name **[Claude](https://systems-analysis.info/eng/Claude_(Anthropic) "Claude (Anthropic)")**. The first Claude models were made publicly available on March 14, 2023, and the family has since grown into a tiered lineup used for conversation, writing, coding, reasoning, agentic workflows, computer use, vision, and long-context tasks.

Claude models are trained using **[constitutional AI](https://systems-analysis.info/eng/Constitutional_AI "Constitutional AI")**, a method Anthropic developed to make models more helpful and harmless without relying primarily on large-scale human feedback. Beginning with the Claude 3 generation in March 2024, each generation has typically been released in three size tiers, ordered from fastest and least expensive to most capable: **Haiku**, **Sonnet**, and **Opus**. In June 2026, Anthropic introduced the **Mythos-class** tier above Opus, comprising the generally available Fable 5 and the restricted-access Mythos 5, which share a single underlying model.

## Models

| No. | Date       | Model                   | Type    | Note                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                | Source                                                                                                                   | System / Model Card                                                                                                                                                                               |
|-----|------------|-------------------------|---------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 1   | 2023-03-14 | Claude                  | Claude  | First public Claude assistant; offered together with Claude Instant.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                | <a href="https://www.anthropic.com/news/introducing-claude" class="external text" rel="nofollow">Anthropic</a>           | —                                                                                                                                                                                                 |
| 2   | 2023-03-14 | Claude Instant          | Instant | Faster, lighter, lower-cost version of the first public Claude assistant.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           | <a href="https://www.anthropic.com/news/introducing-claude" class="external text" rel="nofollow">Anthropic</a>           | —                                                                                                                                                                                                 |
| 3   | 2023-04    | Claude 1.3              | Claude  | Later first-generation Claude model; used as the comparison baseline for Claude 2.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | <a href="https://www.anthropic.com/news/claude-2" class="external text" rel="nofollow">Anthropic</a>                     | <a href="https://www.anthropic.com/claude-2-model-card" class="external text" rel="nofollow">Claude 2 Model Card</a>                                                                              |
| 4   | 2023-07-11 | Claude 2                | Claude  | Second-generation Claude model with improved coding, math, reasoning, longer responses, and 100K-token context.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | <a href="https://www.anthropic.com/news/claude-2" class="external text" rel="nofollow">Anthropic</a>                     | <a href="https://www.anthropic.com/claude-2-model-card" class="external text" rel="nofollow">Claude 2 Model Card</a>                                                                              |
| 5   | 2023-08-09 | Claude Instant 1.2      | Instant | Updated Claude Instant model with improved math, coding, reasoning, safety, and structured responses.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | <a href="https://www.anthropic.com/news/releasing-claude-instant-1-2" class="external text" rel="nofollow">Anthropic</a> | —                                                                                                                                                                                                 |
| 6   | 2023-11-21 | Claude 2.1              | Claude  | Claude 2 update with a 200K-token context window, lower hallucination rates, system prompts, and beta tool use.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | <a href="https://www.anthropic.com/news/claude-2-1" class="external text" rel="nofollow">Anthropic</a>                   | <a href="https://www.anthropic.com/claude-2-model-card" class="external text" rel="nofollow">Claude 2 Model Card</a>                                                                              |
| 7   | 2024-03-04 | Claude 3 Opus           | Opus    | Most capable model in the Claude 3 family.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          | <a href="https://www.anthropic.com/news/claude-3-family" class="external text" rel="nofollow">Anthropic</a>              | <a href="https://assets.anthropic.com/m/61e7d27f8c8f5919/original/Claude-3-Model-Card.pdf" class="external text" rel="nofollow">Claude 3 Model Card</a>                                           |
| 8   | 2024-03-04 | Claude 3 Sonnet         | Sonnet  | Mid-tier Claude 3 model balancing intelligence and speed.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           | <a href="https://www.anthropic.com/news/claude-3-family" class="external text" rel="nofollow">Anthropic</a>              | <a href="https://assets.anthropic.com/m/61e7d27f8c8f5919/original/Claude-3-Model-Card.pdf" class="external text" rel="nofollow">Claude 3 Model Card</a>                                           |
| 9   | 2024-03-13 | Claude 3 Haiku          | Haiku   | Fastest and lowest-cost model in the Claude 3 family.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | <a href="https://www.anthropic.com/news/claude-3-haiku" class="external text" rel="nofollow">Anthropic</a>               | <a href="https://assets.anthropic.com/m/61e7d27f8c8f5919/original/Claude-3-Model-Card.pdf" class="external text" rel="nofollow">Claude 3 Model Card</a>                                           |
| 10  | 2024-06-20 | Claude 3.5 Sonnet       | Sonnet  | First Claude 3.5 model; higher intelligence than Claude 3 Opus with Sonnet-tier speed and cost.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | <a href="https://www.anthropic.com/news/claude-3-5-sonnet" class="external text" rel="nofollow">Anthropic</a>            | <a href="https://www-cdn.anthropic.com/fed9cc193a14b84131812372d8d5857f8f304c52/Model_Card_Claude_3_Addendum.pdf" class="external text" rel="nofollow">Claude 3.5 Sonnet Model Card Addendum</a>  |
| 11  | 2024-10-22 | Claude 3.5 Sonnet (new) | Sonnet  | Upgraded Claude 3.5 Sonnet with improved coding, tool use, and computer-use capability.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             | <a href="https://www.anthropic.com/news/3-5-models-and-computer-use" class="external text" rel="nofollow">Anthropic</a>  | <a href="https://www-cdn.anthropic.com/c7822cdc35ad788ec87e14b3a9d45010f1f86c38.pdf" class="external text" rel="nofollow">Claude 3.5 Haiku and Upgraded Claude 3.5 Sonnet Model Card Addendum</a> |
| 12  | 2024-10-22 | Claude 3.5 Haiku        | Haiku   | Faster and cheaper Claude 3.5-family model.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         | <a href="https://www.anthropic.com/news/3-5-models-and-computer-use" class="external text" rel="nofollow">Anthropic</a>  | <a href="https://www-cdn.anthropic.com/c7822cdc35ad788ec87e14b3a9d45010f1f86c38.pdf" class="external text" rel="nofollow">Claude 3.5 Haiku and Upgraded Claude 3.5 Sonnet Model Card Addendum</a> |
| 13  | 2025-02-24 | Claude 3.7 Sonnet       | Sonnet  | First hybrid reasoning Claude model, with standard and extended-thinking modes.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | <a href="https://www.anthropic.com/news/claude-3-7-sonnet" class="external text" rel="nofollow">Anthropic</a>            | <a href="https://www-cdn.anthropic.com/9ff93dfa8f445c932415d335c88852ef47f1201e.pdf" class="external text" rel="nofollow">Claude 3.7 Sonnet System Card</a>                                       |
| 14  | 2025-05-22 | Claude Opus 4           | Opus    | Opus-class hybrid reasoning model for coding, advanced reasoning, and long-running agent workflows.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | <a href="https://www.anthropic.com/news/claude-4" class="external text" rel="nofollow">Anthropic</a>                     | <a href="https://www-cdn.anthropic.com/07b2a3f9902ee19fe39a36ca638e5ae987bc64dd.pdf" class="external text" rel="nofollow">Claude 4 System Card</a>                                                |
| 15  | 2025-05-22 | Claude Sonnet 4         | Sonnet  | Sonnet-class hybrid reasoning model; upgrade from Claude 3.7 Sonnet.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                | <a href="https://www.anthropic.com/news/claude-4" class="external text" rel="nofollow">Anthropic</a>                     | <a href="https://www-cdn.anthropic.com/07b2a3f9902ee19fe39a36ca638e5ae987bc64dd.pdf" class="external text" rel="nofollow">Claude 4 System Card</a>                                                |
| 16  | 2025-08-05 | Claude Opus 4.1         | Opus    | Incremental upgrade to Claude Opus 4 with improvements in agentic tasks, coding, and reasoning.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | <a href="https://www.anthropic.com/news/claude-opus-4-1" class="external text" rel="nofollow">Anthropic</a>              | <a href="https://www-cdn.anthropic.com/9fa30625273bafdf5af82c93719d7ca606485a16.pdf" class="external text" rel="nofollow">Claude Opus 4.1 System Card</a>                                         |
| 17  | 2025-09-29 | Claude Sonnet 4.5       | Sonnet  | Sonnet model focused on coding, complex agents, computer use, reasoning, and math.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | <a href="https://www.anthropic.com/news/claude-sonnet-4-5" class="external text" rel="nofollow">Anthropic</a>            | <a href="https://www.anthropic.com/claude-sonnet-4-5-system-card" class="external text" rel="nofollow">Claude Sonnet 4.5 System Card</a>                                                          |
| 18  | 2025-10-15 | Claude Haiku 4.5        | Haiku   | Fast, cost-efficient Haiku model with near-frontier performance.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    | <a href="https://www.anthropic.com/news/claude-haiku-4-5" class="external text" rel="nofollow">Anthropic</a>             | <a href="https://www-cdn.anthropic.com/7aad69bf12627d42234e01ee7c36305dc2f6a970.pdf" class="external text" rel="nofollow">Claude Haiku 4.5 System Card</a>                                        |
| 19  | 2025-11-24 | Claude Opus 4.5         | Opus    | Opus model for coding, agents, computer use, deep research, spreadsheets, and slides.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               | <a href="https://www.anthropic.com/news/claude-opus-4-5" class="external text" rel="nofollow">Anthropic</a>              | <a href="https://www.anthropic.com/claude-opus-4-5-system-card" class="external text" rel="nofollow">Claude Opus 4.5 System Card</a>                                                              |
| 20  | 2026-02-05 | Claude Opus 4.6         | Opus    | Opus upgrade with stronger coding, cybersecurity investigation, long-running agentic work, and 1M-token context in beta.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            | <a href="https://www.anthropic.com/news/claude-opus-4-6" class="external text" rel="nofollow">Anthropic</a>              | <a href="https://www.anthropic.com/claude-opus-4-6-system-card" class="external text" rel="nofollow">Claude Opus 4.6 System Card</a>                                                              |
| 21  | 2026-02-17 | Claude Sonnet 4.6       | Sonnet  | Sonnet upgrade across coding, computer use, long-context reasoning, agent planning, knowledge work, and design.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     | <a href="https://www.anthropic.com/news/claude-sonnet-4-6" class="external text" rel="nofollow">Anthropic</a>            | <a href="https://www.anthropic.com/claude-sonnet-4-6-system-card" class="external text" rel="nofollow">Claude Sonnet 4.6 System Card</a>                                                          |
| 22  | 2026-04-07 | Claude Mythos Preview   | Mythos  | Invitation-only research-preview model for defensive cybersecurity workflows through Project Glasswing.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             | <a href="https://www.anthropic.com/glasswing" class="external text" rel="nofollow">Anthropic</a>                         | <a href="https://www.anthropic.com/claude-mythos-preview-system-card" class="external text" rel="nofollow">Claude Mythos Preview System Card</a>                                                  |
| 23  | 2026-04-16 | Claude Opus 4.7         | Opus    | Opus-tier upgrade over Opus 4.6 with stronger coding, vision, and long-running professional work.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | <a href="https://www.anthropic.com/news/claude-opus-4-7" class="external text" rel="nofollow">Anthropic</a>              | <a href="https://www.anthropic.com/claude-opus-4-7-system-card" class="external text" rel="nofollow">Claude Opus 4.7 System Card</a>                                                              |
| 24  | 2026-05-28 | Claude Opus 4.8         | Opus    | Opus-tier upgrade for complex reasoning, long-horizon agentic coding, and high-autonomy work.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       | <a href="https://www.anthropic.com/news/claude-opus-4-8" class="external text" rel="nofollow">Anthropic</a>              | <a href="https://www.anthropic.com/claude-opus-4-8-system-card" class="external text" rel="nofollow">Claude Opus 4.8 System Card</a>                                                              |
| 25  | 2026-06-09 | Claude Fable 5          | Fable   | Mythos-class model made available for general use with additional safeguards. Access to the Mythos-class models (Fable 5 and Mythos 5) was suspended on 2026-06-12 under a U.S. government export-control directive; the models were not deprecated or retired. The U.S. Department of Commerce lifted the export controls on 2026-06-30, and Anthropic began restoring Fable 5 globally on 2026-07-01 (<a href="https://www.anthropic.com/news/fable-mythos-access" class="external text" rel="nofollow">Anthropic statement</a>).                                                                                                                 | <a href="https://www.anthropic.com/news/claude-fable-5-mythos-5" class="external text" rel="nofollow">Anthropic</a>      | <a href="https://www.anthropic.com/claude-fable-5-mythos-5-system-card" class="external text" rel="nofollow">Claude Fable 5 and Mythos 5 System Card</a>                                          |
| 26  | 2026-06-09 | Claude Mythos 5         | Mythos  | Limited-availability Mythos-class model through Project Glasswing; same underlying model class as Fable 5 with different safeguards/access. Access to both Mythos-class models was suspended on 2026-06-12 under a U.S. government export-control directive. The export controls were lifted on 2026-06-30; Mythos 5 access is being restored to a set of approved U.S. organizations (following U.S. government approval on 2026-06-26), with Anthropic continuing to work to expand access through Project Glasswing (<a href="https://www.anthropic.com/news/fable-mythos-access" class="external text" rel="nofollow">Anthropic statement</a>). | <a href="https://www.anthropic.com/news/claude-fable-5-mythos-5" class="external text" rel="nofollow">Anthropic</a>      | <a href="https://www.anthropic.com/claude-fable-5-mythos-5-system-card" class="external text" rel="nofollow">Claude Fable 5 and Mythos 5 System Card</a>                                          |
| 27  | 2026-06-30 | Claude Sonnet 5         | Sonnet  | Sonnet 5 model for coding, agents, and professional work at scale.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | <a href="https://www.anthropic.com/news/claude-sonnet-5" class="external text" rel="nofollow">Anthropic</a>              | <a href="https://www.anthropic.com/claude-sonnet-5-system-card" class="external text" rel="nofollow">Claude Sonnet 5 System Card</a>                                                              |

## Benchmarks

| No. | Date                   | Model                   | Type<sup>a</sup> | [MMLU](https://systems-analysis.info/eng/MMLU_Benchmark "MMLU Benchmark")<sup>b</sup> | [GSM8K](https://systems-analysis.info/eng/GSM8K_(Grade_School_Math_8K) "GSM8K (Grade School Math 8K)") | [HumanEval](https://systems-analysis.info/eng/HumanEval_Benchmark "HumanEval Benchmark") | [MATH](https://systems-analysis.info/eng/MATH_Benchmark "MATH Benchmark") | [GPQA-D](https://systems-analysis.info/eng/GPQA_Diamond_Benchmark "GPQA Diamond Benchmark")<sup>c</sup> | MMMU | SWE-V<sup>d</sup> | SWE-Pro<sup>e</sup> |
|-----|------------------------|-------------------------|------------------|---------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------|---------------------------------------------------------------------------|---------------------------------------------------------------------------------------------------------|------|-------------------|---------------------|
| 1   | 2023-03-14             | Claude                  | Claude           |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      |                   |                     |
| 2   | 2023-03-14             | Claude Instant          | Instant          |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      |                   |                     |
| 3   | 2023-04                | Claude 1.3              | Claude           | 77.0<sup>f</sup>                                                                      | 85.2                                                                                                   | 56.0                                                                                     |                                                                           |                                                                                                         |      |                   |                     |
| 4   | 2023-07-11             | Claude 2                | Claude           | 78.5                                                                                  | 88.0                                                                                                   | 71.2                                                                                     |                                                                           |                                                                                                         |      |                   |                     |
| 5   | 2023-08-09             | Claude Instant 1.2      | Instant          |                                                                                       | 86.7                                                                                                   | 58.7                                                                                     |                                                                           |                                                                                                         |      |                   |                     |
| 6   | 2023-11-21             | Claude 2.1              | Claude           |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      |                   |                     |
| 7   | 2024-03-04             | Claude 3 Opus           | Opus             | 86.8                                                                                  | 95.0                                                                                                   | 84.9                                                                                     | 60.1                                                                      | 50.4                                                                                                    | 59.4 |                   |                     |
| 8   | 2024-03-04             | Claude 3 Sonnet         | Sonnet           | 79.0                                                                                  | 92.3                                                                                                   | 73.0                                                                                     | 43.1                                                                      | 40.4                                                                                                    | 53.1 |                   |                     |
| 9   | 2024-03-13             | Claude 3 Haiku          | Haiku            | 75.2                                                                                  | 88.9                                                                                                   | 75.9                                                                                     | 38.9                                                                      | 33.3                                                                                                    | 50.2 |                   |                     |
| 10  | 2024-06-20<sup>g</sup> | Claude 3.5 Sonnet       | Sonnet           | 88.7                                                                                  | 96.4                                                                                                   | 92.0                                                                                     | 71.1                                                                      | 59.4                                                                                                    | 68.3 | 33.4<sup>h</sup>  |                     |
| 11  | 2024-10-22             | Claude 3.5 Sonnet (new) | Sonnet           | 88.7                                                                                  |                                                                                                        | 93.7                                                                                     | 78.3                                                                      | 65.0                                                                                                    | 70.4 | 49.0              |                     |
| 12  | 2024-10-22             | Claude 3.5 Haiku        | Haiku            | 77.6                                                                                  |                                                                                                        | 88.1                                                                                     | 69.2                                                                      | 41.6                                                                                                    |      | 40.6              |                     |
| 13  | 2025-02-24             | Claude 3.7 Sonnet       | Sonnet           |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      | 62.3<sup>i</sup>  |                     |
| 14  | 2025-05-22             | Claude Opus 4           | Opus             |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      | 72.5<sup>j</sup>  |                     |
| 15  | 2025-05-22             | Claude Sonnet 4         | Sonnet           |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      | 72.7<sup>j</sup>  |                     |
| 16  | 2025-08-05             | Claude Opus 4.1         | Opus             |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      | 74.5              |                     |
| 17  | 2025-09-29             | Claude Sonnet 4.5       | Sonnet           |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      | 77.2<sup>k</sup>  |                     |
| 18  | 2025-10-15             | Claude Haiku 4.5        | Haiku            |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      | 73.3              |                     |
| 19  | 2025-11-24             | Claude Opus 4.5         | Opus             |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         | 80.7 | 80.9<sup>l</sup>  |                     |
| 20  | 2026-02-05             | Claude Opus 4.6         | Opus             |                                                                                       |                                                                                                        |                                                                                          |                                                                           | 91.3                                                                                                    |      | 80.8<sup>l</sup>  | 53.4                |
| 21  | 2026-02-17             | Claude Sonnet 4.6       | Sonnet           |                                                                                       |                                                                                                        |                                                                                          |                                                                           | 89.9                                                                                                    |      | 79.6              | 58.1                |
| 22  | 2026-04-07             | Claude Mythos Preview   | Mythos           |                                                                                       |                                                                                                        |                                                                                          |                                                                           | 94.6                                                                                                    |      | 93.9              | 77.8                |
| 23  | 2026-04-16             | Claude Opus 4.7         | Opus             |                                                                                       |                                                                                                        |                                                                                          |                                                                           | 94.2                                                                                                    |      | 87.6<sup>m</sup>  | 64.3                |
| 24  | 2026-05-28             | Claude Opus 4.8         | Opus             |                                                                                       |                                                                                                        |                                                                                          |                                                                           | 93.6<sup>n</sup>                                                                                        |      | 88.6              | 69.2                |
| 25  | 2026-06-09             | Claude Fable 5          | Fable            |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      | 95.0<sup>o</sup>  | 80.0                |
| 26  | 2026-06-09             | Claude Mythos 5         | Mythos           |                                                                                       |                                                                                                        |                                                                                          |                                                                           | 94.1<sup>q</sup>                                                                                        |      | 95.5<sup>o</sup>  | 80.3                |
| 27  | 2026-06-30             | Claude Sonnet 5         | Sonnet           |                                                                                       |                                                                                                        |                                                                                          |                                                                           |                                                                                                         |      | 85.2<sup>p</sup>  | 63.2<sup>p</sup>    |

**Table notes**

- <sup>a</sup> Tiers follow Anthropic's naming. Before Claude 3 there were no named tiers: "Claude" is the flagship line (Claude 1/2), "Instant" the fast, low-cost line (retrospectively the Haiku lineage). From Claude 3 on, the family splits into Haiku, Sonnet and Opus. "Mythos" and "Fable" form the Mythos-class tier above Opus; Fable 5 and Mythos 5 share one underlying model.
- <sup>b</sup> Early-era figures (rows 3–12) are Anthropic's own, from model cards/addenda; settings differ by benchmark and generation. MMLU: 5-shot CoT for Claude 1.3 and Claude 2 (rows 3–4), plain 5-shot (not the higher 5-shot CoT variant) for the Claude 3 and Claude 3.5 rows (7–12). GSM8K is shown only where Anthropic reported it and uses 0-shot CoT; the October 2024 Claude 3.5 addendum reports MGSM rather than GSM8K, so the GSM8K cells for rows 11–12 are left blank. HumanEval (Codex): 0-shot. MATH: 0-shot for Claude 3 (rows 7–9), 0-shot CoT for the Claude 3.5 rows (10–12). GPQA-D: 0-shot CoT. MMMU: validation split, 0-shot with chain-of-thought where reported — for rows 10–11, but not for Claude 3.5 Haiku (row 12), which launched text-only. See the Claude 2 model card, the Claude 3 model card, and the June/October Claude 3.5 addenda for exact settings.
- <sup>c</sup> Modern GPQA-D figures (rows 20–24 and 26, where reported) were run under newer Anthropic evaluation settings, often with adaptive/extended thinking at high or max effort, and are not directly comparable to the 0-shot CoT figures in earlier rows. Anthropic notes that GPQA-D has become saturated for top models.
- <sup>d</sup> SWE-V figures are Anthropic-reported and generally use Anthropic's simple SWE-bench scaffold (bash + string-replacement file editing) on the full 500-problem set. Trials, prompt additions, context length, thinking budget, and high-/adaptive-compute settings vary by release (see row-specific notes); they are not comparable to independent leaderboards (e.g. vals.ai), which use a different harness.
- <sup>e</sup> SWE-Pro (SWE-bench Pro, Scale AI) is a harder set. Figures shown are from Anthropic's own harness; on Scale's standardized leaderboard the same models score markedly lower (e.g. Opus 4.6 ≈ 47–52%).
- <sup>f</sup> Row 3 (Claude 1.3) figures come from the comparison table in the Claude 2 model card, where "Claude 1.3" is a named column.
- <sup>g</sup> The API snapshot ID is claude-3-5-sonnet-20240620 (June 20, 2024); Anthropic's announcement page is dated June 21, 2024. This table uses the snapshot date.
- <sup>h</sup> 33.4 (Claude 3.5 Sonnet) is the June 2024 release figure. The upgraded version (Oct 2024, row 11) scores 49.0.
- <sup>i</sup> 62.3 (Claude 3.7 Sonnet) is on the full 500-problem set. On the n=489 subset: 63.7 without a scaffold pass and 70.3 with one.
- <sup>j</sup> 72.5 / 72.7 (Opus 4 / Sonnet 4) are standard mode. In "high compute" (parallel attempts plus internal candidate selection): 79.4 / 80.2.
- <sup>k</sup> 77.2 (Sonnet 4.5) is standard mode, 200K context, averaged over 10 trials, no test-time compute. "High compute" gives 82.0; the 1M configuration gives 78.2.
- <sup>l</sup> 80.9 / 80.8 (Opus 4.5 / Opus 4.6) are both Anthropic figures but under different configs: 4.5 with no thinking budget, averaged over 5 trials; 4.6 with adaptive thinking, max effort, averaged over 25 trials (exactly 80.84; 81.42 with a prompt modification). The ~0.1 difference is noise, not a regression.
- <sup>m</sup> 87.6 (Opus 4.7) is from Anthropic's system card; independent vals.ai reports 82.0. The jump over Opus 4.6 largely reflects a grader change, not only the model.
- <sup>n</sup> 93.6 (Opus 4.8) — the benchmark is saturated (~93–94% for top models) and differences are within statistical noise; this cell may also be left blank.
- <sup>o</sup> Fable 5 and Mythos 5 share the same underlying model but are reported separately in the system card: Fable 5's public safeguards route high-risk requests to a Claude Opus 4.8 fallback, which slightly lowers its measured scores. On SWE-bench Verified / SWE-bench Pro, Fable 5 scores 95.0 / 80.0 and Mythos 5 scores 95.5 / 80.3. Anthropic's combined launch chart ("Claude Mythos 5 / Fable 5") shows the higher Mythos-class figure (80.3).
- <sup>p</sup> The Claude Sonnet 5 system card reports SWE-bench Verified = 85.2 and SWE-bench Pro = 63.2, averaged over five trials with Anthropic's standard SWE-bench configuration. Anthropic's comparison for the Pro figure is Opus 4.8's 69.2.
- <sup>q</sup> Claude Mythos 5 scored 94.1% on GPQA Diamond in the Fable 5 / Mythos 5 system card. Anthropic did not publish a separate Fable 5 GPQA-D figure and describes the benchmark as saturated, stating it plans to stop reporting future performance on it.

## External links

- <a href="https://www.anthropic.com/claude" class="external text" rel="nofollow">Claude</a> – official product page
- <a href="https://platform.claude.com/docs/en/about-claude/models/overview" class="external text" rel="nofollow">Claude models overview</a> – Anthropic developer documentation
- <a href="https://www.anthropic.com/news" class="external text" rel="nofollow">Anthropic News</a> – official model announcements
- <a href="https://platform.claude.com/docs/en/about-claude/model-deprecations" class="external text" rel="nofollow">Claude model deprecations</a>

## See also

- [Large language model](https://systems-analysis.info/eng/Large_language_model "Large language model")
- [Claude (Anthropic)](https://systems-analysis.info/eng/Claude_(Anthropic) "Claude (Anthropic)")

## Literature

- Bai, Yuntao; et al. *Constitutional AI: Harmlessness from AI Feedback*. Anthropic, 2022.
- Jimenez, Carlos E.; et al. *SWE-bench: Can Language Models Resolve Real-World GitHub Issues?*. ICLR, 2024.
