---
title: "Jamba (language model)"
source: "https://systems-analysis.info/eng/Jamba_(language_model)"
wiki: "systems-analysis.info/eng"
article: "Jamba_(language_model)"
language: "en"
categories:
  - "Category:English"
  - "Category:Large language models"
  - "Category:LLM families"
  - "Category:Machine learning"
  - "Category:Technology"
revision_id: 196
wiki_created_at: 2026-09-06T22:18:45Z
wiki_modified_at: 2026-09-06T22:18:45Z
downloaded_at: 2026-09-07T22:21:46Z
---

# Jamba (language model)

**Jamba** is a family of [large language models](https://systems-analysis.info/eng/Large_language_model "Large language model") (LLMs) developed by the Israeli research company AI21 Labs. Jamba introduced one of the first production-grade **hybrid architectures** that combines key elements from two dominant approaches in AI development: [Transformers](https://systems-analysis.info/eng/Transformer_architecture "Transformer architecture") and State Space Models (SSMs), specifically the Mamba architecture<sup>[\[1\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-announcement-1)</sup>.

Jamba's primary goal is to address a fundamental trade-off in modern LLMs: the high quality and performance (characteristic of Transformers) versus the efficiency and ability to process ultra-long contexts (characteristic of SSMs). By combining these approaches and adding sparsity through [Mixture-of-Experts (MoE)](https://systems-analysis.info/eng/Mixture-of-Experts_(MoE) "Mixture-of-Experts (MoE)"), Jamba offers a model that is simultaneously powerful, efficient, and capable of handling vast amounts of text in a single query. Since the first release in March 2024, AI21 Labs has extended the family with several generations, from the large enterprise models (up to Jamba 1.7) to compact models such as Jamba Reasoning 3B and the Jamba2 family released in January 2026<sup>[\[2\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-reasoning-3b-2)[\[3\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba2-3)</sup>.

## Jamba's Architecture in Detail

Jamba does not simply alternate between Transformer and Mamba layers. It employs a meticulously designed **block structure**, where each block consists of eight layers. Every layer combines a sequence-mixing component — either an attention (Transformer) block or a Mamba block — with a feed-forward (MLP) component<sup>[\[4\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba-4)</sup>.

Two independent design axes define the released model:

- **Attention-to-Mamba ratio (1:7):** Of the eight layers in a block, one uses an attention (Transformer) mixer, responsible for "deep" understanding and precise recall, while the other seven use Mamba mixers, responsible for efficient sequence processing across a long context. This asymmetric split lets the model perform the heavy but powerful attention operations less frequently and the lightweight, fast Mamba operations more often<sup>[\[4\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba-4)</sup>.
- **MoE frequency (every other layer):** Independently of the ratio above, the feed-forward component is replaced by a [Mixture-of-Experts (MoE)](https://systems-analysis.info/eng/Mixture-of-Experts_(MoE) "Mixture-of-Experts (MoE)") module in every second layer<sup>[\[4\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba-4)[\[5\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-nvidia-jamba15-5)</sup>.

### Mixture-of-Experts (MoE) Integration

Jamba uses the MoE architecture to increase total model capacity without a matching increase in compute.

- MoE replaces the single feed-forward (MLP) block in every other layer, regardless of whether that layer's mixer is attention or Mamba<sup>[\[4\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba-4)[\[6\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-transformers-doc-jamba-6)</sup>. Because attention layers are rare (one per block), most MoE layers actually sit atop Mamba layers.
- The first Jamba model had **16 experts**.
- For each [token](https://systems-analysis.info/eng/Token_(LLM) "Token (LLM)"), a router network selects the **top 2 experts** (Top-2 gating).

This means that although the model's total parameter count is large (52 billion), only 2 of the 16 experts are active in any given MoE layer during each token's processing, keeping the number of active parameters — and therefore the computation — much smaller.

## Evolution of Jamba Models

### Jamba-v0.1 (March 2024)

The first model introduced in this family has the following specifications:

| Specification                                                                           | Value                                                                                                            |
|-----------------------------------------------------------------------------------------|------------------------------------------------------------------------------------------------------------------|
| **Total Parameters**                                                                    | 52 billion                                                                                                       |
| **Active Parameters**                                                                   | ~12 billion                                                                                                      |
| **Number of Experts (MoE)**                                                             | 16 (2 active)                                                                                                    |
| **[Context Window](https://systems-analysis.info/eng/Context_window "Context window")** | 256,000 tokens                                                                                                   |
| **License**                                                                             | Apache 2.0<sup>[\[7\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba-v0.1-7)</sup> |

Jamba-v0.1 Technical Specifications

Thanks to its hybrid architecture, Jamba-v0.1 can process a context length of 256,000 tokens — equivalent to a novel of several hundred pages — and can be deployed on a single 80 GB GPU (with 8-bit weights)<sup>[\[4\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba-4)</sup>. It was released as a pretrained base model (without instruction tuning) under the Apache 2.0 license, so that the community could study and build on the new architecture<sup>[\[4\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba-4)</sup>.

### Jamba-Instruct (May 2024)

In May 2024, AI21 released **Jamba-Instruct**, an instruction-tuned version of the base model aligned for commercial use, with the same 256K context window. Unlike the rest of the family, it was offered only as a hosted model through AI21 Studio and cloud partners, without open weights, and was later superseded by the Jamba 1.5 family<sup>[\[8\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba-instruct-8)</sup>.

### Jamba 1.5 (August 2024)

In August 2024, AI21 Labs introduced the instruction-tuned Jamba 1.5 family, comprising two versions: **Jamba 1.5 Mini** (12B active parameters out of 52B total) and **Jamba 1.5 Large** (94B active parameters out of 398B total)<sup>[\[9\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-jamba-1.5-family-9)[\[10\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba15-10)</sup>. These models demonstrated significant improvements:

- Up to 2.5 times faster inference on long contexts compared to models of comparable size.
- Support for nine languages: English, Spanish, French, Portuguese, Italian, Dutch, German, Arabic, and Hebrew<sup>[\[11\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba-large-1.5-11)</sup>.

Beginning with this release, the flagship Mini and Large models (versions 1.5 through 1.7) are distributed under the **Jamba Open Model License** (a permissive license allowing research and commercial use under its terms) rather than Apache 2.0<sup>[\[11\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba-large-1.5-11)</sup>.

### Jamba 1.6 (March 2025)

On March 6, 2025, AI21 released **Jamba 1.6** in the same two sizes — Jamba Mini 1.6 (12B active / 52B total) and Jamba Large 1.6 (94B active / 398B total) — retaining the 256K context window and the Jamba Open Model License. AI21 positioned it as the leading open model for private enterprise deployment: it reported that Jamba Large 1.6 outperforms Mistral Large 2, Llama 3.3 70B, and Command R+ on quality, while Jamba Mini 1.6 outperforms Ministral 8B, Llama 3.1 8B, and Command R7B<sup>[\[12\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba16-12)[\[13\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba-large-1.6-13)</sup>.

### Jamba 1.7 (July 2025)

On July 3, 2025, AI21 released **Jamba 1.7** (Jamba Large 1.7 and Jamba Mini 1.7), building on the same hybrid architecture and 256K context window with improvements in grounding (more complete, context-faithful answers) and instruction following, and expanded support for self-hosted deployment<sup>[\[14\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba-large-1.7-14)[\[15\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-changelog-15)</sup>.

### Jamba Reasoning 3B (October 2025)

On October 8, 2025, AI21 released **Jamba Reasoning 3B**, a compact open-source reasoning model built on the same SSM-Transformer architecture and presented as the first in a new series of small Jamba models. Despite its 3-billion-parameter size, it supports a 256K context window (and can handle up to 1 million tokens) and runs on consumer devices such as laptops and phones; according to AI21, it delivers 2–5x efficiency gains and outperforms comparable on-device models from DeepSeek, Google, Meta, and Microsoft, particularly on instruction following (IFBench) and general knowledge (MMLU-Pro, Humanity's Last Exam). Unlike the Jamba 1.5–1.7 models, Jamba Reasoning 3B is released under the Apache 2.0 license<sup>[\[2\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-reasoning-3b-2)[\[16\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba-reasoning-3b-16)</sup>.

### Jamba2 (January 2026)

On January 8, 2026, AI21 introduced the **Jamba2** family — **Jamba2 Mini** (a MoE model with 12B active parameters out of 52B total) and the dense **Jamba2 3B** — compact open models optimized for reliability and steerability in enterprise workloads such as grounded question answering and agentic systems, without the "thinking-token" overhead of reasoning models<sup>[\[3\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba2-3)</sup>. Both models keep the 256K context window and are released under the Apache 2.0 license. They were built by post-training on top of the Jamba 1.5 pre-training base — mid-training on 500 billion curated tokens, a state-passing phase for the Mamba layers, supervised fine-tuning, DPO, and several on-policy reinforcement-learning phases — and, according to AI21, lead their categories on instruction-following (IFBench, IFEval, Collie) and grounding (FACTS) benchmarks<sup>[\[3\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba2-3)[\[17\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba2-mini-17)</sup>. Jamba2 3B, like Jamba Reasoning 3B, runs on consumer devices, including iPhones, Androids, Macs, and PCs<sup>[\[18\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba2-3b-18)</sup>. In the AI21 Studio API, Jamba Mini 2 (snapshot 2026-01) replaced Jamba Mini 1.7, while the flagship Jamba Large remains at version 1.7<sup>[\[19\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-docs-19)</sup>.

## Key Advantages and Performance

- **Massive Context Window:** 256,000 tokens — at the time of its release, the longest context window among production-grade open models and one of the largest among all available models (including proprietary ones). According to the Jamba-1.5 technical report, the Jamba 1.5 models were also the only ones with a confirmed effective context length of 256K on the RULER benchmark<sup>[\[10\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba15-10)</sup>. This makes Jamba well suited to tasks requiring the analysis of large documents, such as legal contracts, scientific papers, entire codebases, or long dialogues<sup>[\[12\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba16-12)</sup>.
- **High Performance and Efficiency:** In benchmarks, Jamba demonstrates performance comparable to or exceeding that of leading open models of a similar size, such as Llama and [Mixtral](https://systems-analysis.info/eng/Mixtral_(Mistral_AI) "Mixtral (Mistral AI)"), while achieving roughly **3 times higher throughput** on long contexts. Its efficiency comes largely from the hybrid design: at a 256K context, the base model needs only about 4 GB for its attention cache, against roughly 32 GB for Mixtral and 128 GB for Llama-2 7B<sup>[\[1\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-announcement-1)[\[4\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba-4)</sup>.
- **Openness and Accessibility:** Jamba is distributed under permissive licenses — Apache 2.0 for Jamba-v0.1, Jamba Reasoning 3B, and the Jamba2 models, and the Jamba Open Model License for the Jamba 1.5, 1.6, and 1.7 models — allowing free use in commercial and research applications. The model weights are available on the [Hugging Face](https://systems-analysis.info/eng/Hugging_Face "Hugging Face") platform<sup>[\[13\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-hf-jamba-large-1.6-13)[\[3\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba2-3)</sup>.

### Benchmark Results

Jamba models show competitive results on various benchmarks:

- **Jamba 1.5 Mini** scored 46.1 on Arena Hard, the strongest open model in its size class at release<sup>[\[9\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-jamba-1.5-family-9)</sup>.
- **Jamba 1.5 Large** scored 65.4 on Arena Hard, outperforming Llama 3.1 70B and 405B<sup>[\[9\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-jamba-1.5-family-9)</sup>.
- The later **Jamba 1.6** improved these figures, with Jamba Large 1.6 scoring 76.5 and Jamba Mini 1.6 scoring 51.2 on Arena Hard, and leading on long-context benchmarks such as CRAG and FinanceBench<sup>[\[12\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba16-12)</sup>.

## Applications and Availability

Jamba is optimized for business applications and supports capabilities such as [function calling](https://systems-analysis.info/eng/Function_calling_(LLM) "Function calling (LLM)"), structured JSON output, grounded generation (RAG), and document processing. The models are available on multiple platforms, including:

- Hugging Face
- Google Cloud Vertex AI
- Microsoft Azure
- NVIDIA API catalog
- Amazon Bedrock<sup>[\[20\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-aws-jamba-1.5-bedrock-20)</sup>
- AI21 Studio

The compact Jamba Reasoning 3B is additionally distributed for local inference via Kaggle, LM Studio, and llama.cpp<sup>[\[2\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-reasoning-3b-2)</sup>.

From Jamba 1.6 onward, AI21 has emphasized private, secure deployment, allowing enterprises to run the models entirely on-premises or in a virtual private cloud (VPC) so that sensitive data is never exposed to the model vendor<sup>[\[12\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-ai21-jamba16-12)</sup>.

To support cost-effective inference, AI21 Labs introduced **ExpertsInt8**, a quantization technique for MoE models that quantizes only the expert (MLP) weights to INT8 and dequantizes them at runtime inside the GPU kernel. It allows Jamba 1.5 Large (and later versions) to be served on a single node with eight 80 GB GPUs, retaining the full 256K-token context without quality loss<sup>[\[10\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-arxiv-jamba15-10)[\[21\]](https://systems-analysis.info/eng/Jamba_(language_model)#cite_note-iclr-jamba15-21)</sup>.

## External links

- <a href="https://www.ai21.com/jamba/" class="external text" rel="nofollow">Official Jamba page — AI21 Labs</a>
- <a href="https://huggingface.co/ai21labs" class="external text" rel="nofollow">AI21 Labs Profile on Hugging Face</a>
- <a href="https://en.wikipedia.org/wiki/Jamba_(language_model)" class="external text" rel="nofollow">Jamba (language model) — Wikipedia</a>
- <a href="https://en.wikipedia.org/wiki/AI21_Labs" class="external text" rel="nofollow">AI21 Labs — Wikipedia</a>

## Literature

- Lieber, O.; et al. (2024). *Jamba: A Hybrid Transformer‑Mamba Language Model*. <a href="https://arxiv.org/abs/2403.19887" class="external text" rel="nofollow">arXiv:2403.19887</a>.
- Jamba Team (2024). *Jamba‑1.5: Hybrid Transformer‑Mamba Models at Scale*. <a href="https://arxiv.org/abs/2408.12570" class="external text" rel="nofollow">arXiv:2408.12570</a>.
- Gu, A.; Dao, T. (2023). *Mamba: Linear‑Time Sequence Modeling with Selective State Spaces*. <a href="https://arxiv.org/abs/2312.00752" class="external text" rel="nofollow">arXiv:2312.00752</a>.
- Gu, A.; Goel, K.; Ré, C. (2021). *Efficiently Modeling Long Sequences with Structured State Spaces (S4)*. <a href="https://arxiv.org/abs/2111.00396" class="external text" rel="nofollow">arXiv:2111.00396</a>.
- Fedus, W.; et al. (2021). *Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity*. <a href="https://arxiv.org/abs/2101.03961" class="external text" rel="nofollow">arXiv:2101.03961</a>.
- Yun, L.; et al. (2024). *Toward Inference‑Optimal Mixture‑of‑Expert Large Language Models*. <a href="https://arxiv.org/abs/2404.02852" class="external text" rel="nofollow">arXiv:2404.02852</a>.
- Cai, W.; et al. (2024). *A Survey on Mixture of Experts in Large Language Models*. <a href="https://arxiv.org/abs/2407.06204" class="external text" rel="nofollow">arXiv:2407.06204</a>.
- Gupta, V.; et al. (2024). *Lynx: Enabling Efficient MoE Inference through Dynamic Batch‑Aware Expert Selection*. <a href="https://arxiv.org/abs/2411.08982" class="external text" rel="nofollow">arXiv:2411.08982</a>.
- Liu, J.; et al. (2024). *A Survey on Inference Optimization Techniques for Mixture of Experts Models*. <a href="https://arxiv.org/abs/2412.14219" class="external text" rel="nofollow">arXiv:2412.14219</a>.
- Hsieh, C.‑P.; et al. (2024). *RULER: What's the Real Context Size of Your Long‑Context Language Models?*. <a href="https://arxiv.org/abs/2404.06654" class="external text" rel="nofollow">arXiv:2404.06654</a>.

## References

1.  <span id="cite_note-ai21-announcement-1">↑ <sup>[1.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-announcement_1-0)</sup> <sup>[1.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-announcement_1-1)</sup> "Introducing Jamba: AI21's Groundbreaking SSM-Transformer Model". *AI21 Labs Blog*. <a href="https://www.ai21.com/blog/announcing-jamba/" class="external autonumber" rel="nofollow">[1]</a></span>
2.  <span id="cite_note-ai21-reasoning-3b-2">↑ <sup>[2.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-reasoning-3b_2-0)</sup> <sup>[2.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-reasoning-3b_2-1)</sup> <sup>[2.2](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-reasoning-3b_2-2)</sup> "Introducing Jamba Reasoning 3B: Tiny Model, Huge Possibilities". *AI21 Labs Blog*. <a href="https://www.ai21.com/blog/introducing-jamba-reasoning-3b/" class="external autonumber" rel="nofollow">[2]</a></span>
3.  <span id="cite_note-ai21-jamba2-3">↑ <sup>[3.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba2_3-0)</sup> <sup>[3.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba2_3-1)</sup> <sup>[3.2](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba2_3-2)</sup> <sup>[3.3](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba2_3-3)</sup> "Introducing Jamba2: The open source model family for enterprise reliability and efficiency". *AI21 Labs Blog*. <a href="https://www.ai21.com/blog/introducing-jamba2/" class="external autonumber" rel="nofollow">[3]</a></span>
4.  <span id="cite_note-arxiv-jamba-4">↑ <sup>[4.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba_4-0)</sup> <sup>[4.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba_4-1)</sup> <sup>[4.2](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba_4-2)</sup> <sup>[4.3](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba_4-3)</sup> <sup>[4.4](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba_4-4)</sup> <sup>[4.5](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba_4-5)</sup> <sup>[4.6](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba_4-6)</sup> Lieber, O., et al. (2024). *Jamba: A Hybrid Transformer-Mamba Language Model*. <a href="https://arxiv.org/abs/2403.19887" class="external text" rel="nofollow">arXiv:2403.19887</a>.</span>
5.  <span id="cite_note-nvidia-jamba15-5">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-nvidia-jamba15_5-0) "Jamba 1.5 LLMs Leverage Hybrid Architecture to Deliver Superior Reasoning and Long Context Handling". *NVIDIA Technical Blog*. <a href="https://developer.nvidia.com/blog/jamba-1-5-llms-leverage-hybrid-architecture-to-deliver-superior-reasoning-and-long-context-handling/" class="external autonumber" rel="nofollow">[4]</a></span>
6.  <span id="cite_note-transformers-doc-jamba-6">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-transformers-doc-jamba_6-0) "Jamba Documentation". *Hugging Face Transformers*. <a href="https://huggingface.co/docs/transformers/model_doc/jamba" class="external autonumber" rel="nofollow">[5]</a></span>
7.  <span id="cite_note-hf-jamba-v0.1-7">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba-v0.1_7-0) "ai21labs/Jamba-v0.1". *Hugging Face*. <a href="https://huggingface.co/ai21labs/Jamba-v0.1" class="external autonumber" rel="nofollow">[6]</a></span>
8.  <span id="cite_note-ai21-jamba-instruct-8">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba-instruct_8-0) "Built for the Enterprise: Introducing AI21's Jamba-Instruct Model". *AI21 Labs Blog*. <a href="https://www.ai21.com/blog/announcing-jamba-instruct/" class="external autonumber" rel="nofollow">[7]</a></span>
9.  <span id="cite_note-jamba-1.5-family-9">↑ <sup>[9.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-jamba-1.5-family_9-0)</sup> <sup>[9.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-jamba-1.5-family_9-1)</sup> <sup>[9.2](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-jamba-1.5-family_9-2)</sup> "Announcing the Jamba-1.5 model family". *AI21 Labs Blog*. <a href="https://www.ai21.com/blog/announcing-jamba-model-family/" class="external autonumber" rel="nofollow">[8]</a></span>
10. <span id="cite_note-arxiv-jamba15-10">↑ <sup>[10.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba15_10-0)</sup> <sup>[10.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba15_10-1)</sup> <sup>[10.2](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-arxiv-jamba15_10-2)</sup> Jamba Team (2024). *Jamba-1.5: Hybrid Transformer-Mamba Models at Scale*. <a href="https://arxiv.org/abs/2408.12570" class="external text" rel="nofollow">arXiv:2408.12570</a>.</span>
11. <span id="cite_note-hf-jamba-large-1.5-11">↑ <sup>[11.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba-large-1.5_11-0)</sup> <sup>[11.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba-large-1.5_11-1)</sup> "ai21labs/AI21-Jamba-Large-1.5". *Hugging Face*. <a href="https://huggingface.co/ai21labs/AI21-Jamba-Large-1.5" class="external autonumber" rel="nofollow">[9]</a></span>
12. <span id="cite_note-ai21-jamba16-12">↑ <sup>[12.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba16_12-0)</sup> <sup>[12.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba16_12-1)</sup> <sup>[12.2](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba16_12-2)</sup> <sup>[12.3](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-jamba16_12-3)</sup> "AI21's Jamba 1.6: The Best Open Model for Private Enterprise Deployment". *AI21 Labs Blog*. <a href="https://www.ai21.com/blog/introducing-jamba-1-6/" class="external autonumber" rel="nofollow">[10]</a></span>
13. <span id="cite_note-hf-jamba-large-1.6-13">↑ <sup>[13.0](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba-large-1.6_13-0)</sup> <sup>[13.1](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba-large-1.6_13-1)</sup> "ai21labs/AI21-Jamba-Large-1.6". *Hugging Face*. <a href="https://huggingface.co/ai21labs/AI21-Jamba-Large-1.6" class="external autonumber" rel="nofollow">[11]</a></span>
14. <span id="cite_note-hf-jamba-large-1.7-14">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba-large-1.7_14-0) "ai21labs/AI21-Jamba-Large-1.7". *Hugging Face*. <a href="https://huggingface.co/ai21labs/AI21-Jamba-Large-1.7" class="external autonumber" rel="nofollow">[12]</a></span>
15. <span id="cite_note-ai21-changelog-15">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-changelog_15-0) "Changelog". *AI21 Labs Documentation*. <a href="https://docs.ai21.com/changelog" class="external autonumber" rel="nofollow">[13]</a></span>
16. <span id="cite_note-hf-jamba-reasoning-3b-16">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba-reasoning-3b_16-0) "ai21labs/AI21-Jamba-Reasoning-3B". *Hugging Face*. <a href="https://huggingface.co/ai21labs/AI21-Jamba-Reasoning-3B" class="external autonumber" rel="nofollow">[14]</a></span>
17. <span id="cite_note-hf-jamba2-mini-17">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba2-mini_17-0) "ai21labs/AI21-Jamba2-Mini". *Hugging Face*. <a href="https://huggingface.co/ai21labs/AI21-Jamba2-Mini" class="external autonumber" rel="nofollow">[15]</a></span>
18. <span id="cite_note-hf-jamba2-3b-18">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-hf-jamba2-3b_18-0) "ai21labs/AI21-Jamba2-3B". *Hugging Face*. <a href="https://huggingface.co/ai21labs/AI21-Jamba2-3B" class="external autonumber" rel="nofollow">[16]</a></span>
19. <span id="cite_note-ai21-docs-19">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-ai21-docs_19-0) "Jamba Foundation Models". *AI21 Labs Documentation*. <a href="https://docs.ai21.com/docs/jamba-foundation-models" class="external autonumber" rel="nofollow">[17]</a></span>
20. <span id="cite_note-aws-jamba-1.5-bedrock-20">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-aws-jamba-1.5-bedrock_20-0) "Jamba-1.5 family of models by AI21 Labs is now available in Amazon Bedrock". *AWS What's New*. <a href="https://aws.amazon.com/about-aws/whats-new/2024/09/jamba-1-5-family-models-amazon-bedrock/?nc1=h_ls" class="external autonumber" rel="nofollow">[18]</a></span>
21. <span id="cite_note-iclr-jamba15-21">[↑](https://systems-analysis.info/eng/Jamba_(language_model)#cite_ref-iclr-jamba15_21-0) Jamba Team (2025). "Jamba: Hybrid Transformer-Mamba Language Models". *ICLR 2025 (OpenReview)*. <a href="https://openreview.net/forum?id=JFPaD7lpBD" class="external autonumber" rel="nofollow">[19]</a></span>
