---
title: "Multi-agent frameworks"
source: "https://systems-analysis.info/eng/Multi-agent_frameworks"
wiki: "systems-analysis.info/eng"
article: "Multi-agent_frameworks"
language: "en"
categories:
  - "Category:AI Agents"
  - "Category:English"
  - "Category:Large language models"
  - "Category:Machine learning"
  - "Category:Technology"
revision_id: 260
wiki_created_at: 2026-09-06T22:19:40Z
wiki_modified_at: 2026-09-06T22:19:40Z
downloaded_at: 2026-09-07T22:22:16Z
---

# Multi-agent frameworks

**LLM-based multi-agent frameworks** are software platforms that enable multiple autonomous [AI agents](https://systems-analysis.info/eng/AI_Agent "AI Agent"), built on large language models (LLMs), to interact with each other to collaboratively solve complex problems<sup>[\[1\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-survey_agents-1)</sup>. Such systems emphasize a diversity of agent profiles, their communication, and collective decision-making. This approach leverages the "collective intelligence" of a group, where each agent performs a specialized role, and the exchange of messages between them simulates human collaboration.

This allows for the modeling of complex real-world scenarios and the solving of problems that exceed the capabilities of a single intelligent agent. Multi-agent LLM systems have already demonstrated successful results in areas such as software development, social simulations, economic games, and modeling political discussions<sup>[\[1\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-survey_agents-1)</sup>.

## Key Frameworks and Approaches

The development of multi-agent systems has led to the emergence of several open-source frameworks that facilitate their creation and research.

### MetaGPT (2023)

One of the first open-source frameworks, focused on collaborative work following an *assembly line* principle. **MetaGPT** incorporates standard operating procedures (SOPs) into the system and assigns each agent a specific role (e.g., product manager, engineer, QA tester). This approach allows for the decomposition of a complex task into sub-tasks, distributing them among specialized agents, which reduces chaos and the risk of hallucinations<sup>[\[2\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-harmony_survey-2)</sup>.

### CAMEL (2023)

The **CAMEL** (*Communicative Agents for "Mind" Exploration*) framework focuses on the autonomous interaction of agents through dialogue. It proposes an *inception prompting* technique to coordinate conversations between LLM agents, guiding them toward a common goal. Each agent is assigned a role and a context, after which the agents communicate in natural language, gradually developing a joint solution. CAMEL has proven effective in scenarios requiring cooperation without direct human intervention<sup>[\[1\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-survey_agents-1)</sup>.

### AutoGen (2023)

A versatile and customizable framework from Microsoft researchers, designed for creating complex applications based on multi-LLM communication. **AutoGen** allows the logic of agent interaction to be programmed using both code and natural language. It supports integration with external tools and APIs, making it suitable for a wide range of tasks—from software development to creating conversational systems<sup>[\[1\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-survey_agents-1)</sup>.

### AgentVerse (2023)

An open platform developed by the OpenBMB community for studying dynamic collaboration and emergent agent behaviors. **AgentVerse** provides two modes of operation:

1.  **Task-solving**: Multiple LLM agents form a team to complete a complex task (e.g., collaborative software development).
2.  **Simulation**: Allows the user to define a virtual environment and observe the interactions of agents (e.g., simulating a classroom or the prisoner's dilemma).

The platform emphasizes the importance of a standardized environment and communication protocols for managed communication<sup>[\[3\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-agentverse_github-3)</sup>.

### CrewAI (2024)

A framework focused on integrating LLM agents into business processes and data analysis. **CrewAI** implements the *AI-Based Agents Workflow* (AgWf) concept, where agents execute steps described as text instructions and can use external tools (Python classes/functions). This enables the automation of complex analytical scenarios by combining the flexibility of LLMs with deterministic code<sup>[\[2\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-harmony_survey-2)</sup>.

### LangGraph (2024)

An experimental framework that uses graph structures to represent state and context in dialogues with LLMs. The key feature of **LangGraph** is its support for **cyclical workflows**. This allows agents to exchange data through a shared knowledge graph, iteratively search for information, assess its reliability, and correct their responses, which is particularly useful in question-answering (QA) tasks with an augmented knowledge base<sup>[\[2\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-harmony_survey-2)</sup>.

### Other Projects

The experimental projects **AutoGPT** and **AgentGPT** also gained widespread attention, demonstrating the potential of fully autonomous AI agents capable of independently setting goals, performing web searches, executing code, and managing files. Although these projects were not peer-reviewed, they highlighted the importance of planning, memory, and tool-use components for building truly autonomous agents<sup>[\[4\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-nvidia_blog-4)</sup>.

## Applications of Multi-Agent Systems

- **Software Development Automation**: Groups of LLM agents act as managers, programmers, and testers, collaboratively planning and implementing software projects. The *ChatDev* study showed that a team of four agents could create a simple application in minutes, engaging in dialogue at all stages from task definition to testing<sup>[\[2\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-harmony_survey-2)</sup>.
- **Intelligent Assistants**: Enterprise products like Microsoft 365 Copilot and IBM Watsonx Orchestrate use multiple agents to perform complex tasks, where one agent processes a request, another retrieves facts from a database, and a third compiles a report.
- **Scientific Research**: Agents are used to generate and critique hypotheses. In approaches like *Guided Debate* or *[Self-Refine](https://systems-analysis.info/eng/Self-Refine_Prompting "Self-Refine Prompting")*, one agent proposes a solution, while another evaluates and corrects it, which helps reduce errors<sup>[\[4\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-nvidia_blog-4)</sup>.
- **Social Modeling and Virtual Worlds**: In the landmark project *Generative Agents*, dozens of LLM agents endowed with personalities and memory simulated life in a small virtual town, demonstrating believable social interaction. Such simulations could find applications in gaming (for creating realistic NPCs), education, and the social sciences<sup>[\[4\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-nvidia_blog-4)</sup>.

## Challenges and Future Outlook

Despite their successes, multi-agent systems face several significant challenges:

- **Hallucinations and Cascading Errors**: An error made by one agent can be passed down the chain to others, who then use it as the basis for their reasoning, leading to skewed results for the entire group<sup>[\[1\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-survey_agents-1)</sup>.
- **Scalability and Resource Intensity**: Each LLM-based agent requires significant computational resources. Ensuring the simultaneous operation of dozens of agents is a complex technical challenge<sup>[\[1\]](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_note-survey_agents-1)</sup>.
- **Coordination and Management**: As the number of agents grows, the risk of chaos increases. Sophisticated "orchestration" mechanisms are needed to manage their interactions.
- **Evaluation and Testing**: There is a lack of widely accepted benchmarks for objectively comparing different multi-agent frameworks.

In the future, the emergence of more efficient and secure multimodal systems is expected, where agents can exchange not only text but also images and other data. The implementation of reinforcement learning could teach groups of agents to coordinate better over time, achieving a "collective intelligence" effect. Ultimately, multi-agent frameworks represent a step toward creating more flexible and powerful AI systems, where multiple specialized "minds" work together.

## External links

- <a href="https://arxiv.org/html/2402.01680v2" class="external text" rel="nofollow">Survey Paper: Large Language Model based Multi-Agents (2024)</a>
- <a href="https://arxiv.org/html/2504.01963v1" class="external text" rel="nofollow">Survey Paper: LLMs Working in Harmony (2025)</a>
- <a href="https://en.wikipedia.org/wiki/Multi-agent_system" class="external text" rel="nofollow">Multi-agent system — Wikipedia</a>

## Literature

- Yao, S. et al. (2022). *ReAct: Synergizing Reasoning and Acting in Language Models*. <a href="https://arxiv.org/abs/2210.03629" class="external text" rel="nofollow">arXiv:2210.03629</a>.
- Hong, S. et al. (2023). *MetaGPT: Meta Programming for a Multi-Agent Collaborative Framework*. <a href="https://arxiv.org/abs/2308.00352" class="external text" rel="nofollow">arXiv:2308.00352</a>.
- Li, G. et al. (2023). *CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society*. <a href="https://arxiv.org/abs/2303.17760" class="external text" rel="nofollow">arXiv:2303.17760</a>.
- Wu, Q. et al. (2023). *AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation*. <a href="https://arxiv.org/abs/2308.08155" class="external text" rel="nofollow">arXiv:2308.08155</a>.
- Liu, X. et al. (2023). *AgentBench: Evaluating LLMs as Agents*. <a href="https://arxiv.org/abs/2308.03688" class="external text" rel="nofollow">arXiv:2308.03688</a>.
- Yao, S. et al. (2023). *Tree of Thoughts: Deliberate Problem Solving with Large Language Models*. <a href="https://arxiv.org/abs/2305.10601" class="external text" rel="nofollow">arXiv:2305.10601</a>.
- Shinn, N. et al. (2023). *Reflexion: Language Agents with Verbal Reinforcement Learning*. <a href="https://arxiv.org/abs/2303.11366" class="external text" rel="nofollow">arXiv:2303.11366</a>.
- Chen, W. et al. (2023). *AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors*. <a href="https://arxiv.org/abs/2308.10848" class="external text" rel="nofollow">arXiv:2308.10848</a>.
- Park, J. S. et al. (2023). *Generative Agents: Interactive Simulacra of Human Behavior*. <a href="https://arxiv.org/abs/2304.03442" class="external text" rel="nofollow">arXiv:2304.03442</a>.
- Guo, T. et al. (2024). *Large Language Model Based Multi-Agents: A Survey of Progress and Challenges*. <a href="https://arxiv.org/abs/2402.01680" class="external text" rel="nofollow">arXiv:2402.01680</a>.
- Chen, Q. et al. (2024). *ChatDev: Communicative Agents for Software Development*. <a href="https://arxiv.org/abs/2307.07924" class="external text" rel="nofollow">arXiv:2307.07924</a>.
- Duan, Z.; Wang, J. (2024). *Exploration of LLM Multi-Agent Application Implementation Based on LangGraph + CrewAI*. <a href="https://arxiv.org/abs/2411.18241" class="external text" rel="nofollow">arXiv:2411.18241</a>.
- Aratchige, R. M.; Ilmini, W. M. K. S. (2025). *LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi-Agent Systems*. <a href="https://arxiv.org/abs/2504.01963" class="external text" rel="nofollow">arXiv:2504.01963</a>.

## References

1.  <span id="cite_note-survey_agents-1">↑ <sup>[1.0](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-survey_agents_1-0)</sup> <sup>[1.1](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-survey_agents_1-1)</sup> <sup>[1.2](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-survey_agents_1-2)</sup> <sup>[1.3](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-survey_agents_1-3)</sup> <sup>[1.4](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-survey_agents_1-4)</sup> <sup>[1.5](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-survey_agents_1-5)</sup> Wang, L., et al. "Large Language Model based Multi-Agents: A Survey of Progress and Challenges". *arXiv:2402.01680* \[cs.AI\], 1 Feb. 2024. <a href="https://arxiv.org/html/2402.01680v2" class="external autonumber" rel="nofollow">[1]</a></span>
2.  <span id="cite_note-harmony_survey-2">↑ <sup>[2.0](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-harmony_survey_2-0)</sup> <sup>[2.1](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-harmony_survey_2-1)</sup> <sup>[2.2](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-harmony_survey_2-2)</sup> <sup>[2.3](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-harmony_survey_2-3)</sup> Yu, H., et al. "LLMs Working in Harmony: A Survey on the Technological Aspects of Building Effective LLM-Based Multi Agent Systems". *arXiv:2504.01963* \[cs.CL\], 2 Apr. 2025. <a href="https://arxiv.org/html/2504.01963v1" class="external autonumber" rel="nofollow">[2]</a></span>
3.  <span id="cite_note-agentverse_github-3">[↑](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-agentverse_github_3-0) "GitHub - OpenBMB/AgentVerse". *GitHub*. <a href="https://github.com/OpenBMB/AgentVerse" class="external autonumber" rel="nofollow">[3]</a></span>
4.  <span id="cite_note-nvidia_blog-4">↑ <sup>[4.0](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-nvidia_blog_4-0)</sup> <sup>[4.1](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-nvidia_blog_4-1)</sup> <sup>[4.2](https://systems-analysis.info/eng/Multi-agent_frameworks#cite_ref-nvidia_blog_4-2)</sup> "Building Your First LLM Agent Application". *NVIDIA Technical Blog*. <a href="https://developer.nvidia.com/blog/building-your-first-llm-agent-application/" class="external autonumber" rel="nofollow">[4]</a></span>