Navigate Select ESC Close

Fully local multi-agent systems with LangGraph

2025-03-15 Science & Technology
71.2k
1.5k
47
LangChain
LangChain
194.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

Following the release of OpenAI's new Agents SDK, we've seen a lot of interest in multi-agent workflows. Here, we discuss two different approaches for multi-agent systems - swarm and supervisor - and showcase two different LangGraph packages that make it easy to implement these approaches. We show that both can be run locally with Qwen2.5-14b (via Ollama), which excels at tool-calling. We also show LangGraph Studio and LangSmith traces to provide debugging and observability into these systems. LangGraph-swarm: https://github.com/langchain-ai/langgraph-swarm-py LangGraph-supervisor: https://github.com/langchain-ai/langgraph-supervisor-py Video notes: https://mirror-feeling-d80.notion.site/Fully-Local-Multi-Agent-1b5808527b178066bde0ed981b27998c?pvs=4 Chaters: 00:00 - Introduction to Multi-Agent Systems and Open Eye SDK 00:30 - Demo: Flight and Hotel Booking Multi-Agent System 01:10 - Running Locally with Qwen models 02:00 - What is an Agent? (Tool Calling in a Loop) 03:00 - Finding Local Models for Agent Development 04:00 - Berkeley Function Calling Leaderboard and Qwen Models 05:00 - Why Multi-Agent Systems Matter 06:00 - Supervisor vs. Swarm Architecture Explained 07:15 - Trade-offs Between Different Multi-Agent Approaches 08:00 - Building Multi-Agent Systems in a Notebook 09:00 - Understanding the Agent Implementation 10:00 - Setting up the Supervisor Architecture 11:00 - Tracing and Visualization with LangSmith 12:00 - Choosing the Right Local Models for Your Agents 12:45 - Conclusion and Final Thoughts

Top Comments (10)

@aireddy 2025-03-16

Thank you for detailed walkthrough about how to build multi agents locally.

3
@gchannel1997 2025-03-18

VERY happy to see LangChain folks focusing on Ollama! My initial research showed that LangChain was mostly wedded to HuggingFace, which was a turn-off for me since the performance of HuggingFace is horrible compared with Ollama. Very eagerly following your videos, as I become more engaged with LangChain!

2
@ShashwatTech29 2025-03-15

Awesome❤

1
@brunopinto2447 2025-03-15

Thank you so much for this video. Really great work explaining these concepts. I would love if you guys could create some courses about AI and LLMs in general, specifically if done using LangChain technologies.

1
@RedCloudServices 2025-03-16

This reminds me somewhat of Google’s Map-Reduce framework from a long time ago 😮

1
@_gabidev 2025-05-21

That was really well explained. Thank you, Lance.

1
@munkuo5 2025-03-15

Love this supervisor implementation! Going to try this.

1
@DhirajPatra 2025-04-08

Awsome, I was getting issues with multi agent with Ollama in local MAC i7 16GB RAM

0
@simongentry 2025-03-16

this is brilliant for someone who wants at different points of a pipeline to ‘check’ the data being passed between agents. say for validity, bias, scoring etc. ps please record a class on supervisor, swarm and mcp… all local.

0
@MrGtube007 2025-04-02

This is fantastic and may work for my use case.

0

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot