Navigate Select ESC Close

Local LightRAG: A GraphRAG Alternative but Fully Local with Ollama

2024-10-21 Science & Technology
86.1k
1.1k
90
Prompt Engineering
Prompt Engineering
245.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

In this video, we explore how to set up and run LightRAG—a retrieval augmented generation (RAG) system that combines knowledge graphs with embedding-based retrieval—locally using OLLAMA. This video provides a step-by-step guide on cloning the repo, configuring local models like the Qwen2 LLM, adjusting context windows, and visualizing knowledge graphs generated from example data such as "A Christmas Carol" by Charles Dickens. LINKS: https://github.com/HKUDS/LightRAG https://lightrag.github.io/ https://arxiv.org/pdf/2410.05779 https://microsoft.github.io/graphrag/ https://youtu.be/vX3A96_F3FU 💻 RAG Beyond Basics Course: https://prompt-s-site.thinkific.com/courses/rag Let's Connect: 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Patreon: https://www.patreon.com/PromptEngineering 💼Consulting: https://calendly.com/engineerprompt/consulting-call 📧 Business Contact: [email protected] Become Member: http://tinyurl.com/y5h28s6h 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0 TIMESTAMP 00:00 LightRAG with local models 01:38 Setup with Ollama 02:53 Serving Embeddings with Ollama 03:40 Changing the context window of the LLM 07:00 Configuring the Ingestion process 08:12 Advanced RAG Course 09:14 Indexing and Knowledge Graph Creation 10:45 Testing it out with local models All Interesting Videos: Everything LangChain: https://www.youtube.com/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr Everything LLM: https://youtube.com/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw Everything Midjourney: https://youtube.com/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw AI Image Generation: https://youtube.com/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z

Top Comments (10)

@sammcj2000 2024-10-23

I'd like to see a RAG system specifically built for working with large code bases. Most rag examples are optimised for document retrieval and citation, but I think there's a lot of room for advanced code modernisation / rewriting augmented with rag simply to enable working with large code bases (e.g. >100k tokens)

12 2 replies
@optimistic_das 2024-11-27

Great Video!!! Kindly make more videos on LightRAG and all the latest cool technologies please. You are my one stop source to learn and know about new technologies. Thank you so much!!

4 1 replies
@angelfeliciano8794 2024-10-21

Thanks so much for your tutorials and demos. What if the data is related to products and I already process a txt with 200 products. Then next day the price is updated in 5 products. Do I need to process the whole list again? Does the old price will be remembered or it will be replaced from the rag?

4
@brucewayne2480 2024-10-22

What about an existing knowledge graph in neo4j for example ? Can you enrich an existing graph ?

2
@Othit 2024-11-14

wow, got it working, thank you so much. it took the better part of one day on my non-GPU laptop. next step is to repeat this with some cloud-based GPU horsepower.

1 2 replies
@SurajPrasad-bf9qn 2024-10-27

Thank you , your videos are helping me a lot, please keep uploading such videos

1 1 replies
@mahmoudsamir9537 2024-10-24

Thanks for that. I am confused with the types of queries, what are naive vs local vs global vs hybrid ?

1
@urlanbarros 2025-09-12

Bro, awesome video. Do you have any idea how Qwen extract entities from the text?

0
@henkhbit5748 2024-12-11

Thanks for the update of lightrag with ollama. I am curious if you feed lightrag with a bunch of documents and how it impact the query/inference performance. In standard rag we store the embeddings in a vectorstore. Is this possible with lightrag? It would be nice to see an example with more complex documents and the embeddings stored in a vectorstore with an open source llm (for cost savings ;-) )

0
@SSSNIPD 2025-03-02

What screen recording tool are you using?

0

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot