Navigate Select ESC Close

Local LightRAG: A GraphRAG Alternative but Fully Local with Ollama

2024-10-21 Science & Technology
86.1k
1.1k
90
Prompt Engineering
Prompt Engineering
241.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

In this video, we explore how to set up and run LightRAG—a retrieval augmented generation (RAG) system that combines knowledge graphs with embedding-based retrieval—locally using OLLAMA. This video provides a step-by-step guide on cloning the repo, configuring local models like the Qwen2 LLM, adjusting context windows, and visualizing knowledge graphs generated from example data such as "A Christmas Carol" by Charles Dickens. LINKS: https://github.com/HKUDS/LightRAG https://lightrag.github.io/ https://arxiv.org/pdf/2410.05779 https://microsoft.github.io/graphrag/ https://youtu.be/vX3A96_F3FU 💻 RAG Beyond Basics Course: https://prompt-s-site.thinkific.com/courses/rag Let's Connect: 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Patreon: https://www.patreon.com/PromptEngineering 💼Consulting: https://calendly.com/engineerprompt/consulting-call 📧 Business Contact: [email protected] Become Member: http://tinyurl.com/y5h28s6h 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0 TIMESTAMP 00:00 LightRAG with local models 01:38 Setup with Ollama 02:53 Serving Embeddings with Ollama 03:40 Changing the context window of the LLM 07:00 Configuring the Ingestion process 08:12 Advanced RAG Course 09:14 Indexing and Knowledge Graph Creation 10:45 Testing it out with local models All Interesting Videos: Everything LangChain: https://www.youtube.com/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr Everything LLM: https://youtube.com/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw Everything Midjourney: https://youtube.com/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw AI Image Generation: https://youtube.com/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z

Top Comments (10)

@richardkuhne5054 2024-10-22

Yes we are interested, please add multi modal and pdf processing. Also use a cheap model with prompt caching for the chunking etc. and a smart model with large context window for retrieval. To get accurate results that are vetted out. I.e gpt4o-mini for ingesting, Claude 3.5 sonnet for retrieval or so

7 1 replies
@angelfeliciano8794 2024-10-21

Thanks so much for your tutorials and demos. What if the data is related to products and I already process a txt with 200 products. Then next day the price is updated in 5 products. Do I need to process the whole list again? Does the old price will be remembered or it will be replaced from the rag?

4
@brucewayne2480 2024-10-22

What about an existing knowledge graph in neo4j for example ? Can you enrich an existing graph ?

2
@thangdoan4831 2024-11-21

How can I give a chunked csv or json file as input?

2
@SurajPrasad-bf9qn 2024-10-27

Thank you , your videos are helping me a lot, please keep uploading such videos

1 1 replies
@davidtapang6917 2024-10-22

Definitely more lightrag!

1
@MeinDeutschkurs 2024-10-21

What about options={num_ctx=32000} at the function? Is it not supported?

1
@mahmoudsamir9537 2024-10-24

Thanks for that. I am confused with the types of queries, what are naive vs local vs global vs hybrid ?

1
@jayaverma634 2024-10-21

Can you please make a video on the road map for Learning LLM or generative AI

0
@AIBytesTamil 2025-11-01

Excellent 👌

0

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot