Navigate Select ESC Close

Goodbye Text-Based RAG, Hello Vision AI: Introducing LocalGPT Vision!

2024-10-08 Science & Technology
39.7k
1.1k
107
Prompt Engineering
Prompt Engineering
245.0k subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

In this video, we introduce LocalGPT Vision, a vision-based RAG system designed to change document interaction by going beyond text-based retrieval augmented generation (RAG). With LocalGPT Vision, you can extract information from images, tables, and complex visual data with ease, making it perfect for advanced AI-powered document processing. LINKS: https://github.com/PromtEngineer/localGPT-Vision 💻 RAG Beyond Basics Course: https://prompt-s-site.thinkific.com/courses/rag Let's Connect: 🦾 Discord: https://discord.com/invite/t4eYQRUcXB ☕ Buy me a Coffee: https://ko-fi.com/promptengineering |🔴 Patreon: https://www.patreon.com/PromptEngineering 💼Consulting: https://calendly.com/engineerprompt/consulting-call 📧 Business Contact: [email protected] Become Member: http://tinyurl.com/y5h28s6h 💻 Pre-configured localGPT VM: https://bit.ly/localGPT (use Code: PromptEngineering for 50% off). Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0 00:00 Introduction to LocalGPT Vision 00:22 Why Vision-Based RAG? 01:45 How LocalGPT Vision Works 04:51 Setting Up LocalGPT Vision 05:42 Running LocalGPT Vision 09:37 Using LocalGPT Vision 14:54 Limitations and Failure Points 17:17 Conclusion and Future Updates All Interesting Videos: Everything LangChain: https://www.youtube.com/playlist?list=PLVEEucA9MYhOu89CX8H3MBZqayTbcCTMr Everything LLM: https://youtube.com/playlist?list=PLVEEucA9MYhNF5-zeb4Iw2Nl1OKTH-Txw Everything Midjourney: https://youtube.com/playlist?list=PLVEEucA9MYhMdrdHZtFeEebl20LPkaSmw AI Image Generation: https://youtube.com/playlist?list=PLVEEucA9MYhPVgYazU5hx6emMXtargd4z

Top Comments (10)

@IdPreferNot1 2024-10-08

Great stuff. Once i saw colpali, i thought this would be the future of RAG.

6 1 replies
@HassanAllaham 2024-10-08

Very useful and it includes a very nice and clever idea.. thanks for the good content and thanks for LocalGPT Vision... It deserve a very big star 🌹🌹🌹

1 1 replies
@VerdonTrigance 2024-10-08

My issue with LocalGPT was inability to upload multiple files. But I see right now you've fixed that. Interesting...

1
@Ramesh-tq1nu 2024-11-29

The solution (Local GPT-Vision) taht which you have provided is Excellent i approciate that. This solution doses not work for large number of documents segregated into multiple folders. As the GPU VRAM is limited this works only for few documents . I request you to provide any alternate solution like using a vector Databasae lik Qdrant so that the solution can be implemneted for huge number of documents with ease with out effecting the erpormence of a quick query and search. i hope what i have asked makes logical sence. Or alternatly if you have any solution for searching large number of documents based on document category is most welcome. any sample code in that direction would be of great help to us. keep up the good work.

1
@nikhilbwadibhasme 2024-12-11

should be docker available for this git repo!

1
@RunningStallion-o6u 2024-10-08

Impressive! Nice Job. Thanks.

0 1 replies
@maloukemallouke9735 2024-10-09

perfect

0
@sudabadri7051 2024-10-11

This is awesome thanks

0
@kees6 2024-10-08

Awesome work

0
@barackobama4552 2024-10-10

Thanks!

0

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot