How I Scrape Any Site Using This MCP Server + Claude, LangGraph & AI Agents
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Unlock all features
FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.
Related videos
I Let 3 AIs Compete to Build the Same App…
Tech With Tim
4.3m views
What Programming Language to Learn in 2025 and WHY
Tech With Tim
36.7k views
How to Build AI Agents in Python
Tech With Tim
46.7k views
How to Build a Production-Ready RAG AI Agent in Python (Step-by-Step)
Tech With Tim
77.8k views
Coding is Changing… The Most Advanced AI Tool Yet
Tech With Tim
1.4m views
How to Build an Advanced AI Agent with Search (LangGraph, Python, Bright Data & More)
Tech With Tim
44.4k views
Build ANYTHING With an Advanced MCP Server (Python, Authentication, Databases & More)
Tech With Tim
70.5k views
How To Pass Coding Interviews Like the Top 1%
Tech With Tim
52.8k views
This New AI Coding Platform Is Insane (Warp Tutorial)
Tech With Tim
91.0k views
The Most Advanced Vibe Coding Tool I’ve Ever Seen… This is Crazy
Tech With Tim
47.4k views
Top Comments (10)
So helpful! I just finished my web scraper agent from this tutorial, and it works perfectly! I'm going to try making a nice frontend for it now.
Very Good, great explanation, good job Tim hope you'll do the next video
Thanks a lot, Tim! this video was incredibly helpful! I followed your video and managed to create my own project using the MCP server setup. However, as it grew, it became a huge monolith 😅. I’ve been trying to split things into separate files to keep it more maintainable, but I’d really appreciate in future videos a follow-up showing how to modularize the project properly. That would be awesome!
tim, it is working great. thank you very much
Great tutorial as always , thanks Tim. Is there any easy way to run the custom agent in a docker container ?
You probably always delete your api keys after making the videos, but still i found it funny, that you blurred out the left side of the mcp access details, and left the right side unblurred, which i believe also has the api key as the bearer in the request :D
What is th cost? And how this compare to Crawl4AI ( which is 100% free)?
This is super helpful! Is there a specific way to integrate HasData with the MCP server for smoother scraping?
Any site? Doubt it. If you have a html page with no JSON or consistent patterns from page to page how would you scrape it? For example an OCR scan of a book output as html-v1 from the year 1999 how would you scrape it without a highly complex beautifulsoup custom Python that can handle the different patterns. Where by the python script is modified for each different pattern.
Thank you Tim! What about rotating proxy servers for bots?
Unlock the Data Inside
Turn Videos into Knowledge
- Get FREE 10/day: transcripts, summaries, chats
- Chat with videos, export text & PDF
- $1 free API credit for RAG, chatbots & research
Free forever plan • All features unlocked
Top Comments (10)
So helpful! I just finished my web scraper agent from this tutorial, and it works perfectly! I'm going to try making a nice frontend for it now.
Very Good, great explanation, good job Tim hope you'll do the next video
Thanks a lot, Tim! this video was incredibly helpful! I followed your video and managed to create my own project using the MCP server setup. However, as it grew, it became a huge monolith 😅. I’ve been trying to split things into separate files to keep it more maintainable, but I’d really appreciate in future videos a follow-up showing how to modularize the project properly. That would be awesome!
tim, it is working great. thank you very much
Great tutorial as always , thanks Tim. Is there any easy way to run the custom agent in a docker container ?
You probably always delete your api keys after making the videos, but still i found it funny, that you blurred out the left side of the mcp access details, and left the right side unblurred, which i believe also has the api key as the bearer in the request :D
What is th cost? And how this compare to Crawl4AI ( which is 100% free)?
This is super helpful! Is there a specific way to integrate HasData with the MCP server for smoother scraping?
Any site? Doubt it. If you have a html page with no JSON or consistent patterns from page to page how would you scrape it? For example an OCR scan of a book output as html-v1 from the year 1999 how would you scrape it without a highly complex beautifulsoup custom Python that can handle the different patterns. Where by the python script is modified for each different pattern.
Thank you Tim! What about rotating proxy servers for bots?