Navigate Select ESC Close

Building ETL Pipelines in Databricks | Data Engineering in Databricks

2026-04-07 Education
1.4k
95
1
Alex The Analyst
Alex The Analyst
1.4m subscribers

Unlock all features

FREE: Get instant access to 10 AI summaries, chats, or transcripts per day.

Description

In this series we are going to dive into the Data Engineering side of Databricks! This video will transforming data and creating ETL Pipelines within Databricks. Try out Databricks Free: http://signup.databricks.com/?provider=DB_FREE_TIER&utm_source=youtube&utm_medium=video&utm_campaign=AlextheAnalystDE ____________________________________________ RESOURCES: 💻Analyst Builder - https://www.analystbuilder.com/ 📖Take my Full MySQL Course Here: https://bit.ly/3tqOipr 📖Take my Full Python Course Here: https://bit.ly/48O581R 📖Practice Technical Interview Questions: https://bit.ly/46pDqqL Coursera Courses: Google Data Analyst Certification: https://coursera.pxf.io/5bBd62 Data Analysis with Python - https://coursera.pxf.io/BXY3Wy IBM Data Analysis Specialization - https://coursera.pxf.io/AoYOdR Tableau Data Visualization - https://coursera.pxf.io/MXYqaN *Please note I may earn a small commission for any purchase through these links - Thanks for supporting the channel!* ____________________________________________ BECOME A MEMBER - Want to support the channel? Consider becoming a member! I do Monthly Livestreams and you get some awesome Emoji's to use in chat and comments! https://www.youtube.com/channel/UC7cs8q-gJRlGwj4A8OmCmXg/join ____________________________________________ Websites: 💻Website: AlexTheAnalyst.com 💾GitHub: https://github.com/AlexTheAnalyst 📱Instagram: @Alex_The_Analyst ____________________________________________ *All opinions or statements in this video are my own and do not reflect the opinion of the company I work for or have ever worked for*

Top Comments (10)

@Mirminman 2026-06-17

The company I work for is currently migrating to Databricks, and this tutorial is helping me a lot since I come from the legacy SSIS. There is a lot to study and learn, but I like your tutorial. Thanks!

3
@FatenSaud-r8q 2026-04-27

Such a good tutorial, I'm finding it so easy to follow and Databricks and ETL pipelines don't seem so scary anymore!

0
@pragyadimri6275 2026-04-08

Thank you Alex, very helpful video. Hoping that you'll continue this series

0
@zuhaldanyildiz6348 2026-04-08

This is golden!

0
@abramswee 2026-05-28

Thanks Alex!

0
@TheJuanrcuervo 2026-04-07

Thank you Alex . Very helpful video and it came to me at the right time. I see you are taking advantage of Genie. I have resisted to use it, but finally after whatching your video I'm open to give it a try. I'ts actually very handy specially in a code-oriented platform like Databricks.

3 1 replies
@Firecodeman69 2026-07-16

Hey Alex! Thank you for the tutorial. Curious - why would each layer have its own catalog vs each layer existing in different schemas within the same catalog? Thank you!

0
@akshayasivakumar2112 2026-04-12

Hi Alex, if possible, could you please upload the CSV file you are using for the data engineering series to GitHub? That would be really helpful!

1
@paolocastillo310 2026-05-01

hi alex, is this dbx free edition?

0
@MasterCamus 2026-06-06

I think a better use of catalogs is dividing it per project/department and not prod or uat. It can become messy real quick. Use catalog for projects/departments and schema as the layers \

0 1 replies

Unlock the Data Inside
Turn Videos into Knowledge

  • Get FREE 10/day: transcripts, summaries, chats
  • Chat with videos, export text & PDF
  • $1 free API credit for RAG, chatbots & research

Free forever plan • All features unlocked

App screenshot