In this databricks tutorial, you will learn Databricks foundations from scratch and build a real end-to-end project in E-Commerce domain that you can confidently put on your resume. This Databricks micro Course explains everything in a simple, intuitive way!
Signup to Databricks Free Edition: https://bit.ly/4nK0NTN
Code, Dataset, other resources: https://codebasics.io/resources/databrick-mini-course-end-to-end-project
Get Certified by Codebasics with this Databricks Mini Course - https://codebasics.io/courses/Databricks-Mini-Course
⭐️ Timestamps ⭐️
00:00:00 Intro
00:01:15 Project Introduction
00:03:09 Stakeholder Discussion
00:04:45 Two Learning Paths
00:05:19 Sign up for the free edition
00:06:03 Explore Databricks UI
00:11:12 Dataframe Basics
00:27:54 Distributed Computing, Spark, and Databricks
00:34:51 SQL and joins in Spark
00:49:48 Reading Spark plans with explain
01:02:37 Spark Architecture
01:07:43 Transformations vs Actions and Lazy Evaluation
01:16:03 Narrow vs Wide Transformation
01:19:55 Partition and Parallelism: Repartition
01:34:00 Partition and Parallelism: Coalesce
01:39:37 Managed vs External Tables
01:43:26 Medallion architecture
01:49:18 Unity Catalog
01:59:21 Acid & Time Travel
02:09:05 About AWS Account & Delta Lake
02:09:26 AWS Account Setup
02:11:39 Delta Lake and Delta format
02:25:09 Intro & Tech Architecture
02:28:23 Catalog Setup
02:31:51 Data Understanding and Upload
02:36:20 Dimension Data Processing
03:00:45 Fact Data Processing
03:14:25 Get Insights using Genie
03:18:02 BI Dashboard
03:28:15 Orchestration
03:33:27 Stakeholder Review Meeting
03:34:50 What’s Next?
Do you want to learn technology from me? Check https://codebasics.io/?utm_source=description&utm_medium=yt&utm_campaign=description&utm_id=description for my affordable video courses.
Need help building software or data analytics/AI solutions? My company https://www.atliq.com/ can help. Click on the Contact button on that website.
🎥 Codebasics Hindi channel: https://www.youtube.com/channel/UCTmFBhuhMibVoSfYom1uXEg
#️⃣ Social Media #️⃣
🧑🤝🧑 Discord for Community Support: https://discord.gg/r42Kbuk
📸 Codebasics' Instagram: https://www.instagram.com/codebasicshub/
📝 Codebasics' Linkedin : https://www.linkedin.com/company/codebasics/
------
📝 Dhaval's Linkedin : https://www.linkedin.com/in/dhavalsays/
📝 Hem's Linkedin: https://www.linkedin.com/in/hemvad/
📽️ Hem's Instagram for daily tips: https://www.instagram.com/hemvadivel/
📸 Dhaval's Personal Instagram: https://www.instagram.com/dhavalsays/
🔗 Patreon: https://www.patreon.com/codebasics?fan_landing=true
