|
[FREE Session] Master in Databricks Introduction
|
|
|
|
Databricks Course Introduction
33:00
|
Preview
|
|
|
Databricks Course Curriculum
(5 pages)
|
Preview
|
|
|
Databricks Course presentation
|
Preview
|
|
|
Join Our WhatsApp Group
|
|
|
[Session-1] Spark Fundamentals
|
|
|
|
Spark Features and Eco System (Part-1)
15:00
|
|
|
|
sparkContext Vs sparkSession (Part-2)
14:00
|
|
|
|
Spark worker node - container - executor (Part-3)
19:00
|
|
|
|
Spark On Heap Memory (Part-4)
11:00
|
|
|
|
Spark Off Heap Memory (Part-5)
10:00
|
|
|
|
Spark Garbage Collector (Part-6)
2:00
|
|
|
|
Spark Runtime Architecture Cluster Mode (Part-7)
23:00
|
Preview
|
|
|
Spark Runtime Architecture Client Mode (Part-8)
9:00
|
|
|
|
Spark Client Mode and Cluster Mode Differences (Part-9)
2:00
|
|
|
|
Spark Fundamentals Bonus Session
14:00
|
|
|
|
Session-1 Spark Fundamentals Resources
|
|
|
[Session-2] Spark Important Concepts
|
|
|
|
Session-1 Recap
16:00
|
|
|
|
Session-2 Agenda
2:00
|
|
|
|
Driver and Executor Memory Allocation (Part-1)
4:00
|
|
|
|
Executor Memory Allocation Deep Dive (Part-2)
10:00
|
Preview
|
|
|
Spark Program Execution Scenarios (Part-3)
10:00
|
|
|
|
Spark Executor Memory and cores calculations (Part-4)
14:00
|
Preview
|
|
|
Spark Application-Job-Stage (Part-5)
8:00
|
|
|
|
Spark Directed Acyclic Graph (DAG) (Part-6)
2:00
|
|
|
|
One Spark Application with Multiple Sessions (Part-7)
6:00
|
|
|
|
Bonus Q&A
2:00
|
|
|
|
Session-2 Spark Important Concepts Resources
|
|
|
[Session-3] Spark-Databricks Fundamentals
|
|
|
|
session-2 Spark Important Concepts Recap
1:00
|
|
|
|
Session-3 Spark-Databricks Fundamentals Agenda
3:00
|
|
|
|
Spark-Application-Jobs-Stages-Tasks (Part-1)
17:00
|
|
|
|
Spark-Transformations and Actions (Part-2)
4:00
|
|
|
|
Spark-RDD-DataFrame-Datasets (Part-3)
14:00
|
|
|
|
Spark-RDD-DataFrame-Datasets Differences (Part-4)
5:00
|
|
|
|
Spark- Missing Key Features (Part-5)
3:00
|
|
|
|
Databricks Introduction (Part-6)
7:00
|
|
|
|
Databricks Workspace UI Walkthrough (Part-7)
12:00
|
|
|
|
Databricks Workspace Creation (Part-8)
18:00
|
|
|
|
Databricks Cluster Creation (Part-9)
6:00
|
|
|
|
Azure ADLS Storage Creation (Part-10)
9:00
|
|
|
|
Spark Cluster Configuration and DBX secret scope creation (Part-11)
18:00
|
|
|
|
Spark-Databricks Q&A Bonus
3:00
|
|
|
|
Session-3 Spark Databricks Fundamentals Resources
|
|
|
[Session-4] Databricks- Spark-Hands On
|
|
|
|
Session-3 Spark-Databricks Fundamentals Recap
2:00
|
|
|
|
Databricks Notebook Magic Commands (Part-1)
10:00
|
|
|
|
Databricks DBUtils (Part-2)
18:00
|
|
|
|
Creating RDDs and DataFrames (Part-3)
17:00
|
|
|
|
Creating DataFrames from DBFS (Part-4)
3:00
|
|
|
|
DataFrame Read and Write Operations with different file formats (Part-5)
11:00
|
|
|
|
DataFrame creation with manual schema (Part-6)
7:00
|
|
|
|
Different Types of Tables and Views (Part-7)
10:00
|
|
|
|
Session-4 Bonus
8:00
|
|
|
|
Session-4 Databricks-Spark-Hands on-Resources
|
|
|
[Session-5] Databricks - Lake House Architecture
|
|
|
|
Session-4 Recap
1:00
|
|
|
|
Session-5 Agenda
4:00
|
|
|
|
Types of SCDs (Part-1)
23:00
|
|
|
|
Spark Narrow and Wide Transformations (Part-2)
4:00
|
|
|
|
Data Warehouse Concepts (Part-3)
6:00
|
|
|
|
Data Lake Concepts (Part-4)
11:00
|
|
|
|
Delta Table and Delta Lake Concepts (Part-5)
18:00
|
|
|
|
Lakehouse Architecture (Part-6)
6:00
|
|
|
|
Data Warehouse Vs Data Lake Vs Lakehouse (Part-7)
4:00
|
|
|
|
Delta Tables - Time Travel and History - Practical's (Part-8)
14:00
|
|
|
|
Spark Databricks Bonus Session
6:00
|
|
|
|
Session-5 Databricks - Lake House Architecture Resources
|
|
|
[Session-6] Databricks Unity Catalog
|
|
|
|
Session-5 Recap
3:00
|
|
|
|
Databricks Unity Catalog Agenda
4:00
|
|
|
|
Features of Unity Catalog (Part-1)
10:00
|
|
|
|
Unity Catalog Realtime Implementation Scenario (Part-2)
19:00
|
|
|
|
Unity Catalog Implementation Steps (Part-3)
9:00
|
|
|
|
Unity Catalog Key Roles (Part-4)
22:00
|
|
|
|
Unity Catalog Implementation Steps - Practical's (Part-5)
34:00
|
|
|
|
Grant UC Access on databricks groups-Practical's (Part-6)
15:00
|
|
|
|
Grant UC Access-CLS and RLS-Practicals (Part-7)
16:00
|
|
|
|
Tables Lineage in Unity Catalog-Practical's (Part-8)
6:00
|
|
|
|
Databricks Unity Catalog Bonus
3:00
|
|
|
|
Session-6 Unity Catalog Resources
|
|
|
[Session-7] Databricks Auto Loader
|
|
|
|
Session-6 Databricks Unity Catalog Recap
2:00
|
|
|
|
Session-7 Databricks Auto Loader Agenda
3:00
|
|
|
|
Spark Structured Streaming Theory (Part-1)
19:00
|
|
|
|
Spark Structured Streaming Drawbacks Theory (Part-2)
13:00
|
|
|
|
Databricks Auto Loader Intro (Part-3)
5:00
|
|
|
|
Incremental Load by uinsg the watermark column-Practical (Part-4)
28:00
|
|
|
|
Spark Structured Streaming with Manual Schema Evaluation (Part-5)
19:00
|
|
|
|
Spark Structured Streaming with Automatic Schema Evaluation (Part-6)
12:00
|
|
|
|
Databricks Auto Loader (Part-7)
19:00
|
|
|
|
Session-7 Autoloader Resources
|
|
|
[Session-8] Performance Optimization Techniques in Databricks
|
|
|
|
Session-7 Databricks Auto Loader Recap
2:00
|
|
|
|
Session-8 Databricks Performance Optimization Agenda
1:00
|
|
|
|
Databricks Performance Optimization Intro
5:00
|
|
|
|
Performance Tuning by using the OPTIMIZE Technique (Part-1)
39:00
|
|
|
|
Performance Tuning by using the ZORDER Technique (Part-2)
21:00
|
|
|
|
VACUUM Implementation in Databricks (Part-3)
33:00
|
|
|
|
Session-8 Databricks Performance Optimization Resources
|
|
|
|
sales dataset kaggle link
|
|
|
[Session-9] Spark Performance Optimization Techniques
|
|
|
|
Session-8 Databricks Performance Optimization Techniques Recap
1:00
|
|
|
|
Session-9 Spark Performance Optimization Agenda
1:00
|
|
|
|
Spark Performance Optimization-broadcast join Theory (Part-1)
17:00
|
|
|
|
Spark Performance Optimization-broadcast join Lab (Part-2)
11:00
|
|
|
|
Spark Performance Optimization-Partitioning and Bucketing Theory (Part-3)
22:00
|
|
|
|
Spark Performance Optimization-Partitioning and Bucketing Lab (Part-4)
11:00
|
|
|
|
Spark Performance Optimization-Cache and Persist Theory (Part-5)
8:00
|
|
|
|
Spark Performance Optimization-Cache and Persist Lab (Part-6)
20:00
|
|
|
|
Session-9 Spark Performance Optimzation Resources
|
|
|
|
Sales dataset kaggle link
|
|
|
[Session-10] Databricks Delta Live Tables and Types of Clusters
|
|
|
|
Session-9 Spark Performance Optimization Recap
1:00
|
|
|
|
Session-10 Databricks Delta Live Tables and Clusters Agenda
3:00
|
|
|
|
Databricks Types of Clusters (Part-1)
22:00
|
|
|
|
Databricks SQL Warehouses (Part-2)
16:00
|
|
|
|
Databricks Clusters Pricing Calculations (Part-3)
7:00
|
|
|
|
Databricks Delta Live Tables Theory (Part-4)
34:00
|
|
|
|
Databricks Delta Live Tables Overview and Setup (Part-5)
5:00
|
|
|
|
Databricks Delta Live Tables Lab (Part-6)
51:00
|
|
|
|
Session-10 Delta Live Tables Resources
|
|
|
[Session-11] Databricks Sample Project on GCP
|
|
|
|
Session-10 Databricks Delta Live Tables Recap
1:00
|
|
|
|
Session-11 Databricks Sample project on GCP Agenda
2:00
|
|
|
|
Infra Setup on GCP for Databricks Sample project (Part-1)
24:00
|
|
|
|
Databricks Sample project Overview (Part-2)
18:00
|
|
|
|
Databricks Sample project Code Walkthrough (Part-3)
25:00
|
|
|
|
Databricks Sample project Code Walkthrough (Part-4)
9:00
|
|
|
|
Databricks Sample project - DLT Pipeline Execution (Part-5)
16:00
|
|
|
|
Databricks Sample project - PowerBI Connectivity (Part-6)
4:00
|
|
|
|
Session-11 Sample Project Resources
|
|
|
Session-12 Databricks Prod Deployment & Spark and Databricks FQA
|
|
|
|
Session-11 Databricks Sample project Recap
1:00
|
|
|
|
Session-12 Agenda
1:00
|
|
|
|
Databricks Prod Deployment (Part-1)
35:00
|
|
|
|
Databricks Prod Deployment (Part-2)
23:00
|
|
|
|
Spark and Databricks FAQ's (Part-3)
16:00
|
|
|
|
Spark-Scenario based Question-Partition Skewness (Part-4)
9:00
|
|
|
|
Data Engineer Day to Day Work Style (Part-5)
11:00
|
|
|
|
Tips for getting a job (Part-6)
12:00
|
|
|
|
Session-12 Databricks Prod Deployment & FQA Resources
|
|
