arrow_back
[FREE Session] Master in Databricks Introduction
Databricks Course Introduction
Databricks Course Curriculum
Databricks Course presentation
Join Our WhatsApp Group
[Session-1] Spark Fundamentals
Spark Features and Eco System (Part-1)
sparkContext Vs sparkSession (Part-2)
Spark worker node - container - executor (Part-3)
Spark On Heap Memory (Part-4)
Spark Off Heap Memory (Part-5)
Spark Garbage Collector (Part-6)
Spark Runtime Architecture Cluster Mode (Part-7)
Spark Runtime Architecture Client Mode (Part-8)
Spark Client Mode and Cluster Mode Differences (Part-9)
Spark Fundamentals Bonus Session
Session-1 Spark Fundamentals Resources
[Session-2] Spark Important Concepts
Session-1 Recap
Session-2 Agenda
Driver and Executor Memory Allocation (Part-1)
Executor Memory Allocation Deep Dive (Part-2)
Spark Program Execution Scenarios (Part-3)
Spark Executor Memory and cores calculations (Part-4)
Spark Application-Job-Stage (Part-5)
Spark Directed Acyclic Graph (DAG) (Part-6)
One Spark Application with Multiple Sessions (Part-7)
Bonus Q&A
Session-2 Spark Important Concepts Resources
[Session-3] Spark-Databricks Fundamentals
session-2 Spark Important Concepts Recap
Session-3 Spark-Databricks Fundamentals Agenda
Spark-Application-Jobs-Stages-Tasks (Part-1)
Spark-Transformations and Actions (Part-2)
Spark-RDD-DataFrame-Datasets (Part-3)
Spark-RDD-DataFrame-Datasets Differences (Part-4)
Spark- Missing Key Features (Part-5)
Databricks Introduction (Part-6)
Databricks Workspace UI Walkthrough (Part-7)
Databricks Workspace Creation (Part-8)
Databricks Cluster Creation (Part-9)
Azure ADLS Storage Creation (Part-10)
Spark Cluster Configuration and DBX secret scope creation (Part-11)
Spark-Databricks Q&A Bonus
Session-3 Spark Databricks Fundamentals Resources
[Session-4] Databricks- Spark-Hands On
Session-3 Spark-Databricks Fundamentals Recap
Databricks Notebook Magic Commands (Part-1)
Databricks DBUtils (Part-2)
Creating RDDs and DataFrames (Part-3)
Creating DataFrames from DBFS (Part-4)
DataFrame Read and Write Operations with different file formats (Part-5)
DataFrame creation with manual schema (Part-6)
Different Types of Tables and Views (Part-7)
Session-4 Bonus
Session-4 Databricks-Spark-Hands on-Resources
[Session-5] Databricks - Lake House Architecture
Session-4 Recap
Session-5 Agenda
Types of SCDs (Part-1)
Spark Narrow and Wide Transformations (Part-2)
Data Warehouse Concepts (Part-3)
Data Lake Concepts (Part-4)
Delta Table and Delta Lake Concepts (Part-5)
Lakehouse Architecture (Part-6)
Data Warehouse Vs Data Lake Vs Lakehouse (Part-7)
Delta Tables - Time Travel and History - Practical's (Part-8)
Spark Databricks Bonus Session
Session-5 Databricks - Lake House Architecture Resources
[Session-6] Databricks Unity Catalog
Session-5 Recap
Databricks Unity Catalog Agenda
Features of Unity Catalog (Part-1)
Unity Catalog Realtime Implementation Scenario (Part-2)
Unity Catalog Implementation Steps (Part-3)
Unity Catalog Key Roles (Part-4)
Unity Catalog Implementation Steps - Practical's (Part-5)
Grant UC Access on databricks groups-Practical's (Part-6)
Grant UC Access-CLS and RLS-Practicals (Part-7)
Tables Lineage in Unity Catalog-Practical's (Part-8)
Databricks Unity Catalog Bonus
Session-6 Unity Catalog Resources
[Session-7] Databricks Auto Loader
Session-6 Databricks Unity Catalog Recap
Session-7 Databricks Auto Loader Agenda
Spark Structured Streaming Theory (Part-1)
Spark Structured Streaming Drawbacks Theory (Part-2)
Databricks Auto Loader Intro (Part-3)
Incremental Load by uinsg the watermark column-Practical (Part-4)
Spark Structured Streaming with Manual Schema Evaluation (Part-5)
Spark Structured Streaming with Automatic Schema Evaluation (Part-6)
Databricks Auto Loader (Part-7)
Session-7 Autoloader Resources
[Session-8] Performance Optimization Techniques in Databricks
Session-7 Databricks Auto Loader Recap
Session-8 Databricks Performance Optimization Agenda
Databricks Performance Optimization Intro
Performance Tuning by using the OPTIMIZE Technique (Part-1)
Performance Tuning by using the ZORDER Technique (Part-2)
VACUUM Implementation in Databricks (Part-3)
Session-8 Databricks Performance Optimization Resources
sales dataset kaggle link
[Session-9] Spark Performance Optimization Techniques
Session-8 Databricks Performance Optimization Techniques Recap
Session-9 Spark Performance Optimization Agenda
Spark Performance Optimization-broadcast join Theory (Part-1)
Spark Performance Optimization-broadcast join Lab (Part-2)
Spark Performance Optimization-Partitioning and Bucketing Theory (Part-3)
Spark Performance Optimization-Partitioning and Bucketing Lab (Part-4)
Spark Performance Optimization-Cache and Persist Theory (Part-5)
Spark Performance Optimization-Cache and Persist Lab (Part-6)
Session-9 Spark Performance Optimzation Resources
Sales dataset kaggle link
[Session-10] Databricks Delta Live Tables and Types of Clusters
Session-9 Spark Performance Optimization Recap
Session-10 Databricks Delta Live Tables and Clusters Agenda
Databricks Types of Clusters (Part-1)
Databricks SQL Warehouses (Part-2)
Databricks Clusters Pricing Calculations (Part-3)
Databricks Delta Live Tables Theory (Part-4)
Databricks Delta Live Tables Overview and Setup (Part-5)
Databricks Delta Live Tables Lab (Part-6)
Session-10 Delta Live Tables Resources
[Session-11] Databricks Sample Project on GCP
Session-10 Databricks Delta Live Tables Recap
Session-11 Databricks Sample project on GCP Agenda
Infra Setup on GCP for Databricks Sample project (Part-1)
Databricks Sample project Overview (Part-2)
Databricks Sample project Code Walkthrough (Part-3)
Databricks Sample project Code Walkthrough (Part-4)
Databricks Sample project - DLT Pipeline Execution (Part-5)
Databricks Sample project - PowerBI Connectivity (Part-6)
Session-11 Sample Project Resources
Session-12 Databricks Prod Deployment & Spark and Databricks FQA
Session-11 Databricks Sample project Recap
Session-12 Agenda
Databricks Prod Deployment (Part-1)
Databricks Prod Deployment (Part-2)
Spark and Databricks FAQ's (Part-3)
Spark-Scenario based Question-Partition Skewness (Part-4)
Data Engineer Day to Day Work Style (Part-5)
Tips for getting a job (Part-6)
Session-12 Databricks Prod Deployment & FQA Resources