Optimize Storage and Performance with Delta Lake
Delta Lake internals, ACID, OPTIMIZE, Z-Order, liquid clustering, caching and Photon acceleration.
Level: Intermediate / Advanced | Platform: Azure Databricks Premium
Sign in to read this course
A free account unlocks all 514 courses. 20 are readable without one.
What's inside
35 sections- 1 Table of Contents
- 2 Data Lakehouse Architecture and Delta Lake
- 3 Storage Formats Compared
- 4 Delta Tables and Transaction Log
- 5 ACID Properties in Delta Lake
- 6 Creating and Managing Delta Tables
- 7 Loading Data from ADLS Gen2
- 8 Streaming to Delta Tables
- 9 Schema Enforcement and Evolution
- 10 Delta Lake Optimization Techniques
- 11 Partitioning — Directory-based Organization
- 12 Z-Order — Data Co-location
- 13 OPTIMIZE — Small File Compaction
- 14 Liquid Clustering — Adaptive Partitioning
- 15 Delta Caching — Local Acceleration
- 16 Data Skipping and Column Statistics
- 17 Photon Acceleration
- 18 Time Travel and Versioning
- 19 VACUUM — Cleaning Up Obsolete Files
- 20 Monitoring Delta Tables
- 21 Optimistic Concurrency Control
- 22 Advanced Azure Use Cases
- 23 Summary and Best Practices
- 24 Glossary
- 25 Module 2 – Working with Delta Lake
- 26 Module 3 – Optimizing Performance
- 27 Module 4 – Data Integrity and Versioning
- 28 Azure Use Cases with Delta Lake
- 29 Delta Lake Command Reference
- 30 Module 5 – Photon Engine
- 31 Module 6 – OPTIMIZE and Z-ORDER
- 32 Module 7 – Delta Lake Internals
- 33 Module 8 – Caching in Depth
- 34 Module 9 – Adaptive Query Execution (AQE)
- 35 Module 10 – Join Optimizations
More Azure Databricks & Spark courses
View all 14Administering Clusters and Configuring Policies with Databricks
Databricks architecture, cluster types and runtimes, autoscaling, cluster policies, pools and init scripts.
ETL Pipelines with Azure Databricks and Data Factory
Build ETL with Spark and PySpark, Unity Catalog governance, Delta Lake and Databricks vs Data Factory.
Manage Data with Azure Databricks and Azure Data Lake
Connect Databricks to ADLS Gen2 securely, ingest with Auto Loader and govern with Unity Catalog.
Real-Time Data Processing with Azure Databricks
Spark Structured Streaming with Event Hubs — windowing, stateful processing and real-time anomaly detection.
Machine Learning with Azure Databricks
The Databricks ML lifecycle: MLflow tracking, tuning with Ray, the model registry, serving and AutoML.
Building Deep Learning Models on Databricks
Build, train, tune and serve deep-learning models on Databricks with TensorBoard integration.
Interested in this course?
Contact us to book it or get a custom training plan for your team.