Published 6/2024
Created by A. K Kumar
MP4 | Video: h264, 1280×720 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English | Duration: 50 Lectures ( 3h 56m ) | Size: 1.99 GB
Learn Databricks concepts, Pyspark, DLT Using SQL,DLT Using Python, DLT Use Case
What you’ll learn:
Azure Databricks DLT
DLT using SQL
DLT using Python
DLT : Build Lakehouse using DLT
Requirements:
Basic Python Skills
Basic SQL Skills
Azure Account
Description:
Module 1:•Setup Azure Account•Setup Workspace•Navigate the Workspace•Clusters•What is Notebook•What is Libraries•Databricks File System (DBFS)•DBUTILSModule 2 :•What is Data Lakehouse Architecture•What Is Delta Lake•Lab : Create Delta Table•Lab : Delta Ingestion•Lab : Update / Delete / Merge•Lab : Schema Validation•Lab : Generated ColumnsModule 3:•Understanding Delta Live Tables•Lab: Develop Delta Live Tables using CSV File•Lab: How to add Schema into CSV data in DTL•Lab: Develop Delta Live Tables using JSON & Parquet File•Lab: Build Streaming DLT Pipeline using CSV•Lab: Build Streaming DLT Pipeline using JSON•Lab: DLT Transformation Part-1•Lab: DLT Transformation Part-2•Lab: Data Quality Check in DLTModule 4:•Lab : Create First Delta Live Table Pipeline•Lab : DLT Schema Evolution•Lab : Change the Schema in the DLT Pipeline•Lab : Build Streaming DLT Pipeline•Lab : Schema Evolution into Streaming DLT Pipeline•Lab : Quality Check•Lab : Reusable Quality Checks•Lab : DLT with SQL Server & Parameterized PipelineModule 5:•Project Use Case•Medallion Lakehouse architecture•Configure SQL Server•Build : Product Ingestion Layer•Build : Customer Ingestion Layer•Build : Order Ingestion Layer•Configure Event Hub & Create Producer•Build : Streaming Ingestion Layer•Develop Bronze Layer•Build Silver Products Pipeline•Build Silver Customer Pipeline•Build Silver Order Pipeline•Build Silver Online Event Pipeline•Build Silver Weblogs Pipeline•Build GOLD layer•Build KPI Queries•Build Dashboard
Who this course is for:
Data Engineering Students & Developers
Bigdata Developer
Python & SQL Developer
Homepage
https://anonymz.com/?https://www.udemy.com/course/databricks-delta-live-table-dlt/