Learn Azure Data Factory With 15+ Real Time Based Projects

What you’ll learn
By end of this course you will be able to develop pipeline in azure data factory
how to perform transformation in azure data factory
how to work in real time based on Industry level business use case
you will learn how to develop incremental load pipeline
you will be able to debug pipelines and trigger mail when it will fail
you will be able to understand about databricks architecture and how to use
how to do data cleaning and develop business insight metrics and all
complete 15+ real time projects
you will learn how to do parameterization in data pipeline
Industry level SCD type-1 projects
Industry level SCD type-2 projects
Failure handling and debug pipeline and learn about email alerts and all

Requirements
Good to have Azure Account for the practical lab
Good internet and laptop/desktop
Willing to learn

Description
This course will target anyone who likes to learn azure data factory and databricks . This course will cover all ADF components from the Model and View layer. In this course I have selected 15+ real time industry level project learning which will cover all the topic which is necessary to learn azure data factory and databricks and will be able to work on industry . This is completely hands on learning tutorial where we will do practical’s based learning and by end of this course we will develop a complete ADF application together (step by step) and By the end of this course, you should be able to develop a complete ADF application by yourself.If you will be able to practical’s with me you will be able to get complete picture of data factoryI have also included lessons on the storage blob Storage, amazon s3 , Azure SQL Database etc. Also, there are lessons on Azure Databricks. I have even included lessons on building reports using Power BI on the data processed by the Azure Data Factory data pipelines.this course designed for 1. Any one who wants to learn and get hands on azure data factory and databricks2. Any one looking for job change in the data engineering field3. Any one who is having knowledge about analytics4. Any one who wats to gain knowledge about industry level Business usecase.

Overview
Section 1: Introduction

Lecture 1 Introduction

Lecture 2 Course curriculam

Section 2: Project 1 : Amazon s3 to azure blob data pipeline

Lecture 3 Introduction and business use case

Lecture 4 Project Setup

Lecture 5 Project setup lab

Lecture 6 Project data pipeline lab

Section 3: Project 2 : azure blob to another azure blob data pipeline

Lecture 7 Introduction and Business Use Case

Lecture 8 project setup theory

Lecture 9 project setup lab

Lecture 10 Project data pipeline lab

Section 4: Project 3 : azure sql database to azure blob data pipeline

Lecture 11 Introduction and business usecase

Lecture 12 project setup theory

Lecture 13 project setup lab

Lecture 14 project data pipeline creation

Section 5: project 4 sql table specific columns transfer to azure blob data pipeline

Lecture 15 Introduction and business use case

Lecture 16 project setup theory

Lecture 17 project setup lab

Lecture 18 project create data pipeline

Section 6: project 5 : azure blob csv file to azure sql table data pipeline

Lecture 19 Introduction and business usecase

Lecture 20 project setup lab

Lecture 21 project create data pipeline

Section 7: project 6 : From 2 azure blob storage to output azure blob

Lecture 22 Introduction and business use case

Lecture 23 project setup lab

Lecture 24 project create data pipeline

Section 8: project 7 : 2 azure blob union + transformation to azure blob container

Lecture 25 Introduction and business usecase

Lecture 26 project setup lab

Lecture 27 project create data pipeline

Section 9: project 8 : dataflow transformation pipeline

Lecture 28 Introduction and business use case

Lecture 29 project setup lab

Lecture 30 project create data pipeline

Section 10: project 9 : Incremental data loading

Lecture 31 introduction and business use case

Lecture 32 project setup lab

Lecture 33 project create data pipeline

Section 11: project 10 parameterization project

Lecture 34 introduction and business use case

Lecture 35 project setup theory

Lecture 36 project setup lab

Lecture 37 project create data pipeline

Section 12: project 11 : SCD type 1 implementation real time project

Lecture 38 Introduction

Lecture 39 project setup theory

Lecture 40 project setup lab

Lecture 41 project create data pipeline scd type 1

Section 13: project 12: SCD type 2 implementation real time project

Lecture 42 Introduction

Lecture 43 project setup lab

Lecture 44 project setup lab

Lecture 45 project : create data pipeline scd type 2

Section 14: project 13: data pipeline failure monitoring and email send

Lecture 46 Introduction

Lecture 47 project setup lab

Lecture 48 project implementaion

Section 15: Databricks Introduction and architecture

Lecture 49 What is data bricks and architecture

Lecture 50 databricks overview and account creation

Section 16: project 14 ADF + DATA BRICKS + TABLEAU PROJECT

Lecture 51 PROJECT IMPLEMETATION

Section 17: Project 15 : covid dataset analysis in databricks

Lecture 52 mount amazon s3 to databricks and project implementation

Section 18: Project 16 : superstore dataset analysis in databricks

Lecture 53 project 16: superstore dataset datbricks project

Section 19: project 17 pyspark based project

Lecture 54 pyspark real time project

Any one who wants to learn and get hands on azure data factory and databricks,Any one looking for job change in the data engineering field,Any one who is having knowledge about analytics,Any one who wats to gain knowledge about industry level Business usecase,Beginners can also be able to start career in azure data factory and databricks