Azure Databricks Master Program [real time scenarios + Labs]

What you’ll learn:
Implementing Architecture for big data analytics projects using databricks
Deep knowledge on Azure Databricks Internal Architecture
Internals of Spark Architecture and How Execution Engine works
Creating data pipelines in databricks
Transforming data using Spark core and Spark SQL

Requirements:
Everything will be discussed from scratch

Description:
What is Azure DatabricksChallenges to solutions with Azure DatabricksHistory of Azure DatabricksAzure Databricks ArchitectureAzure Databricks Data Flow ArchitectureBatch Data Processing with Azure DatabricksStream Data Processing with Azure DatabricksMachine Learning on batch data with Azure DatabricksInterfaceWorkspaceData ManagementComputation ManagementModel ManagementAuthentication and AuthorizationHow to login  into azure portalHow to create Azure Databricks DashboardHomeWorkspaceRecentData ManagementComputation ManagementModel ManagementJob ManagementSearchCreating and configuring clusters in Azure DatabricksHow to create Python notebookHow to create Scala notebookHow to create SQL notebookHow to create R notebookHow to login  into azure portalHow to create Azure Databricks Creating and configuring clusters in Azure DatabricksHow to create notebookHow to detach and attach notebook to another clusterHow to Export Notebook in different formatsHow to Import Notebook from different formatsHow to clone NotebookHow to move NotebookHow to change default language of NotebookHow to move cellsHow to create and delete cellsHow to use shortcuts to execute cellsHow to comment code in notebookAll Options available on NotebookHow to create new database in Azure DatabricksHow to describe database in Azure DatabricksHow to drop database in Azure DatabricksHow to drop Non empty database in Azure DatabricksHow to create table with UIHow to create table with NotebookDifference between table with UI and table with notebookHow to create table in specified database with UIHow to create table in specified database with NotebookHow to create empty table How to create Partition table with NotebookHow to append or overwrite partitions in tableHow to describe table in Azure DatabricksHow to drop table in Azure DatabricksHow to upload data into Databricks File SystemCommand to create directory in dbfsCommand to create file and write data to itCommand to display file contentCommand to list down content in a directoryCommand to move files from one directory to another directoryCommand to copy file from one directory to another directoryCommand to remove file and directories Command to mount and unmount file systemCommand to list down mountCommand to refresh mount pointsCommand to install the packagesCommand to find current notebook path/ from UICommand to run one notebook from another notebookCommand to exit notebook executionCommand to list down secret scopesWhat is widget and TypesHow to create widget to pass dynamic values to Python notebookHow to read dynamic parameter values in Python notebookHow to remove widget from python notebook How to create widget to pass dynamic values to Scala notebookHow to read dynamic parameter values in  Scala notebookHow to remove widget from scala notebookHow to run notebook whenever we change the dynamic parameter valuesWidgets panel settingsPrerequisites to install databricks cliHow to install databricks cliHow to authenticate to databricks workspace from cliHow to create clusterHow to terminate clusterHow to start clusterHow to restart clusterHow to get list of clustersHow to get list of notebookHow to import notebook into databricks from localHow to export notebookHow to remove notebookHow to create foldersHow to get list of folders in dbfsHow to create folder in dbfsHow to copy files from local to dbfsHow to move file from one folder to another folderHow to remove files from dbfsHow to remove folders from dbfsHow to install librariesHow to uninstall librariesHow to create jobHow to run job 1. PySpark Read CSV file into DataFrameRead single fileRead all CSV files in a directory2. Options while reading CSV filedelimiterInferSchemaheader3. Read CSV files with a user-specified schema

Who this course is for:
University Students
Software Engineers
Architects