Complete Azure Data Factory With Projects And Scenario
Published 9/2024
MP4 | Video: h264, 1920x1080 | Audio: AAC, 44.1 KHz
Language: English | Size: 3.17 GB | Duration: 8h 9m

Complete Azure data factory with projects and scenario

What you'll learn

By end of this course you will be able to develop pipeline in azure data factory

how to perform transformation in azure data factory

how to work in real time based on Industry level business use case

azure data factory scenario based question

you will learn how to do parameterization in data pipeline

Complete adf with projects

Requirements

Good to have Azure Account for the practical lab

Good internet and laptop/desktop

Willing to learn

Description

This course will target anyone who likes to learn azure data factory . This course will cover all ADF components from the Model and View layer. In this course I have covered complete adf with industry level project . This is completely hands on learning tutorial where we will do practical's based learning and by end of this course we will develop a complete ADF application together (step by step) and By the end of this course, you should be able to develop a complete ADF application by yourself.If you will be able to practical's with me you will be able to get complete picture of data factoryI have also included lessons on the storage blob Storage, Azure SQL Database etc. this course designed for 1. Any one who wants to learn and get hands on azure data factory 2. Any one looking for job change in the data engineering field3. Any one who is having knowledge about analytics4. Any one who wats to gain knowledge about industry level Business use case.please do practice with azure account you will get complete ideas about azure data factory from this.we get free 30 days free azure account that you can utilize for practice.

Overview

Section 1: Introduction

Lecture 1 Introduction

Lecture 2 Dataset download

Section 2: Azure data factory

Lecture 3 adf

Lecture 4 2. How to create azure data factory

Lecture 5 3. azure data factory components

Lecture 6 4. azure storage account

Lecture 7 5. COPY Activity

Lecture 8 6. DELETE ACTIVITY

Lecture 9 7. AZURE SQL DATABASE CREATION

Lecture 10 8. AZURE BLOB to SQL COPY ACTIVITY

Lecture 11 9. TRIGGERS IN ADF

Lecture 12 10. Scheduled Trigger in adf

Lecture 13 11. EVENT BASED TRIGGER IN ADF

Lecture 14 12. TUMBLING WINDOW TRIGGER IN ADF

Lecture 15 13. DATA FLOW IN ADF

Lecture 16 14. JOIN Transformation in ADF

Lecture 17 15. UNION TRANSFORMATION IN ADF

Lecture 18 16. SELECT TRANSFORMATION IN ADF

Lecture 19 17. DERIVED COLUMN TRANSFORMATION IN ADF

Lecture 20 18. aggregate transformation in adf

Lecture 21 19. PARAMETERIZATION DATASET

Lecture 22 20. LINKED SERVICE PARAMETERIZATION

Lecture 23 21. PIPELINE PARAMETERIZATION

Lecture 24 22. FILE NAMING IN ADF

Lecture 25 23. GET METADATA ACTIVITY IN ADF

Lecture 26 24. FOR EACH ACTIVITY IN ADF

Lecture 27 25. IF CONDITION ACTIVITY IN ADF

Lecture 28 26. SET VARIABLE ACTIVITY IN ADF

Lecture 29 27. APPEND VARIABLE ACTIVITY IN ADF

Lecture 30 28. STORE PROCEDURE ACTIVITY

Lecture 31 29. LOOKUP ACTIVITY IN ADF

Lecture 32 30. WAIT ACTIVITY IN ADF

Lecture 33 31. SWITCH ACTIVITY IN ADF

Lecture 34 32. VALIDATION ACTIVITY IN ADF

Lecture 35 33. EXECUTE PIPELINE ACTIVITY

Lecture 36 34. FILTER ACTIVITY

Lecture 37 35. UNTIL ACTIVITY IN ADF

Lecture 38 36. WEB ACTIVITY IN ADF

Lecture 39 37. FAIL ACTIVITY IN ADF

Lecture 40 38. SCRIPT ACTIVITY IN ADF

Lecture 41 39. EXIST TRANSFORMATION

Lecture 42 40. CONDITION SPLIT TRANSFORMATION

Lecture 43 41. PIVOT TRANSFORMATION

Lecture 44 42. UNPIVOT TRANSFORMATION

Lecture 45 43. SURROGATE KEY TRANSFORMATION

Lecture 46 44. WINDOWS TRANSFORMATION

Lecture 47 45. ALTER ROW TRANSFORMATION

Lecture 48 46. RANK TRANSFORMATION

Lecture 49 47. ERROR SOLUTION - AZURE SQLDATABASE V2 ERROR IN ADF

Lecture 50 48. IMPORT SCHEMA FAILED ERROR

Lecture 51 49. DATAFLOW IMPORT SCHEMA FAILED

Section 3: PROJECTS : AZURE DATA FACTORY

Lecture 52 1. SCD TYPE -1 PROJECT

Lecture 53 EMPTY FILE SCENARIO

Lecture 54 DELETE FILE SCENARIO

Lecture 55 DATA MIGRATION PROJECT

Lecture 56 SCD TYPE 2 PROJECT

Lecture 57 VALIDATION SCHEMA PROJECT

Lecture 58 Multiple csv file transfer scenario

Any one who wants to learn and get hands on azure data factory,Any one looking for job change in the data engineering field,Any one who is having knowledge about analytics,Any one who wats to gain knowledge about industry level Business usecase,Beginners can also be able to start career in azure data factory and databricks