Data engineers working with Azure Data Factory can take advantage of Continuous Integration and Continuous Delivery practices to deploy robust and well-tested data pipelines to production. In this course, Deploying Data Pipelines in Microsoft Azure, you will learn foundational knowledge to apply CI/CD methodologies to your data pipeline creation process. First, you will learn to create the right environments to fall into the pit of success when creating data pipelines in ADF. Next, you will discover how to deploy data pipelines using ADF visual tools and ARM templates. Finally, you will explore how to create a release pipeline in Azure DevOps to automate the deployment process between three distinct environments: development, staging, and production. When you are finished with this course, you will have the skills and knowledge to apply CI/CD practices to your data pipeline creation process, effortlessly.
Author Name: Marcelo Pastorino
Author Description:
Marcelo has accumulated over two decades of expertise, adeptly aligning business goals with innovative technological solutions. Initiating his coding journey in the early 90s on an IBM 8086 XT, he became proficient in languages such as Clipper, Pascal and C++. By his mid-teens, Marcelo had already crafted and commercialized software for the DOS operating system. In the current tech landscape, his specialization encompasses technologies like .NET, C#, JavaScript, NextJS, SvelteKit, and cloud-base… more

Table of Contents

• Course Overview
  1min
• Getting Started Deploying Data Pipelines in Azure
  6mins
• Creating the Data Pipeline Deployment Infrastructure
  9mins
• Creating Azure Data Factory Environments
  13mins
• Integrating Azure Data Factory Pipelines with Source Control Using Azure DevOps
  8mins
• Deploying Data Pipelines Using ARM Templates and Azure DevOps
  20mins
• Implementing Continuous Integration and Delivery of Azure Data Factory Pipelines Using Azure DevOps
  28mins