Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline
|
In this module, you will learn how Azure Data Factory can orchestrate large scale data movement by using other Azure Data Platform and Machine Learning technologies.
Introduction, Understand data factory control flow, Work with data factory pipelines, Debug data factory pipelines, Add parameters to data factory components, Integrate a Notebook within Azure Synapse Pipelines, Execute data factory packages, Knowledge check, Summary
Prerequisites
The student should be able to:
Log into the Azure portal
Explain and create resource groups
Describe Azure Data Factory and it’s core components
Ingest data into Azure Data Factory using the Copy Activity
User Reviews
Be the first to review “Orchestrate data movement and transformation in Azure Data Factory or Azure Synapse Pipeline”
Related Products
Load data into a relational data warehouse
A core responsibility for a data engineer is to implement a data ingestion solution that loads new data into a relational data warehouse.
Use Apache Spark in Azure Databricks
Azure Databricks is built on Apache Spark and enables data engineers and analysts to run Spark jobs to transform, analyze and visualize data at scale.
Perform data engineering with Azure Synapse Apache Spark Pools
Apache Spark is a highly scalable distributed processing solution for big data analytics and transformation. You can leverage its power in Azure Synapse Analytics by using Spark pools.
Use Azure Synapse serverless SQL pools to transform data in a data lake
By using a serverless SQL pool in Azure Synapse Analytics, you can use the ubiquitous SQL language to transform data in files in a data lake.
Organizational Privacy Engineering
Explore organizational approaches to designing privacy-aware systems and frameworks for data governance.
Data Ingestion with Kafka and Kafka Streaming
Learn how to build real-time data ingestion pipelines using Apache Kafka.
There are no reviews yet.