Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline
|
In this module, you will learn the various methods that can be used to ingest data between various data stores using Azure Data Factory.
Introduction, List the data factory ingestion methods, Describe data factory connectors, Exercise: Use the data factory copy activity, Exercise: Manage the self hosted integration runtime, Exercise: Set up the Azure integration runtime, Understand data ingestion security considerations, Knowledge check, Summary
Prerequisites
The student should be able to:
Log in to the Azure portal
Explain and create resource groups
Describe Azure Data Factory and its core components
User Reviews
Be the first to review “Petabyte-scale ingestion with Azure Data Factory or Azure Synapse Pipeline”
Related Products
Introduction to Azure Data Lake Storage Gen2
Data lakes are a core element of data analytics architectures. Azure Data Lake Storage Gen2 provides a scalable, secure, cloud-based solution for data lake storage.
Automate Data Pipelines
Learn techniques for automating data pipelines for faster data processing.
Explore fundamentals of large-scale analytics
Organizations use analytics platforms to build large scale data analytics solutions that generate insights and drive success. Microsoft provides multiple technologies that you can combine to build a large scale data analytics solution.
Load data into a relational data warehouse
A core responsibility for a data engineer is to implement a data ingestion solution that loads new data into a relational data warehouse.
Get started with data engineering on Azure
In most organizations, a data engineer is the primary role responsible for integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions. An Azure data engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints.
Organizational Privacy Engineering
Explore organizational approaches to designing privacy-aware systems and frameworks for data governance.
There are no reviews yet.