Build a data pipeline in Azure Synapse Analytics
|
Pipelines are the lifeblood of a data analytics solution. Learn how to use Azure Synapse Analytics pipelines to build integrated data solutions that extract, transform, and load data across diverse systems.
Describe core concepts for Azure Synapse Analytics pipelines., Create a pipeline in Azure Synapse Studio., Implement a data flow activity in a pipeline., Initiate and monitor pipeline runs.
Prerequisites
Before starting this module, you should be familiar with Azure Synapse Analytics and data analytics solutions in general. Consider completing the Introduction to Azure Synapse Analytics module first.
User Reviews
Be the first to review “Build a data pipeline in Azure Synapse Analytics”
Related Products
Explore fundamentals of large-scale analytics
Organizations use analytics platforms to build large scale data analytics solutions that generate insights and drive success. Microsoft provides multiple technologies that you can combine to build a large scale data analytics solution.
Use Spark Notebooks in an Azure Synapse Pipeline
Apache Spark provides data engineers with a scalable, distributed data processing platform, which can be integrated into an Azure Synapse Analytics pipeline.
Load data into a relational data warehouse
A core responsibility for a data engineer is to implement a data ingestion solution that loads new data into a relational data warehouse.
Transform data with Spark in Azure Synapse Analytics
Data engineers commonly need to transform large volumes of data. Apache Spark pools in Azure Synapse Analytics provide a distributed processing platform that they can use to accomplish this goal.
Use Azure Synapse serverless SQL pools to transform data in a data lake
By using a serverless SQL pool in Azure Synapse Analytics, you can use the ubiquitous SQL language to transform data in files in a data lake.
Data Engineering with Microsoft Azure
Explore data engineering concepts on Microsoft Azure’s cloud platform.
There are no reviews yet.