Building Your First Data Pipeline in Azure Data Factory
|
Data Engineering is one of the hottest topics on IT right now, as the velocity, volume, and variety of data nowadays require skills beyond just traditional ETL. In this course, you’ll learn the basic concepts needed to work with Azure Data Factory.
Nowadays data is everywhere, and companies are increasingly interested on transforming this data on insights that can help them become more efficient and productive. In this course, Building Your First Data Pipeline in Azure Data Factory, you will learn foundational knowledge on Azure Data Factory, Microsoft’s main response to Data Engineering in the cloud. First, you will learn the concepts needed to create your own pipelines. Next, you will be introduced to data movement and transformation on ADF. Finally, you will see an example of using Data Factory to orchestrate activities to external compute resources. When you are finished with this course, you will have the skills and knowledge of Azure Data Factory needed to understand data movement, orchestration, and transformation activities.
Author Name: Emilio Melo
Author Description:
Emilio Melo is a globetrotting IT professional with projects in over 15 countries, mostly focused on Microsoft software. After 15 years of On Premises experience in Infrastructure, Data and Collaboration, he became fascinated by Cloud technologies and the incredible transformation potential it brings.
User Reviews
Be the first to review “Building Your First Data Pipeline in Azure Data Factory”
Related Products
Data Engineering with Microsoft Azure
Explore data engineering concepts on Microsoft Azure’s cloud platform.
Use Azure Synapse serverless SQL pool to query files in a data lake
With Azure Synapse serverless SQL pool, you can leverage your SQL skills to explore and analyze data in files, without the need to load the data into a relational database.
Explore fundamentals of large-scale analytics
Organizations use analytics platforms to build large scale data analytics solutions that generate insights and drive success. Microsoft provides multiple technologies that you can combine to build a large scale data analytics solution.
Create a lake database in Azure Synapse Analytics
Why choose between working with files in a data lake or a relational database schema? With lake databases in Azure Synapse Analytics, you can combine the benefits of both.
Transform data with Spark in Azure Synapse Analytics
Data engineers commonly need to transform large volumes of data. Apache Spark pools in Azure Synapse Analytics provide a distributed processing platform that they can use to accomplish this goal.
Transfer and transform data with Azure Synapse Analytics pipelines
Azure Synapse Analytics enables data integration through the use of pipelines, which you can use to automate and orchestrate data transfer and transformation activities.
There are no reviews yet.