Building Batch Data Processing Solutions in Microsoft Azure
|
Azure Data Engineers design and implement data solutions in the Microsoft Azure cloud. This course will teach you how to use Azure products to perform batch data processing operations.
Long-running batch data processing can be difficult to manage locally – why not use Microsoft Azure? In this course, Building Batch Data Processing Solutions in Microsoft Azure, you’ll gain the ability to perform high-scale ETL and ELT operations entirely in the Azure public cloud. First, you’ll explore hosted Apache Spark processing with Azure Databricks. Next, you’ll discover how to transfer data in bulk with Azure Data Factory and Azure Data Explorer. Finally, you’ll learn how to handle stream data processing jobs with Azure Stream Analytics. When you’re finished with this course, you’ll have the skills and knowledge of batch data processing needed to earn your Azure Data Engineer certification and be productive with the Microsoft Azure Data Platform.
Author Name: Tim Warner
Author Description:
Timothy Warner is a Microsoft Most Valuable Professional (MVP) in Cloud and Datacenter Management who is based in Nashville, TN. His professional specialties include Microsoft Azure, cross-platform PowerShell, and all things Windows Server-related. You can reach Tim via Twitter (@TechTrainerTim), LinkedIn or his blog, AzureDepot.com.
Table of Contents
- Course Overview
0mins - Develop a Batch Processing Solution with Azure Databricks
35mins - Develop a Batch Processing Solution with Azure Synapse Analytics
31mins - Develop a Batch Processing Solution with Azure Data Explorer
20mins - Implement Event Processing with Azure Stream Analytics
17mins
User Reviews
Be the first to review “Building Batch Data Processing Solutions in Microsoft Azure”
Related Products
Load data into a relational data warehouse
A core responsibility for a data engineer is to implement a data ingestion solution that loads new data into a relational data warehouse.
Get started with data engineering on Azure
In most organizations, a data engineer is the primary role responsible for integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions. An Azure data engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints.
Data Streaming
Study techniques for real-time data processing and stream analytics.
Use Apache Spark in Azure Databricks
Azure Databricks is built on Apache Spark and enables data engineers and analysts to run Spark jobs to transform, analyze and visualize data at scale.
Build a data pipeline in Azure Synapse Analytics
Pipelines are the lifeblood of a data analytics solution. Learn how to use Azure Synapse Analytics pipelines to build integrated data solutions that extract, transform, and load data across diverse systems.
Create a lake database in Azure Synapse Analytics
Why choose between working with files in a data lake or a relational database schema? With lake databases in Azure Synapse Analytics, you can combine the benefits of both.
There are no reviews yet.