Get started with data engineering on Azure
In most organizations, a data engineer is the primary role responsible for integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions. An Azure data engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints.
Prerequisites
Before starting this learning path, you should have completed the Microsoft Azure Data Fundamentals certification or have equivalent knowledge and experience.
User Reviews
Be the first to review “Get started with data engineering on Azure”
Related Products
Introduction to Azure Data Lake Storage Gen2
Data lakes are a core element of data analytics architectures. Azure Data Lake Storage Gen2 provides a scalable, secure, cloud-based solution for data lake storage.
Load data into a relational data warehouse
A core responsibility for a data engineer is to implement a data ingestion solution that loads new data into a relational data warehouse.
Transform data with Spark in Azure Synapse Analytics
Data engineers commonly need to transform large volumes of data. Apache Spark pools in Azure Synapse Analytics provide a distributed processing platform that they can use to accomplish this goal.
Perform data engineering with Azure Synapse Apache Spark Pools
Apache Spark is a highly scalable distributed processing solution for big data analytics and transformation. You can leverage its power in Azure Synapse Analytics by using Spark pools.
Use Delta Lake in Azure Synapse Analytics
Delta Lake is an open source relational storage area for Spark that you can use to implement a data lakehouse architecture in Azure Synapse Analytics.
Create a lake database in Azure Synapse Analytics
Why choose between working with files in a data lake or a relational database schema? With lake databases in Azure Synapse Analytics, you can combine the benefits of both.
There are no reviews yet.