Use Azure Synapse serverless SQL pools to transform data in a data lake
|
By using a serverless SQL pool in Azure Synapse Analytics, you can use the ubiquitous SQL language to transform data in files in a data lake.
Use a CREATE EXTERNAL TABLE AS SELECT (CETAS) statement to transform data., Encapsulate a CETAS statement in a stored procedure., Include a data transformation stored procedure in a pipeline.
Prerequisites
Consider completing Use Azure Synapse serverless SQL pool to query files in a data lake before starting this module. You will need the following knowledge or experience:
Familiarity with Azure Synapse Analytics.
Experience using Transact-SQL to query and manipulate data.
User Reviews
Be the first to review “Use Azure Synapse serverless SQL pools to transform data in a data lake”
Related Products
Introduction to Azure Data Lake Storage Gen2
Data lakes are a core element of data analytics architectures. Azure Data Lake Storage Gen2 provides a scalable, secure, cloud-based solution for data lake storage.
Introduction to data engineering on Azure
Microsoft Azure provides a comprehensive platform for data engineering; but what is data engineering? Complete this module to find out.
Data Engineering
Learn how to build, optimize, and maintain data pipelines for data processing and storage.
Spark and Data Lakes
Learn how to process big data using Apache Spark and manage data lakes.
Get started with data engineering on Azure
In most organizations, a data engineer is the primary role responsible for integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions. An Azure data engineer also helps ensure that data pipelines and data stores are high-performing, efficient, organized, and reliable, given a specific set of business requirements and constraints.
Transform data with Spark in Azure Synapse Analytics
Data engineers commonly need to transform large volumes of data. Apache Spark pools in Azure Synapse Analytics provide a distributed processing platform that they can use to accomplish this goal.
There are no reviews yet.