Automate Data Pipelines
|
Learn techniques for automating data pipelines for faster data processing.
In this course, you’ll build pipelines leveraging Airflow DAGs to organize your tasks along with AWS resources such as S3 and Redshift.
User Reviews
Be the first to review “Automate Data Pipelines”
Related Products
Organizational Privacy Engineering
Explore organizational approaches to designing privacy-aware systems and frameworks for data governance.
Data lakes and Lakehouses with Spark and Azure Databricks
Learn to manage and process data using Spark and Azure Databricks platforms.
Introduction to Azure Data Lake Storage Gen2
Data lakes are a core element of data analytics architectures. Azure Data Lake Storage Gen2 provides a scalable, secure, cloud-based solution for data lake storage.
Designing Data Systems
Master the principles of designing data systems that handle large-scale data efficiently.
Use Delta Lake in Azure Synapse Analytics
Delta Lake is an open source relational storage area for Spark that you can use to implement a data lakehouse architecture in Azure Synapse Analytics.
Transfer and transform data with Azure Synapse Analytics pipelines
Azure Synapse Analytics enables data integration through the use of pipelines, which you can use to automate and orchestrate data transfer and transformation activities.
There are no reviews yet.