Introduction to Apache Airflow in Python
|
Learn how to implement and schedule data engineering workflows.
Now Updated to Apache Airflow 2.7 – Delivering data on a schedule can be a manual process. You write scripts, add complex cron tasks, and try various ways to meet an ever-changing set of requirements—and it’s even trickier to manage everything when working with teammates. Apache Airflow can remove this headache by adding scheduling, error handling, and reporting to your workflows. In this course, you’ll master the basics of Apache Airflow and learn how to implement complex data engineering pipelines in production. You’ll also learn how to use Directed Acyclic Graphs (DAGs), automate data engineering workflows, and implement data engineering tasks in an easy and repeatable fashion—helping you to maintain your sanity.
User Reviews
Be the first to review “Introduction to Apache Airflow in Python”
Related Products
Data Engineering
Learn how to build, optimize, and maintain data pipelines for data processing and storage.
Explore fundamentals of large-scale analytics
Organizations use analytics platforms to build large scale data analytics solutions that generate insights and drive success. Microsoft provides multiple technologies that you can combine to build a large scale data analytics solution.
Use Azure Synapse serverless SQL pools to transform data in a data lake
By using a serverless SQL pool in Azure Synapse Analytics, you can use the ubiquitous SQL language to transform data in files in a data lake.
Designing Data Systems
Master the principles of designing data systems that handle large-scale data efficiently.
Load data into a relational data warehouse
A core responsibility for a data engineer is to implement a data ingestion solution that loads new data into a relational data warehouse.
Data Pipelines with Azure
Build scalable data pipelines using Microsoft Azure tools.
There are no reviews yet.