Airflow: The Airflow 101 learning path

The Airflow 101 learning path guides you through the foundational skills and knowledge you need to start with Apache Airflow 2. This includes the core concepts, the Airflow UI, creating your first data pipeline following best practices, how to schedule this data pipeline efficiently and more! Airflow 101: Building Your First Workflow ¶ Welcome to world of Apache Airflow ! In this tutorial, we’ll guide you through the essential concepts of Airflow , helping you understand how to write your first Dag. Whether you’re familiar with Python or just starting out, we’ll make the journey enjoyable and straightforward. What is a Dag? ¶ At its core, a Dag is a collection of tasks organized in a way that reflects their relationships and dependencies. It’s like a roadmap for your ... What is Airflow ®? ¶ Apache Airflow ® is an open-source platform for developing, scheduling, and monitoring batch-oriented workflows. Airflow ’s extensible Python framework enables you to build workflows connecting with virtually any technology. A web-based UI helps you visualize, manage, and debug your workflows. You can run Airflow in a variety of configurations — from a single process on your laptop to a distributed system capable of handling massive workloads. Workflows as code ...