Description:
The Apache Airflow Next Steps course is intended for either of two audiences: 1) data engineers that already work with Apache Airflow on a daily basis and want to understand the new changes that Airflow 2 brings; or 2) data engineers that have taken the Apache Airflow Fundamentals course and want to expand their knowledge of the advanced topics of Apache Airflow.
The course begins by revisiting topics that are often not taught in an Airflow fundamentals class, such as connections, variables, templating, and Pools. Then, we reformulate how we create DAGs under the new paradigms of Apache Airflow 2.x.
Next, we expand on a fundamental topic for any Airflow in Production: Security in Airflow. Finally, we teach Airflow in Kubernetes and how to scale within Kubernetes.
This course focuses on the practical aspects of how to use Airflow and is 70% hands-on, 30% lecture, demo, and discussion.
This Apache Airflow Next Steps course is taught using Python > 3.5 and Airflow > 2.1.
Duration: 3 Days
Course Code: BDT292
Learning Objectives:
After this course, you will be able to:
Course Outline:
Creating DAGs the right way
Modularize your DAGs
Airflow Security
Airflow in Kubernetes
A note on upgrading from Airflow 1.10
Training material provided: Yes (Digital format)
