Apache Airflow
Explore a comprehensive series of tutorials and hands-on videos covering various aspects of Apache Airflow. Dive into topics such as the ExternalTaskSensor, defining variables through environment variables, fixing dependencies errors, and scaling with Kubernetes Executors. Learn about password authentication, filtering by owner, variables, macros, and templating. Discover how to implement metrics for monitoring, use timezones, and work with the DockerOperator. Build and run your first Airflow Docker image, use the Sequential Executor, and interact with PostgreSQL using Hooks. Master DAG creation, understand SubDAGs, and explore different types of Operators. Gain insights into storing logs in AWS S3, running Airflow with KubernetesExecutor on multi-node clusters, and integrating with AWS RDS. Delve into advanced concepts like XCom, BranchPythonOperator, TaskGroups, and TriggerDagRunOperator. Set up Airflow 2.0 with Docker, configure LDAP, and get started with the Airflow Helm Chart and Sensors. Read more