Apache Airflow Tutorial for Beginners
Learn Apache Airflow basics, including pipeline execution, scheduling, monitoring, and using Kubernetes Pod Operator through practical demonstrations and live examples.
Airflow - Zero to Hero
Learn to install, run, and master Airflow: core concepts, DAGs, task retries, metadata passing, branching, sensors, and hooks for efficient workflow automation.
Apache Airflow: Where Data Engineers and ML Engineers Meet
Explore production-quality Generative AI pipelines using Apache Airflow. Learn to orchestrate workflows, integrate data engineering, and implement MLOps best practices for robust AI applications.
Airflow: Where Data Engineers and ML Engineers Meet
Explore Apache Airflow's role in operational machine learning with a real-world demo and reference implementation of GenAI in production.
Apache Airflow Tutorials
Learn Apache Airflow fundamentals, set up environments, write pipelines, and integrate with Google Cloud services. Gain practical skills for efficient workflow automation and data pipeline management.
Apache Airflow with Python
Aprende Apache Airflow con Python: operadores de email, Docker Compose, autenticación de usuarios, paralelismo con Pandas, y almacenamiento de logs en AWS S3.
Apache Airflow
Comprehensive tutorials on Apache Airflow covering DAGs, operators, Kubernetes Executors, Docker, AWS integration, and more. Ideal for mastering workflow automation and orchestration.
Apache Airflow 101
Learn to programmatically author, schedule, and monitor workflows using Apache Airflow. Covers installation, DAGs, operators, and hands-on examples with MySQL and email integration.
Apache Airflow Tutorials
Aprende a instalar y usar Apache Airflow con operadores Spark, Hive y Sqoop en Windows, con tutoriales en inglés y tamil.
Streamlining AI Workflows with Apache Airflow and Ray
Discover how to build a unified AI infrastructure by integrating Apache Airflow and Ray for seamless orchestration of data processing, model training, and inference workflows, including LLM fine-tuning and LoRA deployments.
Airflow 2.0
Aprende a usar Airflow 2.0 para ingeniería de datos, crear ETL con Spotify y Python, y desplegar en Kubernetes con k3d y Helm charts.
Navigating the Landscape of a Fully Open Source Data Stack in 2023
Explore the architecture of modern data stacks, from warehousing to streaming solutions, while understanding the potential and limitations of open-source tools in today's data infrastructure.
Building a Robust Data Pipeline with the DAG Stack - dbt, Airflow, and Great Expectations
Learn to build robust data pipelines using dbt, Airflow, and Great Expectations. Discover how these tools complement each other to ensure data quality, perform transformations, and orchestrate workflows effectively.
From Idea to Model: Productionizing Data Pipelines with Apache Airflow
Learn to productionize data pipelines using Apache Airflow, bridging data science and engineering. Explore collaborative workflows, custom operators, and scalable solutions for efficient model deployment and iteration.
Hot Technologies in Data Analytics - What You Need to Learn
Discover essential emerging technologies in Data Analytics and learn how to evaluate them for your career advancement.
Modern ETL Pipelines with Change Data Capture - Building Resilient Data Streams
Discover how GetYourGuide built a resilient ETL pipeline using Debezium, Kafka, Spark, and Airflow. Learn to handle schema changes automatically, stream data from SQL databases, and refresh data lakes multiple times daily for fresher insights.
Orchestrating Data Assets Instead of Tasks, With Dagster - Sandy Ryza
Explore data orchestration with Dagster, focusing on managing data assets over tasks. Learn about pipeline development, testing, deployment, and monitoring in data engineering and machine learning.
Astronomer's Journey from Cloud Lock-in to Open Source Independence
Discover how Astronomer transitioned from AWS-managed services to open-source solutions, enhancing flexibility and independence in their data engineering platform.
Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project
Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.
Orchestrating Scalable Data Pipelines with Apache Toree, YuniKorn, Spark, and Airflow
Explore integrated use of Apache Toree, YuniKorn, Spark, and Airflow for efficient, scalable data pipelines. Learn to leverage these projects for optimized data processing and workflow orchestration.
Apache Airflow 2.x - Modern Workflow Orchestration Features and Improvements
Discover the modern evolution of Apache Airflow 2.x, exploring new UI features, orchestration methods, and testing capabilities while maintaining backward compatibility for workflow management.