Главная
Study mode:
on
1
intro
2
preamble
3
agenda
4
what is airflow? who is astronomer?
5
why test data pipelines?
6
local development and testing
7
astro cli and airflow cli testing features
8
dag.test
9
ci/cd and testing
10
from dev to staging
11
dag validation testing
12
unit tests with airflow
13
integration tests with airflow
14
the cf in ci/cd - our code on the way to the cloud
15
code getting promoted to prod
16
demo
17
take home message
Description:
Save Big on Coursera Plus. 7,000+ courses at $160 off. Limited Time Only! Grab it Discover how to effectively test Apache Airflow data pipelines using frameworks in this 46-minute conference talk from Conf42 Python 2024. Explore the fundamentals of Airflow, understand the importance of testing data pipelines, and learn about local development and testing techniques. Dive into Astro CLI and Airflow CLI testing features, including DAG validation, unit tests, and integration tests. Follow the journey of code from development to staging and production environments. Gain practical insights through a comprehensive demo and take away valuable lessons for implementing robust testing strategies in your Airflow projects.

Using Frameworks to Test Apache Airflow Data Pipelines

Conf42
Add to list