Главная
Study mode:
on
1
Intro
2
ABOUT ME
3
WHAT IS A WORKFLOW?
4
A TYPICAL WORKFLOW
5
EXAMPLES EVERYWHERE
6
WORKFLOW MANAGERS
7
APACHE AIRFLOW
8
WHAT FLOWS IN A WORKFLOW?
9
SOURCE AND TRIBUTARIES
10
DISTRIBUTARIES AND DELTAS
11
BRANCHES
12
AIRFLOW CONCEPTS: DAGS
13
AIRFLOW CONCEPTS: OPERATOR
14
AIRFLOW CONCEPTS: SENSORS
15
AIRFLOW CONCEPTS: XCOM
16
SCAN FOR INFORMATION UPSTREAM
17
REUSABLE OPERATORS
18
CONDITIONAL EXECUTION
19
BASH COMMANDS AND TEMPLATES
20
AIRFLOW PLUGINS
Description:
Learn to develop elegant workflows in Python using Apache Airflow in this EuroPython 2017 conference talk. Explore the concept of workflows as directed acyclic graphs (DAGs) and discover how Airflow enables you to bring block diagrams to life. Dive into basic Airflow concepts, including tasks, operators, and sensors. Through practical examples, master the art of defining workflows in Python code, implementing conditional execution, and leveraging Bash commands with templates. Gain insights into extending Airflow's functionality by creating custom task operators, sensors, and plugins. Understand how Airflow's resilient design handles task retries, workflow resumption, and log management through its user-friendly web interface.

Developing Elegant Workflows in Python Code with Apache Airflow

EuroPython Conference
Add to list
0:00 / 0:00