Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#Apache Airflow

Showing: 74 courses

Apache Airflow Tutorial for Beginners

2 rewiews
Learn Apache Airflow basics, including pipeline execution, scheduling, monitoring, and using Kubernetes Pod Operator through practical demonstrations and live examples.
Add to list
4 Lesons
1 hour 30 minutes
On-Demand
Free-Video

Airflow - Zero to Hero

1 rewiews
Learn to install, run, and master Airflow: core concepts, DAGs, task retries, metadata passing, branching, sensors, and hooks for efficient workflow automation.
Add to list
7 Lesons
1 hour 30 minutes
On-Demand
Free-Video
MLOps World: Machine Learning in Production

Apache Airflow: Where Data Engineers and ML Engineers Meet

0 rewiews
Explore production-quality Generative AI pipelines using Apache Airflow. Learn to orchestrate workflows, integrate data engineering, and implement MLOps best practices for robust AI applications.
Add to list
1 Lesons
47 minutes
On-Demand
Free-Video
MLOps World: Machine Learning in Production

Airflow: Where Data Engineers and ML Engineers Meet

0 rewiews
Explore Apache Airflow's role in operational machine learning with a real-world demo and reference implementation of GenAI in production.
Add to list
1 Lesons
10 minutes
On-Demand
Free-Video

Apache Airflow Tutorials

0 rewiews
Learn Apache Airflow fundamentals, set up environments, write pipelines, and integrate with Google Cloud services. Gain practical skills for efficient workflow automation and data pipeline management.
Add to list
7 Lesons
2 hours 30 minutes
On-Demand
Free-Video

Apache Airflow with Python

0 rewiews
Aprende Apache Airflow con Python: operadores de email, Docker Compose, autenticación de usuarios, paralelismo con Pandas, y almacenamiento de logs en AWS S3.
Add to list
11 Lesons
1 hour 30 minutes
On-Demand
Free-Video

Apache Airflow

0 rewiews
Comprehensive tutorials on Apache Airflow covering DAGs, operators, Kubernetes Executors, Docker, AWS integration, and more. Ideal for mastering workflow automation and orchestration.
Add to list
34 Lesons
6 hours
On-Demand
Free-Video

Apache Airflow 101

0 rewiews
Learn to programmatically author, schedule, and monitor workflows using Apache Airflow. Covers installation, DAGs, operators, and hands-on examples with MySQL and email integration.
Add to list
14 Lesons
2 hours 30 minutes
On-Demand
Free-Video

Apache Airflow Tutorials

0 rewiews
Aprende a instalar y usar Apache Airflow con operadores Spark, Hive y Sqoop en Windows, con tutoriales en inglés y tamil.
Add to list
9 Lesons
2 hours 30 minutes
On-Demand
Free-Video
Anyscale

Streamlining AI Workflows with Apache Airflow and Ray

0 rewiews
Discover how to build a unified AI infrastructure by integrating Apache Airflow and Ray for seamless orchestration of data processing, model training, and inference workflows, including LLM fine-tuning and LoRA deployments.
Add to list
1 Lesons
21 minutes
On-Demand
Free-Video

Airflow 2.0

0 rewiews
Aprende a usar Airflow 2.0 para ingeniería de datos, crear ETL con Spotify y Python, y desplegar en Kubernetes con k3d y Helm charts.
Add to list
5 Lesons
1 hour 30 minutes
On-Demand
Free-Video
OSACon

Navigating the Landscape of a Fully Open Source Data Stack in 2023

0 rewiews
Explore the architecture of modern data stacks, from warehousing to streaming solutions, while understanding the potential and limitations of open-source tools in today's data infrastructure.
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
Open Data Science

Building a Robust Data Pipeline with the DAG Stack - dbt, Airflow, and Great Expectations

0 rewiews
Learn to build robust data pipelines using dbt, Airflow, and Great Expectations. Discover how these tools complement each other to ensure data quality, perform transformations, and orchestrate workflows effectively.
Add to list
29 Lesons
43 minutes
On-Demand
Free-Video
Databricks

From Idea to Model: Productionizing Data Pipelines with Apache Airflow

0 rewiews
Learn to productionize data pipelines using Apache Airflow, bridging data science and engineering. Explore collaborative workflows, custom operators, and scalable solutions for efficient model deployment and iteration.
Add to list
17 Lesons
22 minutes
On-Demand
Free-Video
Bryan Cafferky

Hot Technologies in Data Analytics - What You Need to Learn

0 rewiews
Discover essential emerging technologies in Data Analytics and learn how to evaluate them for your career advancement.
Add to list
10 Lesons
24 minutes
On-Demand
Free-Video
Databricks

Modern ETL Pipelines with Change Data Capture - Building Resilient Data Streams

0 rewiews
Discover how GetYourGuide built a resilient ETL pipeline using Debezium, Kafka, Spark, and Airflow. Learn to handle schema changes automatically, stream data from SQL databases, and refresh data lakes multiple times daily for fresher insights.
Add to list
25 Lesons
43 minutes
On-Demand
Free-Video
Open Data Science

Orchestrating Data Assets Instead of Tasks, With Dagster - Sandy Ryza

0 rewiews
Explore data orchestration with Dagster, focusing on managing data assets over tasks. Learn about pipeline development, testing, deployment, and monitoring in data engineering and machine learning.
Add to list
12 Lesons
31 minutes
On-Demand
Free-Video
Linux Foundation

Astronomer's Journey from Cloud Lock-in to Open Source Independence

0 rewiews
Discover how Astronomer transitioned from AWS-managed services to open-source solutions, enhancing flexibility and independence in their data engineering platform.
Add to list
27 Lesons
24 minutes
On-Demand
Free-Video
CodeWithYu

Building Realtime Data Warehouses from Scratch - End-to-End Data Engineering Project

0 rewiews
Design and implement a real-time data warehouse with Apache Airflow, Kafka, and Pinot. Create custom hooks, ingest batch and streaming data, and visualize evolving data using Apache Superset.
Add to list
13 Lesons
2 hours 9 minutes
On-Demand
Free-Video
The ASF

Orchestrating Scalable Data Pipelines with Apache Toree, YuniKorn, Spark, and Airflow

0 rewiews
Explore integrated use of Apache Toree, YuniKorn, Spark, and Airflow for efficient, scalable data pipelines. Learn to leverage these projects for optimized data processing and workflow orchestration.
Add to list
1 Lesons
24 minutes
On-Demand
Free-Video
OSACon

Apache Airflow 2.x - Modern Workflow Orchestration Features and Improvements

0 rewiews
Discover the modern evolution of Apache Airflow 2.x, exploring new UI features, orchestration methods, and testing capabilities while maintaining backward compatibility for workflow management.
Add to list
1 Lesons
29 minutes
On-Demand
Free-Video
Data Science Conference

Introduction to GKE Setup of Airflow with Helm and Terraform

0 rewiews
Master GKE deployment strategies using Terraform and Helm to efficiently set up and manage Airflow workflows in GitLab, with focus on Pod scheduling and infrastructure automation.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
Data Science Conference

Introduction to Orchestrating ETL Processes with Apache Airflow

0 rewiews
Master Apache Airflow's workflow management capabilities for ETL processes through practical examples. Learn core concepts like DAGs, Tasks, Variables, and XComs while building efficient data engineering pipelines.
Add to list
1 Lesons
1 hour 59 minutes
On-Demand
Free-Video
Linux Foundation

Automating Airflow Backfills with Marquez

0 rewiews
Learn to automate Airflow backfills using Marquez, enhancing data pipeline efficiency and reliability in complex workflows.
Add to list
1 Lesons
35 minutes
On-Demand
Free-Video
Linux Foundation

Lessons Learned from the Migration to Apache Airflow

0 rewiews
Explore Apache Airflow for orchestrating complex workflows, with insights on ETL pipelines, Spark integration, and best practices for managing big data infrastructure.
Add to list
14 Lesons
38 minutes
On-Demand
Free-Video
Linux Foundation

Airflow: Save Money Using Deferrable Operators - Introduction and Implementation

0 rewiews
Learn to optimize Apache Airflow tasks using deferrable operators, saving resources and costs. Explore implementation, advantages, and custom development for efficient workflow management.
Add to list
13 Lesons
33 minutes
On-Demand
Free-Video
Databricks

MATS Stack for Cross-System Orchestration of Machine Learning Pipelines

0 rewiews
Explore the MATS stack for orchestrating ML pipelines across systems, featuring MLFlow, Airflow, Tensorflow, and Spark. Learn how Avast leverages this approach for efficient phishing detection and streamlined ML workflows.
Add to list
7 Lesons
22 minutes
On-Demand
Free-Video
CodeWithYu

Kubernetes for Modern Data Engineering: An End-to-End Data Engineering Project

0 rewiews
Master Kubernetes for data engineering: set up, deploy dashboard, run Apache Airflow with Helm charts. Learn kubectl, manage clusters, and optimize workflows for scalable data processing.
Add to list
20 Lesons
1 hour 25 minutes
On-Demand
Free-Video
GOTO Conferences

Orchestrating Your Data Pipelines with Apache Airflow

0 rewiews
Introduction to Apache Airflow for orchestrating data pipelines, covering key components and demonstrating simple pipeline builds. Includes practical demos and insights on Airflow's evolution and community contributions.
Add to list
9 Lesons
32 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Comparing Argo Workflows and Airflow in Distributed Environments

0 rewiews
Explore workflow orchestration tools for distributed environments, focusing on Argo Workflows' advantages in Kubernetes-based pipelines and its scalability across multiple regions and zones.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
PyCon US

Bridging Data Science and Data Infrastructure with Apache Airflow

0 rewiews
Explore how Apache Airflow bridges data science and infrastructure, enabling collaboration between teams and facilitating the development of flexible, observable, and resilient data pipelines.
Add to list
1 Lesons
16 minutes
On-Demand
Free-Video
PyCon US

In House to Open Source - Stitching the Past to the Future

0 rewiews
Explore the transition from legacy code to open-source solutions, focusing on Python's advantages in software migrations and the implementation of robust frameworks like Apache Airflow.
Add to list
33 Lesons
26 minutes
On-Demand
Free-Video
PyCon US

Too Big for DAG Factories?

0 rewiews
Learn to scale data workflows using Apache Airflow, covering dynamic DAG generation, automation, and best practices for managing big data pipelines. Suitable for beginners and intermediate developers.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
EuroPython Conference

Developing Elegant Workflows in Python Code with Apache Airflow

0 rewiews
Learn to orchestrate data processing pipelines using Apache Airflow. Discover how to define, manage, and extend workflows with Python code, creating resilient and efficient data processing systems.
Add to list
20 Lesons
29 minutes
On-Demand
Free-Video
EuroPython Conference

Feeding Data to AWS Redshift with Airflow

0 rewiews
Explore Airflow for efficient data pipelines and learn to integrate it with AWS Redshift for effective ETL processes, schema management, and data transformation techniques.
Add to list
29 Lesons
39 minutes
On-Demand
Free-Video
EuroPython Conference

Reproducible and Deployable Data Science with Open-Source Python

0 rewiews
Aprenda a criar código de ciência de dados escalável, reproduzível e confiável usando Kedro, Apache Airflow e Great Expectations. Descubra como combinar iteração rápida com manutenibilidade e qualidade de dados consistente.
Add to list
16 Lesons
30 minutes
On-Demand
Free-Video
EuroPython Conference

Orchestrating Python Workflows in Apache Airflow

0 rewiews
Explore Apache Airflow for efficient Python workflow orchestration. Learn strengths, weaknesses, key features, and how to create custom operators based on 5 years of production experience.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Building MLOps POCs and Sandbox Environments Using k3s and Argo

0 rewiews
Explore building MLOps POCs using k3s and Argo. Learn to reduce implementation time and costs for data pipeline automation and ML workflows, with insights on lightweight Kubernetes and Edge Computing.
Add to list
12 Lesons
25 minutes
On-Demand
Free-Video
SK AI SUMMIT 2024

Building Mobility Data Platform with EMR and Airflow

0 rewiews
Discover how to build and optimize a mobility data platform using AWS EMR and Airflow, focusing on migration strategies, cost optimization, and infrastructure automation with Terraform.
Add to list
1 Lesons
25 minutes
On-Demand
Free-Video
SK AI SUMMIT 2024

Managed Airflow Service Vane Development Journey

0 rewiews
Dive into the development journey of Vane, a managed Airflow SaaS platform, exploring its architecture, implementation challenges, and valuable insights gained from operating data platforms at scale.
Add to list
1 Lesons
22 minutes
On-Demand
Free-Video
SK AI SUMMIT 2024

On-Premise Kubernetes and Airflow ETL Platform (Haflow) - Introduction and Implementation

0 rewiews
Discover SK하이닉스의 클라우드 네이티브 ETL 플랫폼 Haflow의 구축 사례와 아키텍처를 통해 기존 ETL 솔루션의 한계 극복 방안과 리소스 최적화 전략을 파악하세요.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
Data Science Conference

Making Data the Central Feature: From Task-Oriented to Data-Oriented Workflows

0 rewiews
Explore the shift from task-oriented to data-oriented workflows in modern data engineering, focusing on tools and approaches that prioritize data assets over process management.
Add to list
1 Lesons
24 minutes
On-Demand
Free-Video
Conf42

4 Tricks to Leverage Your Airflow Pipelines

0 rewiews
Discover four powerful techniques to enhance Airflow pipelines: CSV-based DAG creation, sharable config utilization, entity-based autogeneration, and event-driven implementation.
Add to list
8 Lesons
22 minutes
On-Demand
Free-Video
The ASF

Four Tricks to Leverage Your Apache Airflow Pipelines

0 rewiews
Leverage CSV files, Google Sheets, Airflow Connections, and event-driven techniques to optimize Apache Airflow pipelines and streamline data engineering workflows.
Add to list
1 Lesons
19 minutes
On-Demand
Free-Video
The ASF

Modern Data Orchestration: Best Practices and Real-World Use Cases

0 rewiews
Elevate your data pipeline game with real-world tricks and best practices. Explore patterns, avoid dependencies, and integrate fundamental concepts for efficient data orchestration.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
The ASF

Gatekeeping Data Quality with Apache Iceberg, Toree, and Airflow

0 rewiews
Leverage Apache Iceberg, Toree, and Airflow for efficient data quality validation. Customize data audits with Jupyter notebooks and orchestrate workflows at scale using open-source Apache projects.
Add to list
1 Lesons
23 minutes
On-Demand
Free-Video
CodeWithYu

Creating and Submitting Scala Jobs to Spark Clusters Using Airflow

0 rewiews
Build end-to-end data engineering project using Airflow, Docker, Spark, Scala, Python, and Java. Create and submit jobs to Spark clusters, process data, and view real-time results.
Add to list
8 Lesons
15 minutes
On-Demand
Free-Video
CodeWithYu

Creating and Submitting PySpark Jobs to Spark Clusters

0 rewiews
Create and submit PySpark jobs to Spark clusters in an end-to-end data engineering project using Airflow, Docker, and multiple programming languages. Learn job creation, cluster submission, and result visualization.
Add to list
8 Lesons
17 minutes
On-Demand
Free-Video
CodeWithYu

End-to-End Data Engineering with Apache Airflow, Docker, and Spark Clusters - Using Python, Scala, and Java

0 rewiews
Build an end-to-end data engineering project using Apache Airflow, Docker, Spark Clusters, Scala, Python, and Java. Create and submit jobs in multiple languages to a Spark cluster for processing and real-time results.
Add to list
8 Lesons
12 minutes
On-Demand
Free-Video
CodeWithYu

Football Data Analytics with Tableau - Azure Data Engineering Project Part 3

0 rewiews
Explore football data engineering: Extract Wikipedia data, store in Azure, migrate with Data Factory, query with Synapse, and visualize in Tableau. Master end-to-end data processes.
Add to list
6 Lesons
25 minutes
On-Demand
Free-Video
CodeWithYu

Creating and Submitting Java Spark Jobs to Spark Clusters

0 rewiews
Create and submit Java Spark jobs to clusters. Learn end-to-end data engineering with Airflow, Docker, Spark, Scala, Python, and Java. Build and process jobs in multiple languages for live results.
Add to list
8 Lesons
25 minutes
On-Demand
Free-Video
GOTO Conferences

Resilient Predictive Data Pipelines

0 rewiews
Explore resilient predictive data pipelines with insights on data security, fault-tolerance, and scalability. Learn about Apache Airflow, AWS Lambda, and elastic stream processing for efficient big data management.
Add to list
20 Lesons
45 minutes
On-Demand
Free-Video
Devoxx

Dynamic Workflow Orchestration with Apache Airflow and CrateDB

0 rewiews
Learn to automate and orchestrate complex database processes using Apache Airflow and CrateDB. Discover how to set up dynamic workflows, leverage task mapping, and efficiently manage large-scale data operations.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
Devoxx

Using Open Source Tech to Swap Out Components of Your Data Pipeline

0 rewiews
Explore open-source technologies for flexible data pipelines, from Apache Kafka to BigQuery, with easy component swapping and cloud deployment options.
Add to list
14 Lesons
48 minutes
On-Demand
Free-Video
GOTO Conferences

Cloud Native Data Pipelines

0 rewiews
Explore cloud-native data pipeline architecture, focusing on resilience, cost-efficiency, and operability. Learn about message scoring, Apache Airflow, stream processing, and Avro in building robust data systems.
Add to list
21 Lesons
52 minutes
On-Demand
Free-Video
GOTO Conferences

Applied Data Science & Engineering for Local Weather Forecasts

0 rewiews
Explore data science applications in local weather forecasting, covering numerical prediction models, scaling with Apache Airflow, and forecast verification techniques for improved accuracy.
Add to list
19 Lesons
33 minutes
On-Demand
Free-Video
DevOops

Airflow в кровавом энтерпрайзе

0 rewiews
Discover how to effectively deploy and implement Airflow for enterprise automation, with step-by-step guidance on setup, configuration, and best practices for streamlining routine processes.
Add to list
1 Lesons
45 minutes
On-Demand
Free-Video
Big Data Demystified

Airflow Distributed Workloads - ETL Architecture with AWS Lambda and Multi-Threaded Python Scripts

0 rewiews
Master distributed workload processing with Airflow, AWS Lambda, and multithreaded Python scripts while exploring ETL architecture for third-party API integration at scale.
Add to list
1 Lesons
53 minutes
On-Demand
Free-Video
Conf42

Using Frameworks to Test Apache Airflow Data Pipelines

0 rewiews
Explore frameworks for testing Apache Airflow data pipelines, covering local development, CI/CD, validation, unit tests, and integration tests. Includes a practical demo and key takeaways.
Add to list
17 Lesons
46 minutes
On-Demand
Free-Video
The ASF

OpenLineage: An Open Standard for Data Lineage

0 rewiews
Explore OpenLineage, an open framework for data lineage metadata collection. Learn its purpose, data model, and integration with tools like Apache Airflow and Spark to enhance pipeline understanding and management.
Add to list
1 Lesons
40 minutes
On-Demand
Free-Video
The ASF

Demystifying Apache Airflow - Separating Facts from Fiction

0 rewiews
Unpack critiques of Apache Airflow, analyze its strengths and weaknesses, debunk myths, and compare with competitors. Make informed decisions about workflow management platforms.
Add to list
1 Lesons
36 minutes
On-Demand
Free-Video
The ASF

The Silent Symphony: Keeping Airflow's CI/CD and Dev Tools in Tune

0 rewiews
Explore Airflow's CI/CD and dev tools ecosystem. Learn how robust pipelines and efficient coding practices contribute to seamless integration, bug fixes, and developer empowerment.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
SQLBits

Better ETL with Managed Airflow in Azure Data Factory

0 rewiews
Discover Managed Airflow in ADF for complex data workflows. Learn about Apache Airflow, its benefits for ETL orchestration, and see practical demonstrations of its implementation in Azure.
Add to list
1 Lesons
52 minutes
On-Demand
Free-Video
NullSafe Architect

Tutorial de Apache Airflow: Desde Puesta en Marcha hasta API - Creación de DAGs y Uso de CLI

0 rewiews
Aprende a instalar Apache Airflow, crear DAGs, utilizar operadores, ejecutar workflows, comunicar tareas y manejar el cliente CLI y API REST en este tutorial práctico.
Add to list
11 Lesons
36 minutes
On-Demand
Free-Video
NashKnolX

Orchestration of Data Pipelines Using Airflow

0 rewiews
Learn to orchestrate data pipelines with Airflow, integrating various operators like Bash, Python, Spark, Email, and Slack for efficient workflow management and automation.
Add to list
1 Lesons
44 minutes
On-Demand
Free-Video
DevConf

Data Governance with Airflow and ECS Anywhere

0 rewiews
Explore data governance compliance using Airflow and AWS ECS Anywhere for EU companies processing US data, ensuring legal adherence while maintaining efficient ETL processes.
Add to list
1 Lesons
36 minutes
On-Demand
Free-Video
MLOps.community

Airflow's Limitations for MLOps - Challenges and Alternatives

0 rewiews
Explore challenges in MLOps, data platforms, and Airflow with Stephen Bailey. Gain insights on modular job design, data classification, and practical approaches to data engineering and machine learning workflows.
Add to list
26 Lesons
1 hour 6 minutes
On-Demand
Free-Video
Conf42

GenAI Pipeline for Content Generation with Apache Airflow

0 rewiews
Explore Apache Airflow's key features for building GenAI pipelines, including TaskFlow API, automatic retries, branching, and dynamic task mapping. Learn to overcome challenges in content generation workflows.
Add to list
17 Lesons
1 hour 11 minutes
On-Demand
Free-Video
CodeWithYu

Realtime Data Streaming - End-to-End Data Engineering Project

0 rewiews
Build a real-time data streaming pipeline using Apache Airflow, Kafka, Spark, and Cassandra. Learn end-to-end data engineering, from ingestion to processing and storage, all containerized with Docker.
Add to list
8 Lesons
1 hour 28 minutes
On-Demand
Free-Video
CodeWithYu

Football Data Analytics: Azure End-to-End Data Engineering Project

0 rewiews
Extract, clean, and analyze football data using Apache Airflow, Azure services, and Tableau. Build a comprehensive data pipeline from Wikipedia to interactive visualizations.
Add to list
8 Lesons
1 hour 15 minutes
On-Demand
Free-Video
CodeWithYu

Football Data Analytics: Azure End-to-End Data Engineering Project - Part 2

0 rewiews
Extract, store, and analyze football data using Azure services and Apache Airflow. Develop end-to-end data engineering skills through hands-on implementation of a real-world project.
Add to list
9 Lesons
1 hour
On-Demand
Free-Video
CodeWithYu

Reddit Data Pipeline Engineering with AWS - End-to-End Data Engineering

0 rewiews
Build a comprehensive Reddit data pipeline using AWS services, integrating Airflow, S3, Glue, Athena, and Redshift for efficient ETL processes and analytics.
Add to list
11 Lesons
1 hour 35 minutes
On-Demand
Free-Video
CodeWithYu

Apache Airflow with Spark for Data Engineers - Full Course

0 rewiews
Build end-to-end data engineering projects using Apache Airflow, Docker, Spark, and multiple programming languages. Learn to create and submit jobs to Spark clusters for processing and view real-time results.
Add to list
8 Lesons
1 hour 9 minutes
On-Demand
Free-Video
MLOps.community

Treating Prompt Engineering More Like Code - Promptimize and Test-Driven Development for AI

0 rewiews
Explore scientific prompt evaluation with Promptimize. Learn about open-sourcing, test suites, and AI challenges. Gain insights on prompt optimization, deterministic evaluation, and the evolving landscape of AI prompt engineering.
Add to list
33 Lesons
1 hour 14 minutes
On-Demand
Free-Video