On-Premise Kubernetes and Airflow ETL Platform (Haflow) - Introduction and Implementation
Discover a technical conference talk from SK TECH SUMMIT 2023 exploring SK Hynix's innovative ETL Platform Service 'Haflow', built on Kubernetes and Airflow. Learn how this cloud-native solution addresses common ETL solution challenges through resource optimization and improved efficiency. Gain insights into the architecture, processes, and comprehensive workflow of Haflow, presented by Min-woo Kim, an ETL expert with 8 years of experience at SK Hynix. Explore how the platform overcomes traditional ETL solution limitations, featuring detailed explanations of its unique advantages and implementation strategies in an on-premises environment. Understand the practical know-how gained from transitioning from conventional ETL solutions to a modern, containerized platform that leverages open-source technologies.