Practice of Building Real-Time Data Lake Based on Flink

Practice of Building Real-Time Data Lake Based on Flink

Explore the practice of building real-time data lakes based on Apache Flink in this 32-minute conference talk presented by Wang Zheng and Min Zhongyuan, Cloud-Native Computing R&D Engineers at Bytedance's Volcano Engine. Discover the current challenges in real-time data lakes, including high timeliness, diversity, consistency, and accuracy of data. Learn how to construct a real-time data lake using Flink and Iceberg, focusing on real-time data ingestion and utilizing Flink for OLAP temporary queries. Gain insights into Bytedance's practical benefits from implementing real-time data lake solutions.