Apache Kafka and KSQL in Action - Let's Build a Streaming Data Pipeline
Explore the power of stream processing and learn to build streaming data pipelines in this 43-minute conference talk from USENIX LISA18. Discover how Apache Kafka, a distributed and fault-tolerant streaming platform, combined with KSQL, the open-source SQL streaming engine, can revolutionize data integration and processing. Follow along as the speaker demonstrates real-time event filtering, data enrichment from RDBMS, and streaming aggregates for anomaly detection. Gain practical insights into leveraging these open-source tools to create scalable stream processing applications using a familiar SQL interface, all without extensive programming knowledge. By the end of this talk, acquire a clear understanding of stream processing capabilities and how to get started with Apache Kafka and KSQL projects.