Building Data Pipelines with Apache Kafka and Confluent
Dive into the world of streaming data pipelines with Apache Kafka® and Confluent in this comprehensive tutorial. Learn essential techniques for building efficient data pipelines, including ingesting data from external systems using Kafka Connect with change data capture (CDC), transforming Kafka data in real-time using ksqlDB for stream processing, and writing data to external systems with Kafka Connect. Explore hands-on exercises covering data generation, MySQL integration, filtering and joining data streams, and streaming data to external systems. Gain valuable insights from Tim Berglund, Senior Director of Developer Experience at Confluent, as he guides you through the concepts and practical applications of streaming pipelines, enabling you to ensure more accurate data, react in real-time, and optimize resource management for large-scale data influxes.