Empowering Developers with Easy, Scalable Stream Processing on Kubernetes
Explore a comprehensive conference talk on empowering developers with easy, scalable stream processing technologies on Kubernetes. Discover how Intuit built Numaflow, an open-source Kubernetes-native stream processing framework that enables developers to run large-scale stream processing jobs efficiently. Learn about the challenges of real-time stream data processing and how Numaflow addresses them, offering a cost-effective and resilient solution. Gain insights into Intuit's experience using this platform to process billions of messages daily for analytics, train machine learning models, and power a large-scale anomaly detection system across hundreds of Kubernetes clusters. Understand how this technology can benefit both data engineers and non-data engineers, such as platform engineers and DevOps professionals, by simplifying stream processing and data analytics tasks.