Building a CML Pipeline with Spark and Kafka - YOW! 2018

Building a CML Pipeline with Spark and Kafka - YOW! 2018

Explore the process of building a Continuous Machine Learning (CML) pipeline using Apache Spark and Apache Kafka in this conference talk from YOW! 2018. Dive into functional programming concepts as Principal Machine Learning Engineer Cameron Joannidis demonstrates how to leverage these powerful tools for efficient data processing and real-time analytics. Learn best practices for integrating Spark and Kafka in a machine learning workflow, optimizing performance, and scaling your pipeline to handle large datasets. Gain insights into the challenges and solutions involved in creating robust, scalable CML systems that can adapt to changing data streams and model requirements.