Building a CML Pipeline with Spark & Kafka • Cameron Joannidis • YOW! 2018
Description:
Explore the process of building a Continuous Machine Learning (CML) pipeline using Apache Spark and Apache Kafka in this conference talk from YOW! 2018. Dive into functional programming concepts as Principal Machine Learning Engineer Cameron Joannidis demonstrates how to leverage these powerful tools for efficient data processing and real-time analytics. Learn best practices for integrating Spark and Kafka in a machine learning workflow, optimizing performance, and scaling your pipeline to handle large datasets. Gain insights into the challenges and solutions involved in creating robust, scalable CML systems that can adapt to changing data streams and model requirements.
Building a CML Pipeline with Spark and Kafka - YOW! 2018