Extending Spark Machine Learning - Beyond Linear Regression
Explore Apache Spark's machine learning capabilities beyond linear regression in this 32-minute conference talk from Scala Days Chicago 2017. Dive deep into Spark's scikit-learn inspired ML pipelines, learning how to integrate custom data preparation and machine learning tools. Discover how to leverage meta-algorithms like parameter searching, customize Spark models, and build more powerful ML pipelines. Gain insights into the ML API structure and its functionality, even if you're new to Spark. Cover topics including Spark Datasets, building transformers, configurable parameters, cross-validation, and publishing ML models. Suitable for those with basic Spark knowledge, but also accessible to beginners seeking a broad understanding of Spark ML functions.