Using Scikit-Learn's Interface for Turning Spaghetti Data Science into Maintainable Software

Using Scikit-Learn's Interface for Turning Spaghetti Data Science into Maintainable Software

Learn how to transform messy data science code into maintainable software using Scikit-Learn's interface in this EuroPython conference talk. Explore techniques for structuring number-crunching code, especially for data processing, cleanup, and feature construction. Discover how to leverage Scikit-Learn's estimator and composite classes to encapsulate complex machine learning models into a manageable tree of objects. Gain insights into simplifying model development, testing, and validation while combining best practices from software engineering and data science. Follow along with examples demonstrating how to use pipelines for chained transformations, apply the single-responsibility principle to estimators, and create serializable trained models. No prior knowledge of Scikit-Learn is required to benefit from this presentation on improving code structure and maintainability in data science projects.