Главная
Study mode:
on
1
Intro
2
Machine Learning at Criteo
3
Architecture
4
Scale SOLAlchemyStore
5
Whitelist Column
6
Monitoring
7
Configure the Gunicorn Application
8
Automatic DB migration
9
Periodic Jobs
10
JWT Integration in Javascript
11
Integration to company SSO
12
Write Easily Fitler Queries
13
Miflow-yarn
14
Code Organization
Description:
Discover how to implement MLflow at enterprise scale in this 27-minute talk from Databricks. Learn about managing 50,000 runs, millions of metrics, parameters, and tags, with bursts up to 20,000 QPS. Explore the setup of a shared MLflow instance at Criteo, including contributions to SQLAlchemyStore for improved responsiveness. Gain insights into transforming MLflow into a production-ready system, horizontal scaling on a Mesos cluster, and implementing Prometheus-based monitoring. Understand the integration of company Single Sign-On (SSO) authentication and how data scientists register runs from Europe's largest Hadoop cluster. Dive into topics such as architecture, scaling SQLAlchemyStore, whitelisting columns, configuring Gunicorn applications, automatic database migration, periodic jobs, and JavaScript JWT integration.

MLflow at Company Scale - Scaling and Optimizing for High-Volume Machine Learning

Databricks
Add to list
0:00 / 0:00