Netflix's Ray Platform: From Deep Learning to GenAI
Explore how Netflix is leveraging Ray to enhance its machine learning platform for the generative AI era in this breakout session from Ray Summit 2024. Discover Netflix's strategies for augmenting large-scale deep learning infrastructure to support foundation model pre-training, memory-intensive LLM fine-tuning, and low-latency deployments for multi-billion-parameter models. Learn about the implementation of Ray for crucial tasks such as large-scale data processing, LLM fine-tuning, foundation model training, and distributed inference. Gain valuable insights into integrating Ray into existing ML infrastructure to create a GenAI-ready environment that addresses the needs of modern deep learning. Benefit from the perspectives shared on enhancing machine learning platforms with Ray's capabilities in a major tech company's production environment.