Klaviyo's Journey to Robust Model Serving with Ray Serve
Explore Klaviyo's journey in building DART, a model serving platform using Ray Serve. Gain insights into architecture, deployment strategies, and practical advice for implementing Ray Serve in your own projects.
Fine-Tuning Large Language Models at Scale - Workday's Approach
Dive into Workday's innovative approach to fine-tuning LLMs securely in a multi-tenant environment, addressing GPU scarcity and data access controls using PEFT techniques and KubeRay's autoscaling capabilities.
Scaling Ray Train to 10,000 Kubernetes Nodes on GKE
Discover how to scale distributed machine learning workloads across 10,000 Kubernetes nodes using Ray Train and GKE, featuring architectural insights and practical solutions for massive AI model training.
Sailing Ray Workloads with KubeRay and Kueue in Kubernetes
探索KubeRay和Kueue如何在Kubernetes中优化Ray工作负载管理，解决资源分配和作业调度挑战，提高机器学习工作流程效率。
KubeSecRay - Fortifying Multi-Tenant Ray Clusters on Kubernetes
Discover how to secure multi-tenant Ray clusters using KubeSecRay, implementing robust Kubernetes security features for isolation, access control, and resource management in distributed computing environments.
Accelerate Your GenAI Model Inference with Ray and Kubernetes
Explore serving large GenAI models efficiently using KubeRay on Kubernetes with hardware accelerators. Learn to scale workloads, optimize performance, and reduce costs for production-ready AI inference.
KubeRay: A Ray Cluster Management Solution on Kubernetes
Explore KubeRay's integration with Kubernetes, its capabilities for Ray cluster management, and performance benchmarks for simplified deployment of Ray applications.
KubeRay - A Kubernetes Ray Clustering Solution
Explore KubeRay, an open-source toolkit for managing Ray clusters on Kubernetes. Learn about architectural decisions, resource management, job submission, and autoscaling capabilities.
SkyRay - Extending KubeRay for Multi-Cluster Multi-Cloud Operations
Discover how SkyRay extends KubeRay's capabilities for multi-cluster cloud operations, enabling seamless Ray cluster management across different cloud environments with policy-driven scheduling and automated migration.
Building Scalable AI Infrastructure with KubeRay and Kubernetes
Master scalable AI infrastructure deployment using KubeRay and Kubernetes, covering gang scheduling, distributed checkpointing, and integration with cloud providers for efficient AI workload management.