Delta Live Tables: Building Reliable Data Pipelines with Databricks
Simplify ETL development with declarative pipelines, automatic testing, and deep visibility for reliable batch and streaming data on Databricks Lakehouse Platform.
Powering Applications with High-Volume Data and APIs in Kubernetes
Discover how Kubernetes SIG Apps has evolved to support diverse workloads, from stateless to stateful applications, while exploring its milestones, sub-projects, and future developments in cloud-native application management.
Bloomberg's Journey to Manage Multi-Cluster Training Applications with Karmada
Discover how Bloomberg leverages Karmada to manage multi-cluster GPU workloads, optimize resource utilization, and streamline AI model training across data centers with intelligent scheduling and high availability.
Breaking the 1.5MB Barrier: Running Large Metaflow Flows with Argo for AI/ML Workloads
Discover how to overcome Argo's 1.5MB size limitation for large-scale AI/ML workflows using Aurora Postgres RDS and EKS, enabling efficient management of extensive batch processes and data preparation tasks.
Multitenancy and Fairness at Scale with Kueue - A Kubernetes Batch System Case Study
Explore how Kueue implements job queueing and resource sharing in Kubernetes, featuring fair sharing mechanisms, quota management, and performance optimizations for large-scale ML platforms.
Multicluster Batch Jobs Dispatching with Kueue at CERN
Discover how to efficiently manage multicluster batch jobs using Kueue, exploring automatic capacity finding, job dispatching, and monitoring across various environments including on-prem, cloud, and hybrid setups.