Experience with Hard Multi-Tenancy in Kubernetes Using Kata Containers
Explore how Databricks implements "hard multi-tenancy" in Kubernetes using Kata Containers in this 27-minute conference talk. Discover the challenges and solutions in building a serverless platform for performance-sensitive workloads like Data Lakehouse on Kubernetes clusters. Learn about the integration of Kata Containers, an open-source container runtime that provides strong isolation through micro-VMs, with Kubernetes in production. Gain insights into the trade-offs between security, performance, and cost, as well as strategies for navigating heterogeneity across different public cloud providers. Understand the implementation of hard compute and network isolation layers among untrusted workloads using Kata Containers, network policies, and network security groups.