CNCF [Cloud Native Computing Foundation]
Cloud Native Sustainable LLM Inference in Action
Explore sustainable LLM inference using cloud-native tech. Learn about energy monitoring, AI accelerator optimization, and balancing efficiency with environmental impact. Includes live demo of vLLM in a Kubernetes cluster.