
Deploy vLLM on Kubernetes for efficient LLM inference and serving. Learn basics, local setup, and production deployment with GPU-attached nodes via DaemonSet. Includes hands-on demo and cost-saving strategies.

Enhance build pipeline security using OpenSSF projects: cosign, SBOMs, and SLSA. Demonstrate kpack for container image building on Kubernetes, integrating signed images and SBOM generation.

探索使用WasmEdge和Kuasar在Kubernetes上部署LLM工作负载,提高效率、可扩展性和稳定性。了解如何克服传统方法的挑战,实现快速、灵活、资源高效和安全的LLM应用程序开发。

探索KWOK工具包,实现大规模Kubernetes集群的创建和测试。学习如何利用虚拟节点进行工作负载部署,并通过故障注入进行可靠性和容错性测试,提升Kubernetes弹性。