Self-Hosted LLMs on Kubernetes - A Practical Guide
Practical guide for deploying and managing self-hosted Large Language Models on Kubernetes, covering model selection, containerization, and resource provisioning for enhanced data privacy and flexibility.
The Art of Kubernetes Add-on Validation - Secure Strategies for Modern Developer Platforms
Explore advanced techniques for validating and deploying Kubernetes add-on upgrades securely across cluster fleets, focusing on infrastructure security and streamlined operational workflows.
Architecting Resilience: Lessons from Managing 7000+ Kubernetes Clusters at Scale
Insights on designing highly available Kubernetes clusters, addressing challenges in managing 7K+ clusters and 100K+ nodes, and lessons learned from a data center fire incident.
Accelerator Chaining for Efficient AI/ML Workloads in Kubernetes
Explore extending Kubernetes to orchestrate and configure accelerator chains for efficient handling of large AI/ML workloads, improving performance and reducing latency in production environments.
Safety or Usability: Why Not Both? Towards Referential Auth in Kubernetes
Explore new Kubernetes APIs for secure cross-namespace references and authorization, addressing CVEs in essential tooling while enabling innovative reference patterns.
Enabling Coordinated Checkpointing for Distributed HPC Applications
Explore coordinated checkpointing for distributed HPC applications across multiple Pods and nodes, including new CRIU mechanisms, Kubelet Checkpoint API, and potential Kubernetes scheduler extensions.
Squeeze Your K8s - Adopting Time-Series Forecasting Models in FinOps Practices
Explore time-series forecasting models for optimizing Kubernetes resource allocation, improving cluster utilization, and achieving significant cost savings in cloud-native environments.
Prometheus Update from the Maintainers
Discover the latest Prometheus updates, including improved performance, OpenTelemetry integration, and native histograms. Learn about future plans and version 3.0 from project maintainers.
GitOps Continuous Delivery at Scale with Flux
Explore GitOps scaling practices with Flux, including vertical and horizontal scaling methods, multi-tenancy considerations, and performance benchmarking for efficient continuous delivery.
Istio Project Update - Latest Features and Future Roadmap
Explore Istio's latest features, ambient sidecar-less mode, Gateway API support, and project roadmap. Learn about community-building efforts and how to contribute to this popular service mesh for enhanced observability and traffic management.
Tackling Configuration Management at Scale with Flux, CUE and OCI
Explore Cisco's approach to managing 245M+ IoT devices using Flux, CUE, and OCI. Learn about GitOps implementation, configuration validation, and scaling Helm releases across global Kubernetes clusters.
Shift-Left: Past, Present, and Future of Validation in CI for GitOps Workflows
Explore robust validation mechanisms for GitOps workflows, enhancing automated deployments and reducing maintenance costs. Learn to use kubectl-validate for reliable, efficient Kubernetes manifest validation.
Hooking Libc Calls to Debug Kubernetes Apps - When They Go High, We Go Low
Explore innovative debugging techniques for Kubernetes apps using low-level Rust code to hook libc calls, enabling local testing and debugging in cloud conditions.
Kubernetes in Sign Language - Key Concepts Part 2
Explore advanced Kubernetes concepts in sign language, covering scalability, resilience, security, observability, and resource optimization for cloud-native systems.
Security Showdown: The Overconfident Operator vs the Nefarious Ne'er-Do-Well
Playful demo showcasing cloud-native security concepts through characters Ozzie and Nova, exploring vulnerabilities and proactive measures for robust cluster protection.
LoRAX - Serving Thousands of Fine-Tuned LLMs on a Single GPU
Explore LoRAX, an innovative LLM inference system enabling efficient serving of multiple fine-tuned models on a single GPU. Learn about dynamic adapter loading, heterogeneous batching, and scheduling techniques.
Practicing Cloud-Native Resiliency - Decoding It with Chaos Engineering
Explore automated Chaos Engineering with LitmusChaos to enhance cloud-native application reliability. Learn how to implement and leverage chaos experiments for improved resilience in complex environments.
How Kubernetes Works - Community, Velocity and Contribution
Explore Kubernetes' success through its community structure, decision-making processes, and project evolution. Learn from challenges faced during rapid growth and gain insights into open-source development.
The Art of Debugging Inside Kubernetes Environments
Mastering Kubernetes debugging: Strategies, tools, and techniques for troubleshooting common errors in deployments, RBACs, NetworkPolicies, and more. Enhance your skills to build robust, easily debuggable applications in K8s environments.
Kubernetes Resiliency: From Infrastructure to Applications - Devoxx Greece 2024
Explore Kubernetes resiliency strategies for infrastructure, components, and applications. Learn to identify and address single points of failure, optimize resource management, and implement robust monitoring techniques.
A Hitchhiker's Guide to Observing Java Applications in Kubernetes
Explore Kubernetes observability tools, from API-querying UIs to service meshes and application monitoring, to understand cluster health and performance.