Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#KServe

Showing: 32 courses
CNCF [Cloud Native Computing Foundation]

Kubernetes Wonderland: Adventures in Platform Building

0 rewiews
探讨Kubernetes平台构建的挑战与机遇,聚焦用户需求与工具抽象,对比开发和机器学习平台,并通过演示展示如何利用开源工具构建高效平台。
Add to list
1 Lesons
37 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

DevOps in Data Science - What Works and What Doesn't

0 rewiews
Explore challenges and solutions in implementing DevOps for data science projects, focusing on balancing ML engineers' needs with data scientists' desire for simplicity using Kubeflow and other tools.
Add to list
1 Lesons
22 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

From Bash Scripts to Kubeflow and GitOps - Operationalizing ML at Scale

0 rewiews
Explore the journey of operationalizing data science workloads at scale using Kubeflow and GitOps, from initial challenges to a standardized approach for ML experiments, API creation, and batch predictions delivery.
Add to list
1 Lesons
34 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Production-Ready AI Platform on Kubernetes

0 rewiews
Explore best practices for building scalable AI/ML platforms using cloud-native technologies like Kubernetes, Kubeflow, and KServe. Learn to tackle challenges in MLOps and large model inference systems.
Add to list
1 Lesons
39 minutes
On-Demand
Free-Video
Linux Foundation

Cloud Native Artificial Intelligence - Top to Bottom

0 rewiews
Explore how Cloud Native is shaping MLOps implementations, focusing on tools like Kubeflow and KServe. Learn to leverage Cloud Native knowledge for AI integration and future developments.
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Enhancing the Performance Testing Process for gRPC Model Inferencing at Scale

0 rewiews
Explore performance testing for gRPC model inferencing at scale using Kubernetes, KServe, and ModelMesh. Learn about deployment, load testing, and monitoring key metrics.
Add to list
21 Lesons
32 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Model Serving at the Edge - Challenges and Solutions with ModelMesh

0 rewiews
Explore efficient AI model deployment on edge devices using ModelMesh, K3s, and MicroShift. Learn to overcome resource limitations and manage multiple models effectively for large-scale adoption.
Add to list
16 Lesons
27 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

AI-Ready Microservice Architecture for Deploying and Evaluating AI Models

0 rewiews
Explore event-driven architecture for deploying AI models in production using Knative, KServe, and Kubeflow. Includes real-time image recognition demo with audience participation.
Add to list
1 Lesons
15 minutes
On-Demand
Free-Video
Linux Foundation

ModelMesh: Scalable AI Model Serving on Kubernetes

0 rewiews
Explore scalable AI model deployment on Kubernetes using ModelMesh, a multi-model serving backend for KServe. Learn about its architecture, monitoring, and new features for efficient, high-density model serving.
Add to list
20 Lesons
36 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Fortifying AI Security in Kubernetes with Confidential Containers - CoCo

0 rewiews
Explore confidential computing for AI model protection in Kubernetes using Confidential Containers (CoCo). Learn how CoCo enhances security for AI/ML workloads and provides memory protection for foundational platforms.
Add to list
1 Lesons
33 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Building an ML Inference Platform with Knative - Serverless Containers on Kubernetes

0 rewiews
Leveraging Knative for scalable ML inference platforms: simplifying deployment, enabling serverless containers, and optimizing performance for production-ready machine learning applications.
Add to list
1 Lesons
25 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Exploring ML Model Serving with KServe - Features and Use Cases

0 rewiews
Discover KServe's ML model deployment capabilities, from basic serving to advanced features like inference graphs and ModelMesh, enhancing efficiency for data scientists and engineers.
Add to list
17 Lesons
28 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Training AI to Code Using Project CodeNet - Largest Code Dataset

0 rewiews
Explore Project CodeNet's vast code dataset and learn how to leverage it for machine learning tasks using MLX, including code classification and complexity analysis on Kubernetes.
Add to list
1 Lesons
37 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

How Bloomberg Uses AI to Speed Up Over-the-Counter Trading

0 rewiews
Explore how Bloomberg leverages AI and Kubernetes to enhance over-the-counter trading efficiency, focusing on detecting offers in group chats and streamlining negotiations for traders.
Add to list
1 Lesons
24 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

The State and Future of Cloud-Native Model Serving

0 rewiews
Explore KServe's progress, latest developments, and future roadmap for cloud-native ML model serving. Learn about Kubernetes design patterns and CNCF ecosystem integration for production model deployment.
Add to list
1 Lesons
39 minutes
On-Demand
Free-Video
Linux Foundation

Machine Learning in Fastly's Compute@Edge

0 rewiews
Explore WebAssembly modules for efficient ML model execution in Fastly's Compute@Edge, covering wasi-nn extensions, host API revisions, and KServe protocol integration for enhanced performance.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
Linux Foundation

Integrating High Performance Feature Stores with KServe Model Serving

0 rewiews
Explore high-performance feature stores integration with KServe for efficient ML model serving, focusing on Feast concepts, KServe challenges, and scalable architectures.
Add to list
16 Lesons
29 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Serving Machine Learning Models at Scale Using KServe

0 rewiews
Explore KServe's Multi-Model Serving solution for scalable machine learning deployment. Learn design, implementation, and benchmarks for efficient model serving across frameworks.
Add to list
1 Lesons
40 minutes
On-Demand
Free-Video
Linux Foundation

MLSecOps - Automated Online and Offline ML Model Evaluations on Kubernetes

0 rewiews
Explore MLSecOps on Kubernetes: Automate real-time and offline ML model evaluations using KServe, Knative, Apache Kafka, and Trusted-AI tools for enhanced security and monitoring in production environments.
Add to list
17 Lesons
32 minutes
On-Demand
Free-Video
Linux Foundation

Creating a Custom Serving Runtime in KServe ModelMesh - Hands-On Experience

0 rewiews
Learn to create custom serving runtimes in KServe ModelMesh for ML model deployment. Explore key features, build container images, and run predictions using custom runtimes in this hands-on tutorial.
Add to list
19 Lesons
30 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Efficient Integration of Kubeflow Tools - ISS Data Case Study on Anomaly Detection

0 rewiews
Explore Kubeflow's integrated tools for ML workflows through an ISS anomaly detection case study, showcasing Dask, Katib, PyTorch Operator, and KServe in a unified KFP pipeline.
Add to list
1 Lesons
23 minutes
On-Demand
Free-Video
Linux Foundation

Optimizing Kubernetes Cluster Scaling for Advanced Generative Models

0 rewiews
Explore advanced techniques for scaling Kubernetes clusters to support complex generative models, leveraging tools like Flyte, MLflow, and Kubeflow for efficient deployment and management.
Add to list
1 Lesons
1 hour 22 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Serving Machine Learning Models at Scale Using KServe

0 rewiews
Explore KServe's Multi-Model Serving solution for scalable machine learning deployment, addressing resource limitations and enabling efficient GPU utilization in Kubernetes clusters.
Add to list
23 Lesons
31 minutes
On-Demand
Free-Video
Platform Engineering

Engineering Cloud Native AI Platform

0 rewiews
Explore best practices and challenges in building scalable AI/ML platforms using cloud-native technologies like Kubernetes, Kubeflow, and KServe. Deep dive into a reference platform for modern AI infrastructure.
Add to list
1 Lesons
13 minutes
On-Demand
Free-Video
Devoxx

Serverless Machine Learning Model Inference on Kubernetes with KServe

0 rewiews
Explore KServe for Kubernetes-native ML model serving, covering integration, autoscaling, inference graphs, monitoring, and deployment strategies for efficient production use.
Add to list
1 Lesons
38 minutes
On-Demand
Free-Video
DevConf

Managing MLOps at Scale in OpenShift/Kubernetes

0 rewiews
Explore MLOps at scale using open-source tools like KServe and OpenDataHub. Learn to productize AI/ML models efficiently and deploy integrated toolsets for modeling without infrastructure concerns.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
DevConf

Efficiently Deploying and Benchmarking LLMs in Kubernetes

0 rewiews
Deploy and benchmark LLMs on Kubernetes using Kserve. Learn performance metrics, load testing, and resource optimization for production environments.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Accelerating Serverless AI Large Model Inference with Functionalized Scheduling and RDMA

0 rewiews
Optimizing serverless AI inference with functionalized scheduling and RDMA for faster response times and efficient KV cache migration, addressing challenges in large-scale model deployment.
Add to list
1 Lesons
35 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Best Practices for Deploying LLM Inference, RAG and Fine-Tuning Pipelines on Kubernetes

0 rewiews
Master best practices for deploying and managing LLM inference pipelines on Kubernetes, covering optimization techniques, security measures, and efficient pipeline management using tools like KServe.
Add to list
1 Lesons
35 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Unlocking the Potential of Large Models in Production - Best Practices and Solutions

0 rewiews
Discover practical solutions for deploying and scaling LLMs in production using cloud-native technologies, focusing on KServe implementation, optimization techniques, and operational best practices.
Add to list
1 Lesons
36 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Optimizing Load Balancing and Autoscaling for Large Language Model (LLM) Inference on Kubernetes

0 rewiews
Discover practical techniques for optimizing LLM inference deployments on Kubernetes, focusing on load balancing, autoscaling, and efficient GPU resource utilization using KServe and Knative.
Add to list
1 Lesons
38 minutes
On-Demand
Free-Video
Canonical Ubuntu

End-to-end Generative AI Workflows for Developers

0 rewiews
Discover how to deploy and scale Meta Llama 3.1 models using NVIDIA NIM, KServe, and PEFT techniques in a Kubernetes environment, with practical demonstrations of enterprise-grade AI workflows.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video