Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#Machine Learning Inference

Showing: 10 courses
MLOps World: Machine Learning in Production

Running Multiple Models on the Same GPU on Spot Instances

0 rewiews
Optimize ML inference costs through GPU fractionalization and Spot instances. Increase GenAI application throughput while reducing expenses.
Add to list
1 Lesons
33 minutes
On-Demand
Free-Video
Anyscale

Scaling LLM Inference - AWS Inferentia Meets Ray Serve on EKS

0 rewiews
Discover how to build scalable, cost-effective LLM inference infrastructure using Ray Serve and AWS Inferentia on Amazon EKS, optimizing deployment of models like Llama2 and Mistral-7B.
Add to list
1 Lesons
13 minutes
On-Demand
Free-Video
Linux Foundation

Deep Learning Neural Network Acceleration at the Edge

0 rewiews
Explore neural network acceleration for edge computing, covering frameworks, formats, and hardware solutions. Learn about efforts to consolidate technologies and enable innovation in intelligent devices.
Add to list
1 Lesons
37 minutes
On-Demand
Free-Video
Linux Foundation

Inference on KubeEdge

0 rewiews
Explore KubeEdge for efficient edge computing inference with Adrian Gonzalez-Martin from Seldon. Learn about deploying and managing machine learning models at the network edge.
Add to list
1 Lesons
50 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

The Hitchhiker's Guide to Kubernetes Platforms - Building AI Development Platforms

0 rewiews
Explore building a robust AI platform on Kubernetes, featuring modular APIs for efficient management and deployment. Learn from Bloomberg's implementation using open-source projects as guides.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
Simons Institute

Deep Learning and the Relational Algebra

0 rewiews
Exploring the integration of machine learning inference in query processing, including tensor operations and autograd in relational algebra, with insights from early research experiences.
Add to list
1 Lesons
32 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Serverless for ML Inference on Kubernetes - Panacea or Folly

0 rewiews
Explore serverless ML inference on Kubernetes: performance, costs, and architecture. Gain insights from benchmarking experiments to optimize your ML inference system.
Add to list
7 Lesons
27 minutes
On-Demand
Free-Video
PyCon US

Using Python to Power Serverless Applications

0 rewiews
Explore best practices for building serverless solutions with Python, focusing on API calls, streaming data, and ML inference. Learn techniques for production-grade systems with observability.
Add to list
1 Lesons
1 hour 2 minutes
On-Demand
Free-Video
TensorFlow

TensorFlow Lite - Solution for Running ML On-Device

0 rewiews
Explore TensorFlow Lite for efficient on-device ML inference, featuring low latency, high performance, and small binary size. Learn about mobile BERT, support libraries, and microcontroller applications.
Add to list
15 Lesons
34 minutes
On-Demand
Free-Video
Trelis Research

Faster Inference Using Output Predictions with OpenAI and vLLM

0 rewiews
Master advanced inference techniques for faster AI model outputs using OpenAI predictions and vLLM speculative decoding, with practical demonstrations and cost optimization strategies.
Add to list
8 Lesons
24 minutes
On-Demand
Free-Video