Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#Quantization

Showing: 197 courses
University of Central Florida

Instance Segmentation - Lecture 26

0 rewiews
Explore instance segmentation in computer vision, covering Mask R-CNN, ROI pooling, and alignment techniques for precise object detection and pixel-level classification.
Add to list
9 Lesons
29 minutes
On-Demand
Free-Video
MLOps World: Machine Learning in Production

Leaner, Greener and Faster PyTorch Inference with Quantization

0 rewiews
Explore PyTorch quantization techniques to optimize neural networks, reducing size and improving speed without sacrificing accuracy. Learn implementation strategies and real-world applications.
Add to list
1 Lesons
1 hour 38 minutes
On-Demand
Free-Video
Association for Computing Machinery (ACM)

Quantized Optimal Transport Reward-based Reinforcement Learning Approach to Detoxify Query Auto-Completion - Lecture 1

0 rewiews
Explore a novel reinforcement learning approach for detoxifying query auto-completion using quantized optimal transport rewards.
Add to list
1 Lesons
14 minutes
On-Demand
Free-Video
MIT HAN Lab

MCUNet and TinyML - Lecture 10

0 rewiews
Explore MCUNet and TinyML for efficient machine learning on microcontrollers. Learn optimization techniques and real-world applications in resource-constrained environments.
Add to list
1 Lesons
1 hour 7 minutes
On-Demand
Free-Video
Anyscale

Databricks' vLLM Optimization for Cost-Effective LLM Inference - Ray Summit 2024

0 rewiews
Discover strategies for optimizing vLLM to enhance LLM inference performance, reduce GPU idle time, and accelerate quantization, leading to cost-effective large-scale language model deployment.
Add to list
1 Lesons
28 minutes
On-Demand
Free-Video

Real-Time Digital Signal Processing Laboratory Course

0 rewiews
Comprehensive video series on real-time digital signal processing, covering DSP architecture, filters, modulation techniques, and communication systems. Includes lectures and homework discussions for hands-on learning.
Add to list
45 Lesons
1 day 12 hours
On-Demand
Free-Video
Institute for Advanced Study

Gauge Theory and the Analytic Approach to Geometric Langlands - Edward Witten

0 rewiews
Explore gauge theory's role in geometric Langlands correspondence, comparing categorical and analytic approaches through quantum states, operators, and gauge theory interpretations.
Add to list
25 Lesons
1 hour 1 minute
On-Demand
Free-Video
Anyscale

Optimizing vLLM Performance Through Quantization - Model Compression Techniques

0 rewiews
Discover practical techniques for model quantization in vLLM deployments, exploring FP8, INT8, and INT4 methods to enhance performance and reduce memory usage while maintaining efficiency.
Add to list
1 Lesons
38 minutes
On-Demand
Free-Video
Institut des Hautes Etudes Scientifiques (IHES)

The Completion of the Space of Lagrangian Submanifolds for the Spectral Metric

0 rewiews
Explore the spectral metric on Lagrangian spaces, its completion, and connections to symplectic topology and sheaf theory through quantization.
Add to list
1 Lesons
48 minutes
On-Demand
Free-Video
The Machine Learning Engineer

MLOPS LLMs: Converting Microsoft Phi3 to GGUF Format with LLaMA.cpp

0 rewiews
Aprende a cuantizar el modelo Microsoft Phi3 a formatos bf16, fp16 o q8_0 utilizando LLaMA.cpp para optimizar el rendimiento de LLMs.
Add to list
1 Lesons
23 minutes
On-Demand
Free-Video
The Machine Learning Engineer

MLOPS LLMs - Converting Microsoft Phi3 to GGUF Format with LLaMA.cpp

0 rewiews
Aprende a cuantizar el modelo Phi3 mini a diferentes tipos de datos utilizando LLama.cpp para optimizar el rendimiento y la eficiencia.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
The Machine Learning Engineer

MLOps with MLFlow: Comparing Microsoft Phi3 Mini 128k in GGUF, MLFlow, and ONNX Formats

0 rewiews
Explora el modelo Phi3 Mini 128k en formatos MLFlow, GGUF y ONNX. Compara rendimiento y precisión en diferentes configuraciones. Aprende a implementar y optimizar modelos de lenguaje para diversas plataformas.
Add to list
1 Lesons
51 minutes
On-Demand
Free-Video
The Machine Learning Engineer

AirLLM: Inferencia de LLM de 70 Billones de Parámetros en GPU de 4GB - Español

0 rewiews
Aprende a realizar inferencia con un LLM de 70 billones de parámetros en una GPU doméstica de 4GB usando AirLLM. Explora técnicas avanzadas de machine learning y optimización de recursos.
Add to list
1 Lesons
23 minutes
On-Demand
Free-Video
The Machine Learning Engineer

Visual Studio Code AI Toolkit Introduction - Data Science and Machine Learning

0 rewiews
Explora el Visual Studio Code AI Toolkit con ejemplos prácticos en Python y C# para inferencia en CPU usando el modelo Phi 3 4K Instruct cuantizado.
Add to list
1 Lesons
20 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOps: Como usar Nvidia TensorRT SDK para Inferencia en GPU

0 rewiews
Optimiza la inferencia en GPU con Nvidia TensorRT SDK, convirtiendo modelos y comparando tiempos de ejecución en diferentes precisiones de datos.
Add to list
1 Lesons
40 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOps: Comparación de Openvino, ONNX, TensorRT y Pytorch para Inferencia

0 rewiews
Compara el rendimiento de inferencia de modelos convertidos a ONNX, OpenVino y TensorRT frente a PyTorch nativo en GPU y CPU.
Add to list
1 Lesons
39 minutes
On-Demand
Free-Video
The Machine Learning Engineer

MLOPS: Object Detection con Faster RCNN en C# Formato ONNX en CPU

0 rewiews
Desarrolla una aplicación de detección de objetos en C# utilizando Fast RCNN, ONNX y CPU para inferencia eficiente.
Add to list
1 Lesons
24 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOPs: Inferencia en CPU con Phi3 Vision 128k Instruct - ONNX 4bits en C#

0 rewiews
Aprende a realizar inferencia en CPU con Phi 3 Vision 128K Instruct, utilizando modelos ONNX de 4 bits y C# para prompts multimodales eficientes.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOPs - Inferencia en CPU con Phi3 4k Instruct ONNX 4bits en C#

0 rewiews
Aprende a realizar inferencia en CPU con Phi 3 4K Instruct cuantizado a 4 bits en ONNX usando C#, optimizando el rendimiento de modelos de lenguaje.
Add to list
1 Lesons
24 minutes
On-Demand
Free-Video
Reducible

The Unreasonable Effectiveness of JPEG: A Signal Processing Approach

0 rewiews
Explore the mathematical foundations and signal processing insights behind JPEG compression, including color spaces, discrete cosine transform, and quantization techniques for efficient image encoding.
Add to list
19 Lesons
35 minutes
On-Demand
Free-Video
USENIX

Models on the Move: Towards Feasible Embedded AI for Intrusion Detection on Vehicular CAN Bus

0 rewiews
Innovative AI model for efficient intrusion detection on vehicular CAN bus, enhancing automotive cybersecurity with high accuracy and low latency using FPGA hardware acceleration.
Add to list
1 Lesons
18 minutes
On-Demand
Free-Video
ADC - Audio Developer Conference

Leveraging Pruning and Quantization for Efficient Real-Time Audio Applications

0 rewiews
Explore pruning and quantization techniques to enhance efficiency of complex audio models for real-time processing in resource-constrained environments. Gain insights into model compression for audio applications.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
NPTEL-NOC IITM

Signal and Noise - Lecture 14

0 rewiews
Explore signal and noise concepts in this concise lecture, enhancing your understanding of fundamental principles in signal processing.
Add to list
1 Lesons
15 minutes
On-Demand
Free-Video
NPTEL-NOC IITM

Signals in the Physical World - Lecture 15

0 rewiews
Explore signals in the physical world, examining their characteristics, types, and applications in various scientific and engineering domains.
Add to list
1 Lesons
12 minutes
On-Demand
Free-Video
Hausdorff Center for Mathematics

Helmut Bölcskei - Lossy Compression on General Data Structures

0 rewiews
Explore lossy compression for data on manifolds and fractals, with bounds on rate-distortion function and quantization error. Applications in data science and image processing.
Add to list
14 Lesons
44 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOps: Quantization Models and Inference with ONNX Generative Runtime

0 rewiews
Explore ONNX runtime GPU support for inference with generative models, including Phi3-mini quantization and conversion techniques.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
Valerio Velardo - The Sound of AI

Understanding Audio Signals for Machine Learning

0 rewiews
Explore audio digital signals, analog-to-digital conversion, and key concepts like sampling, quantization, and aliasing for machine learning applications.
Add to list
18 Lesons
25 minutes
On-Demand
Free-Video
IMSA

Stability Structures in Holomorphic Morse-Novikov Theory

0 rewiews
Explore complex symplectic manifolds, Floer theory, and Morse-Novikov theory. Delve into analytic questions of convergence and generalization to almost-complex cases in this advanced mathematical lecture.
Add to list
1 Lesons
1 hour 6 minutes
On-Demand
Free-Video
International Mathematical Union

Yiannis Sakellaridis- Spherical Varieties, Functoriality, and Quantization

0 rewiews
Explore spherical varieties, functoriality, and quantization in algebraic geometry and representation theory with Yiannis Sakellaridis' advanced mathematical lecture.
Add to list
1 Lesons
44 minutes
On-Demand
Free-Video
NCCR SwissMAP

Topological Recursion and Quantum Curves

0 rewiews
Explore quantisation of moduli spaces through topological recursion and quantum curves with expert B. Eynard from IPHT CEA Saclay.
Add to list
1 Lesons
2 hours 18 minutes
On-Demand
Free-Video
NCCR SwissMAP

Symplectic Geometry of the Teichmueller Space of Hyperbolic 0-Metric

0 rewiews
Explore symplectic geometry of Teichmueller space for hyperbolic 0-metric, delving into quantisation of moduli spaces from various perspectives.
Add to list
1 Lesons
1 hour 4 minutes
On-Demand
Free-Video
NCCR SwissMAP

Topological Recursion, Resurgence and BPS Structure

0 rewiews
Explore quantisation of moduli spaces through topological recursion, resurgence, and BPS structure with K. Iwaki from the University of Tokyo.
Add to list
1 Lesons
59 minutes
On-Demand
Free-Video
Kavli Institute for Theoretical Physics

Integrable Sigma Models at RG Fixed Points - Quantisation as Affine Gaudin Models

0 rewiews
Explores recent advances in integrable models, focusing on quantization as affine Gaudin models. Covers topics from mathematical physics, condensed matter, and string theory, offering insights for researchers across various backgrounds.
Add to list
1 Lesons
1 hour 4 minutes
On-Demand
Free-Video
Fields Institute

Which Physical Systems Can Be Quantized?

0 rewiews
Explore quantum mechanics applications in physical systems, focusing on Hamiltonian geometry and quantization techniques for various phenomena in mathematical physics.
Add to list
1 Lesons
55 minutes
On-Demand
Free-Video
NCCR SwissMAP

Integrable Sigma Models at RG Fixed Points: Quantisation as Affine Gaudin Models

0 rewiews
Explore integrable sigma models at RG fixed points and their quantization as affine Gaudin models in condensed matter physics and quantum field theory.
Add to list
1 Lesons
1 hour 1 minute
On-Demand
Free-Video
NCCR SwissMAP

Combinatorial Quantization and BV Structures of Moduli of Flat Connections - Part 1

0 rewiews
Explore quantization of moduli spaces through combinatorial methods and BV structures, focusing on flat connections in mathematical physics.
Add to list
1 Lesons
55 minutes
On-Demand
Free-Video
NCCR SwissMAP

Quantum Analytic Langlands - Quantisation of Moduli Spaces

0 rewiews
Explore quantisation of moduli spaces through diverse perspectives, delving into the intricacies of Quantum Analytic Langlands theory.
Add to list
1 Lesons
2 hours 26 minutes
On-Demand
Free-Video
tinyML

Autonomous Nano-UAVs: An Extreme Edge Computing Case

0 rewiews
Exploring autonomous nano-UAVs as extreme edge computing cases, focusing on onboard intelligence, machine learning techniques, and full-stack solutions for navigation and human-robot interaction in resource-constrained environments.
Add to list
22 Lesons
31 minutes
On-Demand
Free-Video
tinyML

The Akida Neural Processor - Low Power CNN Inference and Learning

0 rewiews
Explore Akida Neural Processor's low-power CNN inference and edge learning capabilities, featuring event-based computing and on-chip learning for visual and auditory applications.
Add to list
14 Lesons
38 minutes
On-Demand
Free-Video
USENIX

Overcoming Challenges in Serving Large Language Models - SREcon23 Europe/Middle East/Africa

0 rewiews
Explore hosting GPT models in Kubernetes, covering GPU sharding, tensor parallelism, and model optimization. Learn trade-offs between latency, accuracy, and resource allocation, with a live demo showcasing performance.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
Discover AI

Coding RLHF on LLama 2 with LoRA, 4-bit Quantization, TRL and DPO

0 rewiews
Master advanced LLM fine-tuning techniques using RLHF, implementing DPO and PPO methods on Llama models with 4-bit quantization and LoRA for optimized performance and human feedback integration.
Add to list
1 Lesons
36 minutes
On-Demand
Free-Video
Discover AI

Understanding 4-bit Quantization and QLoRA - Memory Efficient Fine-tuning of LLMs

0 rewiews
Dive into memory-efficient fine-tuning of large language models through 4-bit quantization and QLoRA, combining theoretical foundations with practical implementation in Colab.
Add to list
1 Lesons
42 minutes
On-Demand
Free-Video
SNIAVideo

In-SRAM Computing for Generative AI and Large Language Models

0 rewiews
Explore innovative In-SRAM computing architecture and its role in reducing power consumption for large language models and generative AI in datacenter environments.
Add to list
1 Lesons
40 minutes
On-Demand
Free-Video
AI Bites

Quantization in Deep Learning: Types, Algorithms, and Implementation

0 rewiews
Explore quantization techniques in deep learning, from uniform to non-uniform approaches, and learn practical implementation strategies for optimizing large-scale neural networks.
Add to list
5 Lesons
13 minutes
On-Demand
Free-Video
AI Bites

Simple Quantization of LLMs - A Hands-on Guide to Absolute Max and Zero Point Methods

0 rewiews
Master practical LLM quantization techniques through hands-on implementation of Absolute Max and Zero Point methods, building foundational skills for advanced approaches like GPTQ and AWQ.
Add to list
1 Lesons
15 minutes
On-Demand
Free-Video
AI Bites

QLoRA: Efficient Training of Large Language Models Using Quantization and Low-Rank Adaptation

0 rewiews
Discover how QLoRA enables efficient training of large language models on a single GPU through innovative techniques like NormalFloat, Double Quantization, and Paged Optimizers.
Add to list
10 Lesons
12 minutes
On-Demand
Free-Video
Discover AI

AI Phone: From Voice Assistants to Advanced AI Integration and Reasoning

0 rewiews
Explore the revolutionary concept of AI Phone technology, from LLM quantization to advanced reasoning systems, and discover how AI-centric devices could transform mobile computing and human interaction.
Add to list
1 Lesons
17 minutes
On-Demand
Free-Video
UofU Data Science

Faster and Cheaper LLMs with Weight and Key-value Cache Quantization

0 rewiews
Explore advanced techniques for optimizing Large Language Models through weight and key-value cache quantization methods to improve speed and reduce computational costs.
Add to list
1 Lesons
55 minutes
On-Demand
Free-Video
CNCF [Cloud Native Computing Foundation]

Debugging Machine Learning on the Edge with MLExray

0 rewiews
Explore MLExray for efficient debugging of edge-deployed machine learning models, covering benefits, deployment challenges, and practical demonstrations.
Add to list
21 Lesons
27 minutes
On-Demand
Free-Video
Paul G. Allen School

SAMPL Research Group Presentations on Machine Learning Hardware and Systems

0 rewiews
Presentations on cutting-edge machine learning hardware, efficient cloud communication, dynamic tensor rematerialization, alternative datatypes, and quantized ML kernels by UW graduate students.
Add to list
1 Lesons
58 minutes
On-Demand
Free-Video
Aleksa Gordić - The AI Epiphany

High Fidelity Neural Audio Compression - Paper & Code Explained

0 rewiews
Explore neural audio compression techniques achieving 10x compression rates, with in-depth analysis of paper and code implementation, including VQ-VAE, VQ-GAN, and AudioGen applications.
Add to list
14 Lesons
58 minutes
On-Demand
Free-Video
Open Data Science

Deploying Optimized Deep Learning Pipelines

0 rewiews
Survey of deep learning pipeline optimization techniques, exploring quantization, distillation, and math library selection. Discusses trade-offs for deployment and provides insights for efficient ML implementation.
Add to list
13 Lesons
45 minutes
On-Demand
Free-Video
Open Data Science

Leaner and Greener AI with Quantization in PyTorch - Suraj Subramanian

0 rewiews
Discover how quantization in PyTorch can make AI models lighter, faster, and more power-efficient without compromising accuracy. Learn techniques and workflows from an ML expert at Meta AI.
Add to list
8 Lesons
28 minutes
On-Demand
Free-Video
Databricks

Scaling Up AI Research to Production with PyTorch and MLFlow

0 rewiews
Explore PyTorch's latest advancements in AI research and production, including distributed training, model optimization, and deployment using MLFlow, with insights on scaling and efficiency.
Add to list
30 Lesons
44 minutes
On-Demand
Free-Video
tinyML

Power Efficient Neural Network Based Hardware Architecture for Biomedical Applications

0 rewiews
Power-efficient neural network hardware architecture for biomedical applications, focusing on sleep apnea detection using ECG and SpO2 data. Introduces SABiNN technique for reduced power consumption and compact design while maintaining accuracy.
Add to list
15 Lesons
27 minutes
On-Demand
Free-Video
tinyML

Continual On-Device Learning on Multi-Core RISC-V Microcontrollers

0 rewiews
Explore continual on-device learning for multi-core RISC-V microcontrollers, focusing on system architecture, memory-energy-accuracy trade-offs, and efficient implementation of backpropagation techniques using latent replays.
Add to list
12 Lesons
25 minutes
On-Demand
Free-Video
tinyML

Optimizing Data-Flow in Binary Neural Networks

0 rewiews
Explore optimizing data flow in Binary Neural Networks, focusing on hardware efficiency, quantization techniques, and accuracy improvements for embedded systems.
Add to list
14 Lesons
20 minutes
On-Demand
Free-Video
tinyML

TinyML Auto ML Deep Dive: GAPflow - From TFLite and ONNX to Optimized C Code

0 rewiews
Explore GAPflow: transform neural networks into optimized C code for ultra-low-power GAP processors. Learn quantization, validation, and memory allocation for efficient AI deployment on energy-constrained devices.
Add to list
12 Lesons
40 minutes
On-Demand
Free-Video
tinyML

On-Device Learning Under 256KB Memory - Challenges and Solutions for IoT Devices

0 rewiews
Explore on-device learning for IoT devices with limited memory. Learn techniques for efficient model adaptation, quantization-aware scaling, and sparse updates to enable continuous learning on tiny hardware.
Add to list
13 Lesons
35 minutes
On-Demand
Free-Video
Nvidia

Inference and Quantization for AI - Session 3

0 rewiews
Explore quantized inference, TensorRT 5, and TensorFlow integration for AI model optimization. Learn about NVIDIA's inference server and techniques to improve model efficiency and performance.
Add to list
33 Lesons
41 minutes
On-Demand
Free-Video
tinyML

On-Device Speech Models Optimization and Deployment for Mobile Hardware

0 rewiews
Explore on-device speech model optimization and deployment, covering streaming-aware design, quantization techniques, and benchmarks for popular speech processing model topologies on mobile platforms.
Add to list
15 Lesons
26 minutes
On-Demand
Free-Video
tinyML

Power-of-Two Quantization for Low Bitwidth and Hardware Compliant Neural Networks

0 rewiews
Explore power-of-two quantization for efficient neural networks, focusing on low bitwidth and hardware compatibility. Learn about key problems, methods, and results in this cutting-edge research.
Add to list
9 Lesons
24 minutes
On-Demand
Free-Video
tinyML

TinyML Talks Germany - AutoFlow - An Open Source Framework to Automatically Implement Neural

0 rewiews
Explore AutoFlow: an open-source framework for automating neural network implementation on embedded devices, covering model building, optimization, and deployment.
Add to list
14 Lesons
39 minutes
On-Demand
Free-Video
tinyML

Extremely Low-Bit Quantization for Transformers - tinyML Asia 2021

0 rewiews
Explore extremely low-bit quantization techniques for Transformers, focusing on mixed precision strategies to optimize deployment on resource-limited devices without compromising accuracy.
Add to list
21 Lesons
28 minutes
On-Demand
Free-Video
tinyML

Introduction to Optimization Algorithms to Compress Neural Networks

0 rewiews
Explore optimization techniques for compressing neural networks, including pruning and quantization, to enable deployment on resource-constrained devices like smartphones.
Add to list
16 Lesons
48 minutes
On-Demand
Free-Video
tinyML

A Review of Compression Methods for Deep Convolutional Neural Networks

0 rewiews
Explore compression techniques for Convolutional Neural Networks, including pruning, distillation, and quantization, to optimize deployment on tinyML devices without compromising accuracy.
Add to list
27 Lesons
58 minutes
On-Demand
Free-Video
tinyML

ELL: The Microsoft Embedded Learning Library - Principles and Applications

0 rewiews
Explore Microsoft's Embedded Learning Library for efficient AI on resource-constrained devices. Learn about quantization, acceleration techniques, and architecture search for optimized machine learning deployment.
Add to list
14 Lesons
26 minutes
On-Demand
Free-Video
tinyML

tinyMLPerf: Benchmarking Ultra-low Power Machine Learning Systems

0 rewiews
Explore benchmarking for ultra-low power ML systems, focusing on tinyMLPerf's methodology, tasks, and ecosystem impact. Learn about quantization and community-driven efforts in this emerging field.
Add to list
15 Lesons
24 minutes
On-Demand
Free-Video
tinyML

The Model Efficiency Pipeline: Enabling Deep Learning Inference at the Edge

0 rewiews
Explore optimizing deep learning for edge devices through model efficiency techniques, including neural architecture search, pruning, quantization, and conditional processing.
Add to list
42 Lesons
50 minutes
On-Demand
Free-Video
tinyML

SWIS: Shared Weight Bit Sparsity for Efficient Neural Network Acceleration

0 rewiews
Explore SWIS, a quantization framework for efficient neural network inference acceleration, offering improved performance and storage compression through weight decomposition and scheduling algorithms.
Add to list
11 Lesons
20 minutes
On-Demand
Free-Video
tinyML

hls4ml: An Open-Source Co-Design Workflow for Scientific Low-Power Machine Learning Devices

0 rewiews
Explore hls4ml, an open-source workflow for implementing machine learning algorithms on FPGAs and ASICs, enabling real-time processing for scientific applications and accelerating discoveries.
Add to list
5 Lesons
21 minutes
On-Demand
Free-Video
tinyML

Many Shades of Acceleration - An Open TinyML Platform Perspective

0 rewiews
Explore extreme edge AI, energy efficiency, and acceleration techniques for TinyML applications with insights from the PULP platform and RISC-V processors.
Add to list
23 Lesons
55 minutes
On-Demand
Free-Video
tinyML

Advanced Network Quantization and Compression Using AIMET - tinyML Summit 2021

0 rewiews
Explore advanced network quantization and compression techniques using AIMET to optimize AI models for efficient deployment on end devices, addressing memory, compute, and energy constraints.
Add to list
20 Lesons
1 hour 34 minutes
On-Demand
Free-Video
tinyML

Build Industrial-Grade TinyML Applications with Edge Impulse - Tutorial

0 rewiews
Learn to build industrial-grade tinyML applications using Edge Impulse. Covers dataset collection, model design, training, optimization, and integration into embedded systems running on MCUs.
Add to list
14 Lesons
1 hour 37 minutes
On-Demand
Free-Video
tinyML

Building a Magic Wand with TensorFlow Lite Micro - Tutorial

0 rewiews
Learn to build an IMU-based gesture recognition model for Arduino, covering data gathering, training, and deployment using TensorFlow Lite Micro and CMSIS-NN library.
Add to list
19 Lesons
1 hour 33 minutes
On-Demand
Free-Video
tinyML

MicroTVM: A Tensor Compiler for Bare Metal

0 rewiews
Explore microTVM, a tensor compiler for bare metal devices, its functionality, and future directions. Learn about deployment challenges and see a demonstration of the technology.
Add to list
24 Lesons
58 minutes
On-Demand
Free-Video
tinyML

AI at the Edge - Enabling Vision for Low-Power Devices

0 rewiews
Explore AI's shift to edge devices, focusing on building efficient computer vision algorithms for battery-powered devices. Learn about data collection, continuous learning, and optimization techniques.
Add to list
15 Lesons
57 minutes
On-Demand
Free-Video
tinyML

Machine Learning at the Extreme Edge of Always-on Intelligent Sensor Networks

0 rewiews
Explore ML optimization techniques for resource-constrained IoT sensor nodes, focusing on system, algorithm, architecture, and circuit levels to achieve significant area-power improvements.
Add to list
17 Lesons
43 minutes
On-Demand
Free-Video
Paul G. Allen School

Trends in Deep Learning Hardware

0 rewiews
Explore deep learning hardware advancements, including GPU efficiency improvements and data representation innovations, with NVIDIA's chief scientist Bill Dally.
Add to list
1 Lesons
1 hour 11 minutes
On-Demand
Free-Video
Data Science Dojo

Leveraging Open-Source LLMs for Production

0 rewiews
Explore open-source LLMs, comparing them to proprietary options. Learn about hosting costs, performance evaluation, and practical applications. Gain insights into fine-tuning techniques and emerging trends in AI development.
Add to list
11 Lesons
1 hour 7 minutes
On-Demand
Free-Video
Open Data Science

PyTorch 2.1 - New Features and Accelerating Generative AI Models

0 rewiews
Explore PyTorch 2.1's new features for AI model acceleration, including compile, distributed, inference, and edge technologies, with insights on optimizing generative AI models for enhanced performance.
Add to list
6 Lesons
26 minutes
On-Demand
Free-Video
Aleksa Gordić - The AI Epiphany

GPT-Fast - Blazingly Fast Inference with PyTorch

0 rewiews
Explore techniques for accelerating AI inference using PyTorch, including compile, quantization, speculative decoding, and tensor parallelism, with expert insights from Horace He.
Add to list
10 Lesons
1 hour 5 minutes
On-Demand
Free-Video
Sam Witteveen

Testing Microsoft's New VLM - Phi-3 Vision Model

0 rewiews
Explore Microsoft's Phi-3 Vision model capabilities through hands-on demonstrations, including image analysis and 4-bit quantization, with insights from the model's documentation and research paper.
Add to list
7 Lesons
15 minutes
On-Demand
Free-Video
Yannic Kilcher

Scalable MatMul-free Language Modeling - Paper Explained

0 rewiews
Explore innovative MatMul-free language modeling techniques using quantization and recurrence, achieving comparable performance to traditional models while significantly reducing computational costs and memory usage.
Add to list
8 Lesons
50 minutes
On-Demand
Free-Video
Krish Naik

Generative AI: Fine-Tuning LLM Models Crash Course

0 rewiews
Comprehensive guide to fine-tuning LLMs using advanced techniques like QLORA and quantization, covering theoretical concepts and practical implementations with popular models like LLama2 and Google Gemma.
Add to list
8 Lesons
2 hours 37 minutes
On-Demand
Free-Video
The Machine Learning Engineer

MLOps: OpenVino Quantized Pipeline for Grammatical Error Correction

0 rewiews
Build a grammar error correction model using OpenVino, combining Roberta-based error detection and Flan-T5 correction, with quantization for efficient CPU inference.
Add to list
1 Lesons
55 minutes
On-Demand
Free-Video
The Machine Learning Engineer

Object Detection with Faster R-CNN in C# Using ONNX on CPU

0 rewiews
Implement object detection using Faster R-CNN in C# with ONNX format on CPU, leveraging machine learning for efficient image analysis.
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOPs: Multimodal Prompting and Inference with Phi-3 Vision 128K Instruct on CPU - ONNX 4-Bit Quantization in C#

0 rewiews
Explore multimodal prompting and CPU inference using Phi 3 Vision 128K Instruct, quantized to 4 bits in ONNX format, with C# implementation for efficient machine learning operations.
Add to list
1 Lesons
23 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOPs - Inference in CPU with Phi3 4k Instruct ONNX 4-bit Model Using C#

0 rewiews
Explore CPU-based inference using 4-bit quantized Phi 3 4K Instruct in ONNX format with C#. Learn practical implementation for efficient machine learning deployment.
Add to list
1 Lesons
24 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOps: Using Nvidia TensorRT SDK for GPU Inference

0 rewiews
Optimize GPU inference using Nvidia TensorRT SDK. Convert models, compare throughput, and explore batch sizes, data precision, and runtime options for enhanced performance.
Add to list
1 Lesons
34 minutes
On-Demand
Free-Video
USENIX

Check-N-Run - A Checkpointing System for Training Deep Learning Recommendation Models

0 rewiews
Innovative checkpointing system for large ML models, reducing bandwidth and storage needs through differential checkpointing and quantization techniques without compromising training accuracy.
Add to list
15 Lesons
16 minutes
On-Demand
Free-Video
USENIX

BatchCrypt - Efficient Homomorphic Encryption for Cross-Silo Federated Learning

0 rewiews
Efficient homomorphic encryption system for cross-silo federated learning, reducing encryption and communication overhead while maintaining privacy and accuracy in collaborative machine learning.
Add to list
18 Lesons
23 minutes
On-Demand
Free-Video
Strange Loop Conference

Client Side Deep Learning Optimization with PyTorch

0 rewiews
Explore real-time computer vision on mobile devices using PyTorch. Learn model porting, optimization techniques, and performance benchmarking for client-side deep learning applications.
Add to list
22 Lesons
35 minutes
On-Demand
Free-Video
GOTO Conferences

Best Practices for Real-time Intelligent Video Analytics

0 rewiews
Explore best practices for real-time intelligent video analytics, including transfer learning, data augmentation, and NVIDIA tools for efficient AI applications and high-performance inference.
Add to list
30 Lesons
47 minutes
On-Demand
Free-Video
Fields Institute

Helton-Howe Trace, Connes-Chern Character, and Quantization

0 rewiews
Explore advanced mathematical concepts connecting Helton-Howe Trace, Connes-Chern Character, and Quantization in this insightful lecture by Xiang Tang from Washington University in St. Louis.
Add to list
1 Lesons
46 minutes
On-Demand
Free-Video
WeAreDevelopers

Deep Learning for Mobile Devices

0 rewiews
Strategies for implementing efficient convolutional neural networks on mobile devices, covering model optimization, hardware considerations, and on-device training techniques.
Add to list
22 Lesons
44 minutes
On-Demand
Free-Video
EuroPython Conference

Accelerate Your Deep Learning Inferencing with the Intel DL Boost Technology

0 rewiews
Explore Intel® DL Boost technology for efficient deep learning inference acceleration using low-precision INT8 and VNNI instructions on 2nd gen Intel Xeon Scalable processors.
Add to list
7 Lesons
29 minutes
On-Demand
Free-Video
MLCon | Machine Learning Conference

Honey, I Shrunk the TinyML

0 rewiews
Explore TinyML: train, convert, and run machine learning models on microcontrollers. Learn quantization, pruning techniques, and step-by-step integration for embedded AI applications.
Add to list
1 Lesons
49 minutes
On-Demand
Free-Video
Meta

Building a Mobile AI Platform at Facebook - F8 2019

0 rewiews
Explore Facebook's approach to mobile AI, covering NLP, video, ASR, and content understanding. Learn about challenges, techniques, and optimizations for edge deployment.
Add to list
23 Lesons
27 minutes
On-Demand
Free-Video
EuroPython Conference

Fine-tuning Large Models on Local Hardware Using PEFT and Quantization

0 rewiews
Explore Parameter-Efficient Fine-Tuning (PEFT) and quantization techniques to train large neural networks on modest hardware using the PEFT library and Hugging Face ecosystem.
Add to list
1 Lesons
28 minutes
On-Demand
Free-Video