SGD and Weight Decay Secretly Compress Your Neural Network
Explore how SGD and weight decay techniques compress neural networks, enhancing efficiency and performance in deep learning models.
MCUNet: Tiny Neural Network Design for Microcontrollers - Lecture 11
Explore algorithm and system co-design for tiny neural network inference on microcontrollers, focusing on TinyML, TinyNAS, and TinyEngine for efficient deep learning applications.
MCUNet: Tiny Neural Network Design for Microcontrollers - Lecture 11
Explore algorithm and system co-design for tiny neural network inference on microcontrollers, focusing on TinyML, TinyNAS, and TinyEngine for efficient deep learning applications.
Neural Architecture Search (Part II) - Lecture 8
Explore neural architecture search techniques, including hardware-aware approaches and joint optimization of hardware and neural architectures. Learn applications and advancements in efficient deep learning design.
Quantization in Neural Networks - Lecture 5
Explore neural network quantization, including numeric data types, K-means-based quantization, and linear quantization for efficient deep learning on resource-constrained devices.
Neural Architecture Search for Efficient Deep Learning - Lecture 9
Explore advanced neural architecture search techniques for efficient deep learning on resource-constrained devices. Gain insights into model optimization for mobile and IoT applications.
Neural Architecture Search (Part II) - Lecture 8
Explore neural architecture search techniques, including hardware-aware approaches and joint optimization of hardware and neural architectures. Learn applications and advancements in efficient deep learning design.
Implicit Deep Learning - Seminar Series
Explore implicit deep learning models, their state-space representation, training problems, and applications in parameter reduction, feature elimination, and mathematical reasoning tasks.
Efficiency in the Age of Large Scale Models - Designing and Optimizing Deep Learning Systems
Explore the challenges and solutions of large-scale AI models, from theoretical foundations to practical efficiency improvements, with insights on reducing computational costs while maintaining performance in modern machine learning.
Quantization for Efficient Machine Learning - Part I - Lecture 5
Explore quantization techniques for efficient machine learning, covering fundamental concepts and practical applications in neural network optimization.
EfficientML.ai - Quantization Part I - Lecture 5
Explore quantization techniques for efficient machine learning, focusing on part I of the topic in this MIT lecture by Prof. Song Han.
EfficientML.ai Lecture - Introduction to Efficient Machine Learning
Explore cutting-edge techniques for optimizing machine learning models, focusing on efficiency and performance in AI applications.
Pruning and Sparsity in Machine Learning - Part II (EfficientML.ai Lecture 4)
Explore advanced pruning techniques and sparsity concepts for efficient machine learning, focusing on practical applications and cutting-edge research.
Pruning and Sparsity in Machine Learning - Lecture 3
Explore pruning and sparsity techniques for efficient machine learning, focusing on reducing model size and computational requirements while maintaining performance.
Pruning and Sparsity in Machine Learning - Part I (EfficientML.ai Lecture 3)
Explore pruning and sparsity techniques for efficient machine learning, focusing on reducing model size and computational requirements while maintaining performance.
EfficientML.ai: Introduction to Efficient Machine Learning - Lecture 1
Explore efficient machine learning techniques and their applications in this comprehensive introduction to EfficientML.ai from MIT's Prof. Song Han.
EfficientML.ai: Introduction to Efficient Machine Learning - Lecture 1
Explore efficient machine learning techniques and their applications in this introductory lecture from MIT's EfficientML course, led by Prof. Song Han.
Quantum Machine Learning - Lecture 22
Explore quantum machine learning fundamentals, bridging quantum computing and AI. Gain insights into this emerging field's potential to revolutionize computational approaches.
Efficient Transformers - Lecture 20
Explore efficient transformer architectures for optimized deep learning on resource-constrained devices. Learn techniques to enhance performance and reduce computational demands.
Efficient Transformers - Lecture 20
Explore efficient transformer architectures for optimized deep learning on resource-constrained devices. Learn techniques to enhance performance and reduce computational demands.
TinyEngine - Efficient Training and Inference on Microcontrollers - Lecture 17
Explore TinyEngine library for efficient neural network training and inference on microcontrollers. Learn techniques to optimize deep learning for resource-constrained devices.