Regularizing Trajectory Optimization with Denoising Autoencoders - Paper Explained
Explore regularizing trajectory optimization in reinforcement learning using denoising autoencoders to improve planning and sample efficiency in motor control tasks.
Concept Learning with Energy-Based Models
Explore energy-based models for concept learning, focusing on their ability to generalize, reason abstractly, and solve problems creatively with limited data through inference-time optimization.
Gradient Descent and the Backpropagation Algorithm
Explore gradient descent and backpropagation algorithms, covering supervised learning, parametrized models, loss functions, and neural network architectures with PyTorch implementation.
Tools, Classification with Neural Nets, PyTorch Implementation
Explore neural network classification, PyTorch implementation, and advanced concepts like space-fabric stretching and regression uncertainty estimation in this comprehensive tutorial.
Optimisation
Explore optimization techniques for neural networks, including gradient descent, SGD, momentum, adaptive methods, and normalization layers, with real-world applications in MRI technology.
History, Motivation, and Evolution of Deep Learning
Explore the history, motivation, and evolution of deep learning, covering key concepts like gradient descent, backpropagation, CNNs, and feature extraction in neural networks.
Deep Q-Networks
Learn advanced reinforcement learning techniques, focusing on Deep Q-Networks. Explore approximation, optimization, and practical implementations to enhance AI decision-making capabilities.
MIT Introduction to Deep Learning
Comprehensive introduction to deep learning fundamentals, covering perceptrons, neural networks, loss functions, gradient descent, backpropagation, and regularization techniques.
Training a Neural Network - Implementing Backpropagation and Gradient Descent from Scratch
Implement backpropagation and gradient descent from scratch in Python, training a neural network to perform arithmetic sum. Includes step-by-step coding and explanations.
Training a Neural Network - Backward Propagation and Gradient Descent
Explore the theory and mathematics behind neural network training, focusing on backpropagation and gradient descent algorithms for deep learning enthusiasts.
Optimization Crash Course
Explore geometric methods in optimization and sampling, covering key topics like convexity, optimality, and gradient descent with expert insights from MIT's Ashia Wilson.
Analyzing Optimization and Generalization in Deep Learning via Dynamics of Gradient Descent
Explore deep learning optimization and generalization through gradient descent dynamics, focusing on implicit preconditioning and its impact on matrix completion problems.
Quantum Algorithms for Optimization - Quantum Colloquium
Explore quantum algorithms for optimization, including discrete and continuous problems, with insights on potential speedups and limitations in quantum computing applications.
Implicit Regularization I
Explore implicit regularization in deep learning, covering boosting, complexity control, optimization landscapes, and stochastic gradient descent for effective model training.
First-Order Stochastic Optimization
Explore first-order stochastic optimization techniques for machine learning, covering gradient descent, adaptive learning, and convergence rates in data science applications.
Provably Robust Deep Learning via Adversarially Trained Smoothed Classifiers
Explore adversarially trained smoothed classifiers for robust deep learning, covering theory, implementation, and experimental results in this technical talk.
Stochastic Gradient Descent and Machine Learning - Lecture 1
Explore optimization methods, gradient descent, Newton's method, and convexity in machine learning. Gain insights into iterative algorithms and their applications in statistical physics and data analysis.
Gradient Descent on Infinitely Wide Neural Networks - Global Convergence and
Explore gradient descent on infinitely wide neural networks, examining global convergence and optimization techniques for non-convex problems in machine learning.
Deep Learning Applications by Rina Panigrahy
Explore deep learning applications, from basic concepts to advanced techniques. Learn about neural networks, optimization methods, and real-world uses in image and speech recognition.
Toward Theoretical Understanding of Deep Learning - Lecture 2
Explores theoretical aspects of deep learning, including overparameterization, optimization, generalization, and generative models, offering insights for researchers and practitioners in machine learning.
Mathematics of Machine Learning: An Introduction - Lecture 1
Comprehensive introduction to machine learning fundamentals, covering mathematical formalization, deep learning concepts, optimization techniques, and real-world applications in various domains.