Introduction to Neural Networks: Classification, Softmax, and Training Techniques
Master the fundamentals of neural networks, from nonlinear and multiclass classification to feedforward networks, training techniques, and optimization strategies for improved model performance.
Machine Learning - Lecture 25
Dive into advanced data science concepts through comprehensive coverage of machine learning principles, algorithms, and practical applications in this graduate-level lecture from University of Utah.
Machine Learning - Lecture 24
Dive into advanced data science concepts through comprehensive coverage of machine learning principles, algorithms, and practical applications in this graduate-level lecture from University of Utah.
Machine Learning - Lecture 23
Dive into advanced data science concepts through comprehensive coverage of machine learning principles, algorithms, and practical applications in this graduate-level academic lecture.
Deep Learning Fundamentals - Full Stack Deep Learning
Comprehensive overview of deep learning basics, covering neural networks, learning problems, optimization techniques, and architectural considerations for AI practitioners.
Rank Overparameterization and Global Optimality Certification in Low-Rank Matrix Estimation
Explore rank overparameterization in nonconvex optimization, its impact on spurious local minima, and methods for certifying global optimality in large-scale problems.
Automatic Differentiation - Session Preview at POPL 2023
Explore automatic differentiation techniques and their applications in programming languages, presented by expert Sasa Misailovic at POPL 2023.
Gradient Descent: The Ultimate Optimizer - Automating Hyperparameter Optimization
Discover how to automatically optimize hyperparameters in gradient-based ML algorithms through an elegant modification to backpropagation, making optimizer tuning more efficient and less sensitive to initial choices.
Machine Learning with JAX - From Hero to HeroPro+
Advanced JAX tutorial covering PyTrees, parallelism, multi-device training, and advanced techniques for efficient machine learning model implementation and training.
Generative Adversarial Networks - Computerphile
Explore Generative Adversarial Networks (GANs) with Rob Miles, learning how neural networks compete to create new, realistic data like images and faces.
How to Create a Neural Network and Train It to Identify Doodles
Comprehensive guide to building and training neural networks from scratch, covering key concepts and practical implementation for image recognition tasks.
Gradient Boost Part 2 - Regression Details
Detailed exploration of Gradient Boost algorithm for regression, covering initialization, tree building, residual calculation, and prediction optimization. Ideal for those seeking in-depth understanding of this popular machine learning technique.
Gradient Descent, Step-by-Step
Comprehensive step-by-step explanation of Gradient Descent, covering its application in Machine Learning, optimization techniques, and variations like Stochastic Gradient Descent.
Optimization, Complexity and Math - Can We Prove P!=NP by Gradient Descent?
Explore optimization, complexity, and mathematics with Avi Wigderson. Delve into perfect matchings, symbolic matrices, and operator scaling, connecting diverse areas of mathematics and computer science.
Differentiable Programming for End-to-end Optimization of Experiments - Lecture 6
Explore differentiable programming for optimizing experiments in high-energy physics, focusing on end-to-end solutions and advanced machine learning techniques.
Building the Gradient Descent Algorithm - Coding Challenge
Hands-on tutorial for building a gradient descent algorithm from scratch in Python, implementing a regression machine learning model using only NumPy.
On the Robustness of Deep K-Nearest Neighbors
Explore the robustness of Deep k-Nearest Neighbors against adversarial attacks, proposing a heuristic method to find vulnerabilities in this defense mechanism for deep learning models.
One of Three Theoretical Puzzles - Generalization in Deep Networks
Explore deep network generalization, dimensionality challenges, and optimization techniques with MIT's Tomaso Poggio. Gain insights into overparameterized networks and gradient descent for RELU architectures.
Regularized Least Squares
Explore statistical learning theory with Lorenzo Rosasco, focusing on regularized least squares, optimization techniques, and key concepts in machine learning algorithms.
Deep Networks Are Kernel Machines
Explores the theory that deep neural networks function as kernel machines, challenging the view that they discover new data representations. Discusses implications for interpretability and algorithm development.
Gradient Origin Networks - Paper Explained with Live Coding
Explore Gradient Origin Networks: a novel implicit generative model for efficient latent representation learning, with live coding demonstration and in-depth explanation of the paper's key concepts.