Training on the Test Set and Other Heresies
Explore unconventional approaches to machine learning, challenging traditional wisdom on generalization, model size, and dataset usage in deep learning research.
Recent Advances in Iterative Solvers for Interior Point Methods
Explore recent advancements in iterative solvers for interior point methods, covering linear programming, optimization theory, and applications in big data and compressed sensing.
Machine Learning Basics: A Speedrun - IPAM at UCLA
Speedrun through machine learning fundamentals, covering key concepts like inductive bias, regularization, and kernel methods for both linear and nonlinear regression.
On the Use of Machine Learning for Computational Imaging
Exploring machine learning applications in computational imaging, focusing on inverse problems, regularization, and challenges in phase retrieval, 3D structure reconstruction, and surface analysis.
The Learning Problem and Regularization
Explore the foundations of machine learning with Prof. Poggio, covering key concepts like generalization, consistency, and regularization in solving learning problems.
Variational Autoencoders
Explore generative models, autoencoders, and variational techniques in deep learning. Learn about architecture, optimization, and practical applications of variational autoencoders.
Statistical Learning Theory and Applications - Class 7
Explore statistical learning theory, covering least squares, gradient descent, regularization, and induction, with insights into historical context and practical applications.
Introduction to Optimization
Learn optimization techniques for machine learning, including likelihood estimation, gradient descent, and regularization, with practical examples and applications.
Discrepancy Minimization via Regularization
Explore a novel algorithmic framework for discrepancy minimization, reinterpreting key breakthroughs and proving conjectures for pseudorandom instances through regularization techniques.
MIT Introduction to Deep Learning - Foundations of Deep Learning - Lecture 1
Comprehensive introduction to deep learning fundamentals, covering perceptrons, neural networks, loss functions, gradient descent, backpropagation, and regularization techniques for effective model training.
Stochastic Depth for Neural Networks - Implementation and Analysis
Explore stochastic depth in neural networks: a regularization method for residual networks that enhances training speed and test performance. Includes methodology explanation and PyTorch implementation.
Issues Related to Regularizing Thermo and Magnetic Contributions within Nonrenormalizable Theories
Explore regularization challenges in thermo and magnetic contributions for nonrenormalizable theories in strongly interacting matter.
Learning Neural Network Hyperparameters for Machine Translation - 2019
Explore neural network hyperparameter optimization for machine translation, focusing on efficient methods to learn parameters during training without extensive grid searches.
Learning with Marginalized Corrupted Features
Explore machine learning with marginalized corrupted features, a novel approach to enhance generalization and scalability in finite data scenarios. Discover applications in risk minimization and document representation.
Handling Multicollinearity with Ridge Regression in Python
Implement Ridge Regression using Python and sklearn to handle multicollinearity in data analysis.
MixupE: Understanding and Improving Mixup from Directional Derivative Perspective - Oral Session 1
Explore MixupE, an improved data augmentation technique for deep neural networks. Gain insights into its theoretical foundations and practical applications across various domains.
MIT Introduction to Deep Learning
Comprehensive introduction to deep learning fundamentals, covering perceptrons, neural networks, loss functions, gradient descent, backpropagation, and regularization techniques for building effective models.
Introduction to Deep Learning
Comprehensive introduction to deep learning fundamentals, covering perceptrons, neural networks, loss functions, gradient descent, backpropagation, and regularization techniques for building effective models.
Critical Phenomena from the Perspective of Fuzzy Sphere Regularization - ICBS 2024
Explore critical phenomena and phase transitions using fuzzy sphere regularization, focusing on 3D Ising model and conformal field theory applications.
Trade-off Between Optimality and Explainability in Machine Learning Models
Explore the trade-off between model explainability and accuracy in AI/ML, focusing on counterfactual explainability and optimization challenges in high-risk applications.
Overfitting: Benign, Tempered and Harmful - Lecture on Machine Learning Regularization
Explore the nuanced understanding of overfitting in neural networks, examining benign, tempered, and harmful effects on model performance based on data properties and training conditions.