Deep Learning: Feedforward Neural Networks and Backpropagation - Lecture 2
Dive into fundamental concepts of deep learning, exploring perceptrons, feedforward neural networks, and mastering backpropagation techniques for neural network training.
Deep Learning: Historical Background and Course Motivation - Lecture 1
Discover the foundations of deep learning through a comprehensive introduction covering historical context, motivations, and essential background knowledge for beginning your AI journey.
Deep Learning: RLHF, ChatGPT, and Alignment in LLMs - Lecture 14
Dive into advanced concepts of RLHF, ChatGPT training, and LLM alignment, exploring efficient transformers and the technical foundations behind modern language models.
Deep Learning: Transformers and Encoder-Decoder Architecture - Lecture 10
Dive into transformer architectures, exploring encoder-decoder mechanisms and positional embeddings for advanced deep learning applications.
Deep Learning: BERT and GPT Models - Lecture 11
Dive into the evolution and architecture of transformer models, exploring BERT, GPT series, and T5 to understand their impact on modern natural language processing.
Attention Mechanism and Self-Attention in Deep Learning - Lecture 9
Dive into attention mechanisms and self-attention concepts in deep learning, exploring their revolutionary impact on NLP and discovering practical applications in sequence models.
Deep Learning: Dropout and Batch Normalization - Lecture 5
Delve into dropout and batch normalization techniques, understanding their mechanisms and effectiveness in deep learning, with insights on loss function smoothness and Lipschitzness.
Recurrent Neural Networks and Backpropagation Through Time - Lecture 8
Dive into recurrent neural networks, exploring LSTM, GRU architectures, and advanced concepts like backpropagation through time and gradient challenges in deep learning implementations.
Denoising Diffusion Probabilistic Models and Generative Moment Matching Networks - Lecture 17
Delve into diffusion models and DDPMs, exploring progressive data refinement techniques and generative moment matching networks using Maximum Mean Discrepancy for distribution analysis.
Generative Adversarial Networks and Adversarial Autoencoders - Lecture 16
Dive into advanced concepts of GANs and AAEs, exploring conditional implementations, mode collapse solutions, and practical applications in supervised and unsupervised learning scenarios.
Variational Autoencoders and Performers in Deep Learning - Lecture 15
Delve into advanced deep learning concepts including Variational Autoencoders (VAE), variational inference, ELBO computation, and Performer-based Transformer architectures.
Fairness in Food Delivery Platforms - Ensuring Equitable Income Distribution and Customer Satisfaction
Explore algorithmic solutions for fair income distribution in food delivery platforms, focusing on innovative approaches like FAIRFOODY and WORK4FOOD to balance worker earnings and platform efficiency.
Neural Networks and Backpropagation - Lecture 26
Dive into neural network training fundamentals through backpropagation, learning essential parameter optimization techniques and mathematical foundations for deep learning implementation.
Neural Networks - Lecture 25
Dive into neural networks' structural foundations and discover their role as a hypothesis class, exploring key concepts and practical applications in machine learning.
Multilingual and Multimodal Large Language Models
Explore the fascinating world of multilingual and multimodal Large Language Models, understanding their capabilities, applications, and future potential in AI development.
Tokenization and Morphology in Natural Language Processing
Master essential text processing concepts through tokenization and morphology analysis, exploring fundamental techniques for breaking down and understanding linguistic structures.
Reinforcement Learning from Human Feedback (RLHF) - Advances in Generative AI
Dive into reinforcement learning from human feedback (RLHF) and its crucial role in advancing generative AI systems, exploring key concepts, implementation strategies, and real-world applications.
Topics in Responsible AI - Ethics, Fairness, and Accountability
Explore the critical principles and practices of responsible artificial intelligence, examining ethical considerations and implementation strategies for AI development.
Practical Issues with Neural Networks in Machine Learning - Lecture 27
Explore practical challenges and solutions for training large neural networks, including effective strategies and optimization techniques for improved performance.
Neural Networks Foundations - Feedforward Neural Networks
Master the fundamentals of feedforward neural networks, exploring their architecture, functionality, and implementation principles for building effective machine learning models.
Faster and Cheaper LLMs with Weight and Key-value Cache Quantization
Explore advanced techniques for optimizing Large Language Models through weight and key-value cache quantization methods to improve speed and reduce computational costs.