Deep Learning: Transformers and Encoder-Decoder Architecture - Lecture 10
Dive into transformer architectures, exploring encoder-decoder mechanisms and positional embeddings for advanced deep learning applications.
Deep Learning: BERT and GPT Models - Lecture 11
Dive into the evolution and architecture of transformer models, exploring BERT, GPT series, and T5 to understand their impact on modern natural language processing.
Attention Mechanism and Self-Attention in Deep Learning - Lecture 9
Dive into attention mechanisms and self-attention concepts in deep learning, exploring their revolutionary impact on NLP and discovering practical applications in sequence models.
Deep Learning: Dropout and Batch Normalization - Lecture 5
Delve into dropout and batch normalization techniques, understanding their mechanisms and effectiveness in deep learning, with insights on loss function smoothness and Lipschitzness.
Recurrent Neural Networks and Backpropagation Through Time - Lecture 8
Dive into recurrent neural networks, exploring LSTM, GRU architectures, and advanced concepts like backpropagation through time and gradient challenges in deep learning implementations.
Generative Adversarial Networks and Adversarial Autoencoders - Lecture 16
Dive into advanced concepts of GANs and AAEs, exploring conditional implementations, mode collapse solutions, and practical applications in supervised and unsupervised learning scenarios.
Variational Autoencoders and Performers in Deep Learning - Lecture 15
Delve into advanced deep learning concepts including Variational Autoencoders (VAE), variational inference, ELBO computation, and Performer-based Transformer architectures.
Neural Networks and Backpropagation - Lecture 26
Dive into neural network training fundamentals through backpropagation, learning essential parameter optimization techniques and mathematical foundations for deep learning implementation.
Neural Networks - Lecture 25
Dive into neural networks' structural foundations and discover their role as a hypothesis class, exploring key concepts and practical applications in machine learning.
Multilingual and Multimodal Large Language Models
Explore the fascinating world of multilingual and multimodal Large Language Models, understanding their capabilities, applications, and future potential in AI development.
Reinforcement Learning from Human Feedback (RLHF) - Advances in Generative AI
Dive into reinforcement learning from human feedback (RLHF) and its crucial role in advancing generative AI systems, exploring key concepts, implementation strategies, and real-world applications.
Practical Issues with Neural Networks in Machine Learning - Lecture 27
Explore practical challenges and solutions for training large neural networks, including effective strategies and optimization techniques for improved performance.
Neural Networks Foundations - Feedforward Neural Networks
Master the fundamentals of feedforward neural networks, exploring their architecture, functionality, and implementation principles for building effective machine learning models.
Faster and Cheaper LLMs with Weight and Key-value Cache Quantization
Explore advanced techniques for optimizing Large Language Models through weight and key-value cache quantization methods to improve speed and reduce computational costs.
Transformer Types and Practical Considerations
Explore different transformer architectures and key implementation factors for building effective natural language processing models and applications.
Retrieval Augmented Generation (RAG) - Advances in Generative AI
Dive into retrieval augmented generation (RAG) to enhance AI systems with external knowledge retrieval, improving accuracy and context awareness in generative AI applications.
Pretraining and Finetuning in Machine Learning
Dive into the fundamental concepts of pretraining and finetuning in machine learning, exploring key techniques and applications for model optimization.
Multilingual Large Language Models - Advances in Generative AI
Explore the latest developments in multilingual large language models, their capabilities, challenges, and future potential in the evolving landscape of generative AI.
Introduction to Machine Translation with Sequence-to-Sequence Models
Master sequence-to-sequence modeling fundamentals and applications in machine translation, focusing on neural network architectures and practical implementation techniques.
Language Modeling - Fundamentals and Applications
Master the fundamentals of language modeling, exploring statistical and neural approaches, probability distributions, and practical applications in natural language processing.
Neural Classification with Word Embeddings - PyTorch Tutorial
Master neural classification techniques and word embeddings implementation in PyTorch through hands-on practice with essential deep learning concepts and practical applications.