Region Mutual Information Loss for Semantic Segmentation
Explore advanced techniques in semantic segmentation, including region mutual information loss, à trous convolutions, and multi-scale features for improved image analysis and understanding.
Action Recognition, Temporal Localization and Detection in Videos
Explore action recognition, temporal localization, and detection in videos. Learn about knowledge transfer, 3D adaptations of object detection, and video segmentation techniques.
Approximation Theory of Deep Learning from the Dynamical Viewpoint
Explore deep learning approximation theory from a dynamical perspective, covering supervised learning, universal approximation, sequence modeling, and insights on various neural network architectures.
Predicting Single-Cell Perturbation Responses for Unseen Drugs
Explore single-cell perturbation response prediction for novel drugs using an encoder-decoder architecture and transfer learning, enhancing drug discovery efficiency through in-silico hypothesis generation.
Fine-tuning Flan-T5 LLM with HuggingFace Accelerate - Tutorial
Learn how to fine-tune Flan-T5 LLM using HuggingFace Accelerate for multi-GPU environments, with step-by-step guidance on preprocessing and implementation for specific downstream tasks.
Deep Learning: Transformers and Encoder-Decoder Architecture - Lecture 10
Dive into transformer architectures, exploring encoder-decoder mechanisms and positional embeddings for advanced deep learning applications.
Introduction to Machine Translation with Sequence-to-Sequence Models
Master sequence-to-sequence modeling fundamentals and applications in machine translation, focusing on neural network architectures and practical implementation techniques.
Recurrent Neural Networks - Full Stack Deep Learning - Spring 2021
Explore Recurrent Neural Networks: architecture, challenges, solutions, and applications. Dive into LSTMs, bidirectionality, attention mechanisms, CTC loss, and non-recurrent sequence models like WaveNet.
Melody Generation with Transformers - Generative Music AI
Implement a transformer architecture in TensorFlow for end-to-end melody generation. Learn melody encoding, dataset preprocessing, model building, training, and inference techniques for AI-driven music creation.
Pytorch Transformers from Scratch - Attention Is All You Need
Implement Pytorch Transformers from scratch, exploring the "Attention is all you need" paper. Learn attention mechanisms, encoder-decoder architecture, and practical application.
Pytorch Seq2Seq Tutorial for Machine Translation
Comprehensive tutorial on building a Seq2Seq model for German-English machine translation, covering implementation, training, and evaluation using PyTorch and the Multi30k dataset.
Creating Image Captioning Models: Overview and Components
Learn to build deep learning image captioning models, exploring encoder-decoder architecture, training techniques, and evaluation methods for accurate visual descriptions.
Informer Encoder Architecture Explained
Explore the Informer Encoder architecture, its key components, and implementation details for advanced time series forecasting and sequence modeling tasks.
LLMs and Transformers Demystified: Introduction to AI Engineering - Lecture 1
Demystify transformers and LLMs through intuitive weather analogies. Explore the architecture's impact on AI, from 'Attention is All You Need' to modern applications like ChatGPT.
Transformers from Scratch - Part 2: Building and Training a Weather Prediction Model
Dive deep into advanced transformer concepts, exploring encoder-decoder architectures, GPT-4o, and positional embeddings. Apply knowledge to weather prediction and analyze model performance.
Informer Architecture Explained - Complete Guide
Comprehensive exploration of Informer encoder architecture, detailing its components and implementation for advanced time series forecasting and sequence modeling tasks.
Informer: Complete Code from Scratch - Time Series Transformer Analysis
Line-by-line exploration of the time series transformer, focusing on implementation details and code structure for deep learning enthusiasts and practitioners.
Transformer and Large Language Models - Part II - Lecture 13
Explore advanced concepts of Transformers and Large Language Models in this in-depth lecture from MIT's EfficientML course.
Tossing in the Dark: Practical Bit-Flipping on Gray-box Deep Neural Networks for Runtime Trojan Injection
Explore practical bit-flipping techniques for runtime Trojan injection in deep neural networks, focusing on gray-box scenarios and innovative approaches to bypass memory protection systems.