Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#Self-Attention

Showing: 44 courses
Open Data Science

Vision Transformer and Its Applications

1 rewiews
Explore vision transformers' architecture, self-attention in computer vision, and applications in recognition, segmentation, and multi-modal learning. Discover their potential for general-purpose model architectures.
Add to list
25 Lesons
35 minutes
On-Demand
Free-Video
University of Central Florida

Rethinking and Improving Relative Position Encoding for Vision Transformer - Lecture 23

0 rewiews
Explore vision transformer improvements through relative position encoding, examining bias modes, piecewise indexing, and 2D calculations for enhanced performance in image processing tasks.
Add to list
18 Lesons
32 minutes
On-Demand
Free-Video
Simons Institute

The Emergence of Clusters in Self-Attention Dynamics

0 rewiews
Explore the formation of clusters in self-attention dynamics, examining their impact on transformer models and computational processes.
Add to list
1 Lesons
49 minutes
On-Demand
Free-Video
Simons Institute

Transformers, Parallel Computation, and Logarithmic Depth

0 rewiews
Explore the computational power of transformers, their connection to parallel processing, and efficiency in solving complex tasks with logarithmic depth.
Add to list
1 Lesons
57 minutes
On-Demand
Free-Video
Simons Institute

Introduction to Transformers

0 rewiews
Dive into the fundamentals of Transformers, exploring their architecture and applications in large language models with expert insights from Columbia University.
Add to list
1 Lesons
1 hour 10 minutes
On-Demand
Free-Video
Institute for Advanced Study

Emergent Linguistic Structure in Deep Contextual Neural Word Representations - Chris Manning

0 rewiews
Explore emergent linguistic structures in deep neural word representations with Stanford's Chris Manning, examining language models, attention mechanisms, and vector space analysis.
Add to list
10 Lesons
43 minutes
On-Demand
Free-Video
Simons Institute

How Do Transformers Work? - A Deep Dive into Neural Network Architecture

0 rewiews
Dive into the fundamental mechanics and architecture of transformer models, exploring their key components and operational principles through expert insights from MIT's research.
Add to list
1 Lesons
1 hour 16 minutes
On-Demand
Free-Video
Discover AI

RoPE: Rotary Position Embedding for Extended Context Lengths in Transformers

0 rewiews
Dive into Rotary Position Embedding (RoPE) and learn how this innovative technique enhances transformer models by enabling extended context lengths up to 100K tokens.
Add to list
1 Lesons
40 minutes
On-Demand
Free-Video
Discover AI

Self-Extending LLM Context Windows Using Grouped Self-Attention

0 rewiews
Discover how to extend LLM context windows through grouped self-attention, enabling longer text processing without model retraining. Learn implementation techniques and practical applications.
Add to list
10 Lesons
26 minutes
On-Demand
Free-Video
Data Science Conference

Seeing Through the Lens of Transformers - A New Era in Computer Vision

0 rewiews
Explore the revolutionary impact of transformer architecture in computer vision, from its origins in language processing to groundbreaking applications in visual tasks and self-attention mechanisms.
Add to list
1 Lesons
33 minutes
On-Demand
Free-Video
UofU Data Science

Pairwise Feature Importance and Effective Attention in Self-Attention Networks

0 rewiews
Dive into advanced concepts of attention mechanisms, exploring effective attention computation, norm-based analysis, and practical applications in neural networks.
Add to list
5 Lesons
36 minutes
On-Demand
Free-Video
Data Science Courses

Attention Mechanism and Self-Attention in Deep Learning - Lecture 9

0 rewiews
Dive into attention mechanisms and self-attention concepts in deep learning, exploring their revolutionary impact on NLP and discovering practical applications in sequence models.
Add to list
1 Lesons
1 hour 18 minutes
On-Demand
Free-Video
Valerio Velardo - The Sound of AI

Transformers Explained - Part 1: Generative Music AI

0 rewiews
Comprehensive exploration of transformer architectures in AI, covering intuition, theory, and mathematical formalization, with focus on their application in music and audio processing.
Add to list
25 Lesons
1 hour 13 minutes
On-Demand
Free-Video
AutoML Seminars

Discovering Black-Box Optimizers via Evolutionary Meta-Learning

0 rewiews
Delve into evolutionary meta-learning techniques for discovering black-box optimizers, exploring advanced concepts in evolution strategies and genetic algorithms through self-attention architectures.
Add to list
26 Lesons
50 minutes
On-Demand
Free-Video
Edan Meyer

Recreate Google Translate - Model Training

0 rewiews
Explore model training and testing for Neural Machine Translation, recreating Google Translate using mT5 and Hugging Face. Practical implementation and demo of multilingual translations.
Add to list
6 Lesons
21 minutes
On-Demand
Free-Video
Andrej Karpathy

Let's Build GPT - From Scratch, in Code, Spelled Out

0 rewiews
Comprehensive tutorial on building a GPT model from scratch, covering key concepts like self-attention, multi-headed attention, and transformer architecture. Includes practical coding examples and insights into modern language models.
Add to list
32 Lesons
1 hour 56 minutes
On-Demand
Free-Video
Yannic Kilcher

TransGAN - Two Transformers Can Make One Strong GAN - Machine Learning Research Paper Explained

0 rewiews
Explore TransGAN, a novel approach using transformers for image generation. Learn about its architecture, key techniques, and competitive performance in various datasets.
Add to list
11 Lesons
30 minutes
On-Demand
Free-Video
Yannic Kilcher

Nyströmformer- A Nyström-Based Algorithm for Approximating Self-Attention

0 rewiews
Explore Nyströmformer, a novel algorithm for approximating self-attention in Transformers with linear complexity, enabling processing of longer sequences and improving scalability in natural language tasks.
Add to list
12 Lesons
48 minutes
On-Demand
Free-Video
Prodramp

Prompt Engineering - Understanding Large Language Models with ChatGPT

0 rewiews
Explore large language models and ChatGPT through prompt engineering. Learn about transformer architecture, text embedding, self-attention, and key deep learning methods with practical Python examples.
Add to list
17 Lesons
36 minutes
On-Demand
Free-Video
Graham Neubig

Neural Nets for NLP 2017 - Attention

0 rewiews
Comprehensive exploration of attention mechanisms in neural networks for NLP, covering various types, improvements, and applications, with a focus on the Transformer model.
Add to list
22 Lesons
1 hour 3 minutes
On-Demand
Free-Video
Graham Neubig

CMU Multilingual NLP - Machine Translation-Sequence-to-Sequence Models

0 rewiews
Explore conditional language modeling, sequence-to-sequence models, generation methods, attention mechanisms, and transformers in multilingual natural language processing.
Add to list
26 Lesons
44 minutes
On-Demand
Free-Video
Graham Neubig

Neural Nets for NLP 2020 - Document Level Models

0 rewiews
Explore document-level NLP techniques including language modeling, coreference resolution, and discourse parsing. Learn advanced approaches for handling long-range dependencies and entity relationships in text.
Add to list
21 Lesons
52 minutes
On-Demand
Free-Video
Graham Neubig

Neural Nets for NLP 2021 - Document-Level Models

0 rewiews
Explores advanced NLP techniques for document-level tasks, including long-document modeling, entity coreference, and discourse parsing, with a focus on neural network approaches and their applications.
Add to list
23 Lesons
40 minutes
On-Demand
Free-Video
CodeEmporium

Transformers - From Zero to Hero

0 rewiews
Comprehensive deep dive into transformer architecture, covering key concepts from self-attention to tokenization. Includes hands-on coding for both encoder and decoder implementations.
Add to list
11 Lesons
3 hours 35 minutes
On-Demand
Free-Video
StatQuest with Josh Starmer

Transformer Neural Networks, ChatGPT's Foundation, Clearly Explained

0 rewiews
Clear explanation of Transformer Neural Networks, the foundation of ChatGPT and modern AI. Covers key concepts like word embedding, self-attention, and encoder-decoder architecture.
Add to list
13 Lesons
36 minutes
On-Demand
Free-Video
CodeEmporium

Deep Dive into the Transformer Encoder Architecture

0 rewiews
Detailed exploration of transformer encoder architecture, covering embeddings, positional encodings, self-attention mechanisms, and key components for effective natural language processing.
Add to list
16 Lesons
21 minutes
On-Demand
Free-Video
tinyML

On-Device Speech Models Optimization and Deployment for Mobile Hardware

0 rewiews
Explore on-device speech model optimization and deployment, covering streaming-aware design, quantization techniques, and benchmarks for popular speech processing model topologies on mobile platforms.
Add to list
15 Lesons
26 minutes
On-Demand
Free-Video
Wolfram

Accelerating Simulations of Particle Systems Using Machine Learning

0 rewiews
Explore machine learning techniques for accelerating particle system simulations using transformer-based architectures and Mathematica.
Add to list
9 Lesons
29 minutes
On-Demand
Free-Video
Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC)

Deep Learning Applied to the Analysis of Dissolved Carbon Dioxide in Coastal Areas of the Balearic Islands

0 rewiews
Explore deep learning techniques for analyzing dissolved CO2 in Balearic coastal areas, covering self-attention, permutation convolution, and symbolic regression.
Add to list
7 Lesons
22 minutes
On-Demand
Free-Video
CodeEmporium

Informer Encoder Architecture Explained

0 rewiews
Explore the Informer Encoder architecture, its key components, and implementation details for advanced time series forecasting and sequence modeling tasks.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
Meta

New Approaches to Image and Video Reconstruction Using Deep Learning

0 rewiews
Explore cutting-edge deep learning techniques for image and video enhancement, including colorization and resolution improvement, using efficient PyTorch-based tools trainable on a single GPU.
Add to list
26 Lesons
46 minutes
On-Demand
Free-Video
Computational Genomics Summer Institute CGSI

Large Language Models for Computational Biology - A Primer

0 rewiews
Explore large language models in computational biology, covering transformers, pretraining, and applications in genomics and single-cell analysis.
Add to list
24 Lesons
49 minutes
On-Demand
Free-Video
Data Centric

LLMs and Transformers Demystified: Introduction to AI Engineering - Lecture 1

0 rewiews
Demystify transformers and LLMs through intuitive weather analogies. Explore the architecture's impact on AI, from 'Attention is All You Need' to modern applications like ChatGPT.
Add to list
9 Lesons
52 minutes
On-Demand
Free-Video
CodeEmporium

Informer Architecture Explained - Complete Guide

0 rewiews
Comprehensive exploration of Informer encoder architecture, detailing its components and implementation for advanced time series forecasting and sequence modeling tasks.
Add to list
1 Lesons
38 minutes
On-Demand
Free-Video
CodeEmporium

Informer: Complete Code from Scratch - Time Series Transformer Analysis

0 rewiews
Line-by-line exploration of the time series transformer, focusing on implementation details and code structure for deep learning enthusiasts and practitioners.
Add to list
1 Lesons
1 hour 27 minutes
On-Demand
Free-Video
Code With Aarohi

Vision Transformers (ViTs) - A Beginner's Guide to Image Processing with Transformers

0 rewiews
Dive into Vision Transformers (ViTs), exploring core concepts like linear projection, multihead attention layers, and patch embedding in a beginner-friendly, comprehensive walkthrough.
Add to list
1 Lesons
1 hour 12 minutes
On-Demand
Free-Video
MIT HAN Lab

Transformer and Large Language Models - Part I - Lecture 12

0 rewiews
Explore Transformer architecture and Large Language Models in this comprehensive MIT lecture, covering key concepts and recent advancements in AI.
Add to list
1 Lesons
1 hour 20 minutes
On-Demand
Free-Video
MIT HAN Lab

Transformer and Large Language Models - Part I - Lecture 12

0 rewiews
Explore Transformer architecture and Large Language Models in this comprehensive MIT lecture, covering key concepts and recent advancements in AI.
Add to list
1 Lesons
1 hour 18 minutes
On-Demand
Free-Video
MIT HAN Lab

Transformer and Large Language Models - Part II - Lecture 13

0 rewiews
Explore advanced concepts of Transformers and Large Language Models in this in-depth lecture from MIT's EfficientML course.
Add to list
1 Lesons
1 hour 17 minutes
On-Demand
Free-Video
MIT HAN Lab

Transformer and Large Language Models - Part II - Lecture 13

0 rewiews
Explore advanced concepts of Transformers and Large Language Models, focusing on efficiency and optimization techniques in AI and machine learning.
Add to list
1 Lesons
1 hour 17 minutes
On-Demand
Free-Video
MIT HAN Lab

Vision Transformer - Lecture 14

0 rewiews
Explore Vision Transformers in deep learning, covering architecture, training, and applications. Gain insights into this powerful model for computer vision tasks.
Add to list
1 Lesons
1 hour 14 minutes
On-Demand
Free-Video
MIT HAN Lab

Vision Transformer - Lecture 14

0 rewiews
Explore Vision Transformers in deep learning, covering architecture, training, and applications. Gain insights into this powerful model for computer vision tasks.
Add to list
1 Lesons
1 hour 14 minutes
On-Demand
Free-Video
ChemicalQDevice

LLM Explainability and Controllability Improvements with Tensor Networks

0 rewiews
Explore how Tensor Networks enhance explainability and controllability of Large Language Models, focusing on transformer self-attention and multi-layer perceptron layer modifications.
Add to list
1 Lesons
1 hour
On-Demand
Free-Video
Simons Institute

How Transformers Learn Causal Structure with Gradient Descent

0 rewiews
Delve into the mathematical foundations of how transformer models learn and encode causal relationships through self-attention mechanisms and gradient-based training algorithms.
Add to list
1 Lesons
38 minutes
On-Demand
Free-Video