Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#Transformer Architecture

Showing: 57 courses
Stanford University

Stanford Seminar - Decision Transformer: Reinforcement Learning via Sequence Modeling

0 rewiews
Innovative approach to reinforcement learning using sequence modeling and Transformer architecture, offering simplicity and scalability while matching or exceeding state-of-the-art performance in various tasks.
Add to list
1 Lesons
1 hour 21 minutes
On-Demand
Free-Video
Stanford University

Shaping the Future of AI from the History of Transformer Architectures - Stanford CS25

0 rewiews
Explore the evolution of Transformer architectures and AI development with OpenAI researcher Hyung Won Chung, focusing on historical motivations and future projections in the field.
Add to list
1 Lesons
37 minutes
On-Demand
Free-Video
Stanford University

Intuitions on Language Models and Shaping AI's Future - Stanford CS25 Lecture

0 rewiews
Explore intuitions on language models and the evolution of Transformer architectures with OpenAI researchers. Gain insights into next-word prediction, scaling laws, and the future of AI development.
Add to list
1 Lesons
1 hour 17 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLMOPS: Training a Small LLM (GPT-2) - Machine Learning and Data Science

0 rewiews
Explore training a small LLM (GPT2) locally, understanding challenges and limitations of LLM development for individuals and small teams.
Add to list
1 Lesons
53 minutes
On-Demand
Free-Video
Anyscale

How Datadog is Transforming Time Series Forecasting with Toto

0 rewiews
Discover how Toto, a Time Series-Optimized Transformer, revolutionizes forecasting through advanced architecture and trillion-point training data, enabling precise zero-shot predictions for observability metrics.
Add to list
1 Lesons
13 minutes
On-Demand
Free-Video
DataLearning@ICL

Autoregressive Long-Context Music Generation with Perceiver AR

0 rewiews
Explore autoregressive long-context music generation using Perceiver AR, presented by DeepMind's Cătălina Cangea. Gain insights into cutting-edge AI techniques for creating music.
Add to list
1 Lesons
1 hour
On-Demand
Free-Video
Discover AI

Supercharging Multi-LLM Intelligence with CALM - Composition to Augment Language Models

0 rewiews
Discover how CALM (Composition to Augment Language Models) revolutionizes multi-LLM integration through advanced projection layers and cross-attention mechanisms for enhanced AI capabilities.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
Discover AI

StreamingLLM: Enabling Infinite Sequence Length in Large Language Models

0 rewiews
Dive into StreamingLLM's framework for extending LLM attention windows to handle infinite sequences, featuring practical implementation insights and code analysis.
Add to list
1 Lesons
38 minutes
On-Demand
Free-Video
Discover AI

Mamba AI: Understanding Selective State Space Models as Transformer Alternatives

0 rewiews
Explore the groundbreaking MAMBA architecture and its potential to revolutionize AI through selective state space models, offering a compelling alternative to traditional transformers.
Add to list
1 Lesons
46 minutes
On-Demand
Free-Video
Discover AI

Reversible Transformer - GPU Memory Optimization Using ReFORMER and Reversible Residual Layers

0 rewiews
Delve into GPU memory optimization techniques for transformers, exploring reversible residual layers and locality-sensitive hashing to enhance deep neural network efficiency and performance.
Add to list
1 Lesons
18 minutes
On-Demand
Free-Video
Data Science Courses

Deep Learning: RLHF, ChatGPT, and Alignment in LLMs - Lecture 14

0 rewiews
Dive into advanced concepts of RLHF, ChatGPT training, and LLM alignment, exploring efficient transformers and the technical foundations behind modern language models.
Add to list
1 Lesons
1 hour 14 minutes
On-Demand
Free-Video
TensorFlow

Transfer Learning and Transformer Models

0 rewiews
Explore natural language processing's evolution, focusing on Transformer architecture, language modeling, and BERT's impact on transfer learning in this comprehensive tech talk.
Add to list
5 Lesons
45 minutes
On-Demand
Free-Video
Andrej Karpathy

Let's Build GPT - From Scratch, in Code, Spelled Out

0 rewiews
Comprehensive tutorial on building a GPT model from scratch, covering key concepts like self-attention, multi-headed attention, and transformer architecture. Includes practical coding examples and insights into modern language models.
Add to list
32 Lesons
1 hour 56 minutes
On-Demand
Free-Video
Yannic Kilcher

TransGAN - Two Transformers Can Make One Strong GAN - Machine Learning Research Paper Explained

0 rewiews
Explore TransGAN, a novel approach using transformers for image generation. Learn about its architecture, key techniques, and competitive performance in various datasets.
Add to list
11 Lesons
30 minutes
On-Demand
Free-Video
Yannic Kilcher

Perceiver - General Perception with Iterative Attention

0 rewiews
Explore DeepMind's Perceiver model, a versatile architecture that processes diverse input modalities using iterative attention, solving the quadratic bottleneck problem in Transformers.
Add to list
8 Lesons
30 minutes
On-Demand
Free-Video
Keith Galli

Complete Natural Language Processing Tutorial in Python

0 rewiews
Comprehensive Python tutorial covering NLP fundamentals, techniques, and state-of-the-art models. Includes practical examples using popular libraries and hands-on implementation of advanced concepts.
Add to list
21 Lesons
1 hour 38 minutes
On-Demand
Free-Video
Prodramp

Prompt Engineering - Understanding Large Language Models with ChatGPT

0 rewiews
Explore large language models and ChatGPT through prompt engineering. Learn about transformer architecture, text embedding, self-attention, and key deep learning methods with practical Python examples.
Add to list
17 Lesons
36 minutes
On-Demand
Free-Video
Graham Neubig

Neural Nets for NLP 2021 - Attention

0 rewiews
Explore attention mechanisms in neural networks for NLP, covering key concepts, improvements, and specialized varieties with practical examples and applications.
Add to list
18 Lesons
38 minutes
On-Demand
Free-Video
Prodramp

Text to Image Generation Using ruDALL-E Open Source Model

0 rewiews
Explore ruDALL-E, an open-source text-to-image model based on DALL-E. Learn about its architecture, models, and try it out in Google Colab for generating images from text descriptions.
Add to list
16 Lesons
24 minutes
On-Demand
Free-Video
The Full Stack

LLM Foundations - LLM Bootcamp

0 rewiews
Explore foundational concepts of large language models, including machine learning basics, Transformer architecture, and notable LLMs. Gain insights into pretraining datasets and instruction tuning.
Add to list
19 Lesons
48 minutes
On-Demand
Free-Video
Yannic Kilcher

Decision Transformer - Reinforcement Learning via Sequence Modeling

0 rewiews
Explore how Decision Transformer reframes offline reinforcement learning as sequence modeling, leveraging Transformer architecture to generate optimal actions based on desired returns, past states, and actions.
Add to list
13 Lesons
57 minutes
On-Demand
Free-Video
Alfredo Canziani

Self - Cross, Hard - Soft Attention and the Transformer

0 rewiews
Explore attention mechanisms and Transformer architecture, covering self/cross and hard/soft attention, key-value stores, and practical implementation in PyTorch for advanced deep learning applications.
Add to list
16 Lesons
1 hour 12 minutes
On-Demand
Free-Video
Alfredo Canziani

Attention and the Transformer

0 rewiews
Explore self-attention, key-value stores, and transformer architecture in deep learning. Learn to implement attention mechanisms and understand encoder-decoder paradigms for advanced neural network design.
Add to list
5 Lesons
1 hour 18 minutes
On-Demand
Free-Video
CodeEmporium

Deep Dive into the Transformer Encoder Architecture

0 rewiews
Detailed exploration of transformer encoder architecture, covering embeddings, positional encodings, self-attention mechanisms, and key components for effective natural language processing.
Add to list
16 Lesons
21 minutes
On-Demand
Free-Video
The Royal Institution

The Future of Generative AI - Possibilities and Challenges

0 rewiews
Explore the future of generative AI with Professor Michael Wooldridge, covering its capabilities, challenges, and potential impact on society. Gain insights into machine learning, neural networks, and the evolution of AI technology.
Add to list
18 Lesons
1 hour 1 minute
On-Demand
Free-Video
Software Engineering Courses - SE Courses

PixArt-α: Open Source Text-to-Image Model - Installation and Usage Tutorial

0 rewiews
Explore PixArt-α, an open-source text-to-image model rivaling Midjourney. Learn installation, usage, and comparison with other models. Discover its superior capabilities in various art styles and prompt following.
Add to list
30 Lesons
30 minutes
On-Demand
Free-Video
Oracle

First Principles of OCI Generative AI Service - Architecture and Implementation

0 rewiews
Explore OCI Generative AI Service's mechanics, including flexible LLM fine-tuning and improved GPU cluster management for simplified, cost-effective AI application integration.
Add to list
18 Lesons
19 minutes
On-Demand
Free-Video
GOTO Conferences

Inside GPT - Large Language Models Demystified

0 rewiews
Demystifying GPT algorithms: architecture, inner workings, and practical applications. Explore NLP fundamentals, train models, and learn to leverage ChatGPT and GPT4 for innovative solutions.
Add to list
15 Lesons
47 minutes
On-Demand
Free-Video
Wolfram

What Is ChatGPT Doing and Why Does It Work?

0 rewiews
Explore the inner workings and underlying principles of ChatGPT, delving into its functionality and effectiveness in natural language processing and generation.
Add to list
1 Lesons
5 hours 12 minutes
On-Demand
Free-Video
Wolfram

Accelerating Simulations of Particle Systems Using Machine Learning

0 rewiews
Explore machine learning techniques for accelerating particle system simulations using transformer-based architectures and Mathematica.
Add to list
9 Lesons
29 minutes
On-Demand
Free-Video
EuroPython Conference

Unfolding the Paper Windmills

0 rewiews
Demystify academic papers, understand Transformer architecture, and explore JAX ecosystem through hands-on implementation of "Attention is all you need" paper.
Add to list
1 Lesons
27 minutes
On-Demand
Free-Video
MIT HAN Lab

StreamingLLM: Deploying Language Models for Streaming Applications with Long Text Sequences

0 rewiews
Explore innovative techniques for deploying LLMs in streaming applications, focusing on the "attention sink" phenomenon and efficient KV cache management.
Add to list
1 Lesons
14 minutes
On-Demand
Free-Video
Google Cloud Tech

Introduction to Generative AI

0 rewiews
Explore the fundamentals of Generative AI, its applications, model types, and usage principles in this concise overview.
Add to list
1 Lesons
22 minutes
On-Demand
Free-Video
Jeff Heaton

Generative AI Overview - Foundations, Models, and Applications

0 rewiews
Explore foundational concepts of Generative AI, its evolution, and key models like DALL·E and GPT. Learn how these technologies reshape creativity and innovation across various industries.
Add to list
1 Lesons
11 minutes
On-Demand
Free-Video
CodeEmporium

Generative AI, ChatGPT, and LLMs - Buzzwords Explained

0 rewiews
Clarifies key AI terms: genAI, ChatGPT, and LLMs. Demystifies buzzwords, explaining differences and relationships between these concepts in artificial intelligence.
Add to list
1 Lesons
18 minutes
On-Demand
Free-Video
CodeEmporium

Generative AI - Explained

0 rewiews
Explore generative AI's unique features and how it differs from other AI buzzwords in this concise, informative video.
Add to list
1 Lesons
14 minutes
On-Demand
Free-Video
Yannic Kilcher

BERTology Meets Biology - Interpreting Attention in Protein Language Models

0 rewiews
Explores how BERT models trained on protein sequences learn biological properties, revealing insights into protein structure, binding sites, and biophysical characteristics through attention mechanism analysis.
Add to list
10 Lesons
37 minutes
On-Demand
Free-Video
Unify

LoRA Explained - Efficient Fine-Tuning of Large Language Models

0 rewiews
Explore LoRA, a technique for efficient fine-tuning of large language models. Learn about its low-rank matrix decompositions and reduced trainable parameters for task-specific adaptations.
Add to list
1 Lesons
30 minutes
On-Demand
Free-Video
Jay Alammar

The Narrated Transformer Language Model

0 rewiews
Visual introduction to the Transformer architecture, explaining its components and applications in AI/ML. Accessible to various experience levels, covering tokenization, embedding, and output projection.
Add to list
9 Lesons
30 minutes
On-Demand
Free-Video
NDC Conferences

Lost and Found in Translation - An Intro to ML Assisted Decompilation and Deobfuscation

0 rewiews
Explore ML-assisted decompilation and deobfuscation, covering large language models, neural machine translation, and their applications in reverse engineering and security auditing.
Add to list
25 Lesons
54 minutes
On-Demand
Free-Video
tinyML

Memory Optimization Techniques for On-Device Large Language Models

0 rewiews
Discover advanced memory optimization techniques for deploying large language models on devices with limited resources, focusing on key-value caching and dynamic compression methods.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
Data Science Conference

Multi-Task Learning in Transformer-Based Architectures for Natural Language Processing

0 rewiews
Explore multi-task learning in transformers, covering adapter techniques, hypernetworks, and efficient solutions for training multiple NLP tasks with shared architectures and reduced computational costs.
Add to list
18 Lesons
31 minutes
On-Demand
Free-Video
OpenSource Connections

Unbiased Neural Ranking Model for Product Search

0 rewiews
Explore an unbiased neural ranking model for product search, leveraging implicit customer feedback and addressing position bias to improve e-commerce search results.
Add to list
1 Lesons
41 minutes
On-Demand
Free-Video
Unify

The Era of 1-bit LLMs Explained - BitNet b1.58 and New Scaling Laws

0 rewiews
Explore groundbreaking research on BitNet b1.58, a ternary parameter model matching full-precision Transformers while offering improved cost-effectiveness and defining new LLM scaling laws.
Add to list
1 Lesons
58 minutes
On-Demand
Free-Video
Center for Language & Speech Processing(CLSP), JHU

Foundation Models and the Transfer of Embodied Autonomy

0 rewiews
Explore challenges in developing foundation models for sequential decision-making, including transfer learning, and discuss future research directions in embodied autonomy.
Add to list
1 Lesons
41 minutes
On-Demand
Free-Video
NashKnolX

How to Finetune and Develop Your Own Large Language Model

0 rewiews
Explore techniques for fine-tuning and developing custom large language models, enhancing your AI capabilities and understanding of advanced NLP concepts.
Add to list
1 Lesons
54 minutes
On-Demand
Free-Video
NHR@FAU

Towards Robust and Efficient AI at Scale

0 rewiews
Explore robust, efficient AI for scientific time series forecasting. Learn scalable transformer architectures, energy optimization, and balancing performance with sustainability in large-scale AI applications.
Add to list
27 Lesons
51 minutes
On-Demand
Free-Video
USC Probability and Statistics Seminar

Foundations for Feature Learning via Gradient Descent

0 rewiews
Explore the theoretical foundations of feature learning in modern machine learning models, focusing on gradient descent's role in extracting useful features and representations from data.
Add to list
1 Lesons
49 minutes
On-Demand
Free-Video
Trelis Research

Very Few Parameter Fine-Tuning with ReFT and LoRA

0 rewiews
Explore advanced fine-tuning techniques ReFT and LoRA for efficient parameter optimization in transformer models. Learn implementation, comparison, and practical tips for improved model performance.
Add to list
13 Lesons
55 minutes
On-Demand
Free-Video
Neuro Symbolic

Introduction to Language Models - LLMs, Prompt Engineering, and Architectures

0 rewiews
Explore language models, covering generative AI, LLMs, encoders, prompt engineering, and transformer architecture. Gain insights into embeddings, attention mechanisms, and model limitations.
Add to list
8 Lesons
58 minutes
On-Demand
Free-Video
MIT HAN Lab

Vision Transformer - Lecture 16

0 rewiews
Dive into Vision Transformers architecture and implementation, exploring their role in computer vision tasks through expert insights and practical applications in machine learning.
Add to list
1 Lesons
1 hour 2 minutes
On-Demand
Free-Video
MIT HAN Lab

Vision Transformer - Lecture 14

0 rewiews
Explore Vision Transformers in deep learning, covering architecture, training, and applications. Gain insights into this powerful model for computer vision tasks.
Add to list
1 Lesons
1 hour 14 minutes
On-Demand
Free-Video
Neurosymbolic Programming for Science

Programming with Neural Surrogates of Programs

0 rewiews
Explore neural surrogates for program optimization, including case studies on CPU simulators and techniques like the Renamer and Turaco for constructing efficient program surrogates.
Add to list
1 Lesons
1 hour 6 minutes
On-Demand
Free-Video
VinAI

Generative Sequence Models for Sequential Decision Making

0 rewiews
Explore generative sequence models for decision-making under uncertainty. Learn how Transformer architecture and language modeling advances can enhance offline learning, online exploration, and multi-task generalization in AI.
Add to list
1 Lesons
1 hour 10 minutes
On-Demand
Free-Video
Conf42

Reducing Hallucinations in Conversational Systems

0 rewiews
Discover effective strategies for minimizing AI hallucinations through prompt engineering techniques, ethical considerations, and bias mitigation in large language models.
Add to list
8 Lesons
15 minutes
On-Demand
Free-Video
Discover AI

NVIDIA HYMBA: A Hybrid-Head Architecture for Small Language Models with MetaTokens

0 rewiews
Explore NVIDIA's Hymba hybrid architecture combining transformer attention and state-space models, featuring innovative meta tokens and memory optimizations for enhanced language model performance and efficiency.
Add to list
10 Lesons
32 minutes
On-Demand
Free-Video
AI Bites

Mixture of Transformers for Multi-modal Foundation Models

0 rewiews
Explore Meta's Mixture-of-Transformers (MoT) architecture, a revolutionary approach to handling multi-modal AI tasks combining text, speech, images, and videos with enhanced efficiency and performance.
Add to list
7 Lesons
16 minutes
On-Demand
Free-Video