Главная
Study mode:
on
1
00:00:00 - Intro
2
00:01:56 - Hyperstack GPUs! sponsored
3
00:03:37 - Cartesia AI, real-time intelligence
4
00:09:45 - text-to-speech demo
5
00:12:05 - state space models SSMs
6
00:36:35 - bitter lessons transformers vs SSMs
7
00:38:30 - free lunch? what are the actual tradeoffs?
8
00:41:30 - Computing SSMs convolutionally
9
00:42:55 - What is the state RNNs, Attention, Conv, Neural ODEs
10
00:50:00 - Mamba 2, discrete vs continuous spectrum
11
00:55:30 - Q&A: scaling laws
Description:
Dive into a comprehensive video lecture on state space models featuring Albert Gu and Karan Goel from Cartesia AI. Explore the cutting-edge research in SSMs competing against transformer supremacy, including insights from the seminal S4 paper and the Mamba paper. Learn about real-time intelligence, text-to-speech demos, and the fundamental concepts of state space models. Examine the trade-offs between SSMs and transformers, understand how SSMs are computed convolutionally, and compare different state representations in machine learning models. Discover the latest developments in Mamba 2 and discuss scaling laws in AI. Gain valuable knowledge from these pioneering researchers in the field of state space models and their applications in artificial intelligence.

State Space Models: Advancements and Applications in AI - Featuring Albert Gu and Karan Goel

Aleksa Gordić - The AI Epiphany
Add to list
0:00 / 0:00