Generative AI Models Through the Lens of Dense Associative Memory
Explore Dense Associative Memories and their relationship to transformers and diffusion models. Gain insights into energy-based modeling and the memorization-generalization transition in AI.
Emergence and Grokking in Simple Neural Architectures
Dive into emergence and grokking in simple neural architectures. Explore MLPs' remarkable behaviors, feature-learning kernel machines, and their implications for understanding modern deep learning phenomena.
Scaling Insights from Infinite-Width Theory for Next Generation Architectures and Learning Paradigms
Explore scaling insights from infinite-width theory for advanced architectures and learning paradigms. Gain understanding of optimal scaling rules across various models and their impact on training stability and generalization.
How Neural Networks Learn Features from Data
Uncover the mechanism behind neural networks' feature learning through the average gradient outer product (AGOP). Explore its applications in various architectures and its role in developing interpretable models for scientific use.
Dynamics of Brain's Deep Network
Uncover insights into brain's deep network processing of visual information, exploring biophysical principles and emergent theories through cutting-edge neurotechnology and experimental observations.
Using Generative AI to Better Understand B2B Audiences: From Topic Modeling to Text Classification
Unlock the potential of Generative AI and ML for B2B audience understanding. Explore innovative techniques in topic modeling and text classification using LLMs to enhance marketing strategies and data-driven decision-making.
Gender Bias in Machine Learning
Explore gender bias in machine learning with Shalvi Mahajan. Uncover AI's role in amplifying biases, real-world challenges, and evolving techniques to address them in product design and services across genders.
Neural Networks Meet Nonparametric Regression: Generalization by Weight Decay and Large Learning Rates
Explore the intersection of deep neural networks and nonparametric regression, uncovering insights on overparameterization, representation learning, and adaptive generalization in machine learning.
Generalization in Robotic Behavior Cloning: Pitfalls and Promises
Explore challenges and solutions in robotic behavior cloning, focusing on generalization in continuous state/action spaces. Gain insights into frameworks enabling agents to imitate complex behaviors with provable guarantees.
Know When You Know: Handling Adversarial Data by Abstaining
Explore sequential prediction in stochastic settings with adversarial interference. Learn strategies for handling distribution shifts and making confident predictions while abstaining from uncertain cases.
Human and Machine Inductive Biases for Compositional Linguistic Generalization
Explore compositional linguistic generalization in humans and artificial neural networks. Compare model results with human patterns, highlighting challenges and opportunities in structural generalization research.
Adaptive Generalization: The Role of Dynamic Evaluation in Low-Resource Settings
Explore adaptive generalization techniques and dynamic evaluation strategies for enhancing AI performance in low-resource environments.
Toward Understanding In-Context Learning
Dive into the mechanisms of in-context learning in large language models, exploring theoretical explanations and simplified data distributions with Stanford's Tengyu Ma.
Large Language Models and Transformers: Perspectives from Physics, Neuroscience, and Theory
Explore perspectives on large language models and transformers from physics, neuroscience, and theory with Stanford's Surya Ganguli in this insightful Simons Institute lecture.
Introduction to Transformers
Dive into the fundamentals of Transformers, exploring their architecture and applications in large language models with expert insights from Columbia University.
The Enigma of LLMs: Creativity, Compositionality, Pluralism, and Paradoxes
Explore the complexities of large language models, delving into creativity, compositionality, pluralism, and paradoxes. Gain insights into the ongoing research challenges and the importance of developing a comprehensive "Science of LLMs".
Create, Share, and Explore Community-Made AI Apps with Glif
Dive into Glif, an innovative AI art platform. Create, share, and remix user-generated models for unique AI art. Explore features like Murano Glass, 80s TV, and AI-powered roasts. Join a community of creators and unleash your artistic potential.
LLM Safety, Alignment, and Generalization
Explore the challenges and importance of LLM safety, alignment, and generalization as capabilities rapidly improve across various domains.
How Well Does Diffusion Model Generate? Exploring Generalization in Emerging Settings
Explore the capabilities and limitations of diffusion models in generative tasks, focusing on emerging generalization settings and their implications.
Generalization in Diffusion Models Arises from Geometry-Adaptive Harmonic Representations
Uncover the geometric foundations of diffusion models' generalization capabilities through adaptive harmonic representations in this insightful exploration.
Robust Generalization in the Era of LLMs - Jailbreaking Attacks and Defenses
Explore jailbreaking attacks on LLMs, their vulnerabilities, and defense strategies. Gain insights into robust generalization and evaluation methods for production language models.