Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#Scaling Laws

Showing: 41 courses
Stanford University

Intuitions on Language Models and Shaping AI's Future - Stanford CS25 Lecture

0 rewiews
Explore intuitions on language models and the evolution of Transformer architectures with OpenAI researchers. Gain insights into next-word prediction, scaling laws, and the future of AI development.
Add to list
1 Lesons
1 hour 17 minutes
On-Demand
Free-Video
Santa Fe Institute

Modeling Computer Networks from Chips to the Internet

0 rewiews
Explore network modeling strategies for the Internet, from chip-level communication to global-scale simulations, examining scaling laws, biological concepts, and socio-economic factors shaping its future.
Add to list
23 Lesons
1 hour 12 minutes
On-Demand
Free-Video
Santa Fe Institute

How Does Size Shape Our Understanding of and Search for Life? Alien Crash Site with Chris Kempes

0 rewiews
Explore how size influences our understanding of life, from microscopic to cosmic scales, and its implications for the search for extraterrestrial life with mathematical biologist Chris Kempes.
Add to list
11 Lesons
49 minutes
On-Demand
Free-Video
Santa Fe Institute

The Laws of Life, Time and Chance

0 rewiews
Explore the intersection of physics and biology, uncovering mathematical frameworks for understanding life, time, and probability. Discover how chance governs cellular behavior and impacts complex biological phenomena.
Add to list
1 Lesons
48 minutes
On-Demand
Free-Video
Santa Fe Institute

Using Buckingham's Π Theorem for Dimensionless Similarity Parameters in Macroecology

0 rewiews
Explore dimensionless similarity parameters in macroecology using Buckingham's Π theorem, presented by Sandra Chapman from the University of Warwick.
Add to list
1 Lesons
1 hour 2 minutes
On-Demand
Free-Video
Santa Fe Institute

Geoffrey West on Scaling, Open-Ended Growth, and Accelerating Crisis/Innovation Cycles

0 rewiews
Geoffrey West explores scaling laws in cities, discussing how urban environments amplify human creativity and challenges, and examines the accelerating cycle of crisis and innovation driving our global economy towards potential peril.
Add to list
1 Lesons
58 minutes
On-Demand
Free-Video
Santa Fe Institute

Scaling Laws and Social Networks in the Time of COVID-19 - Part 1

0 rewiews
Exploring scaling laws in biology, cities, and economies, and their implications for societal challenges like pandemics and sustainability. Insights from complex systems science for understanding human civilization.
Add to list
9 Lesons
50 minutes
On-Demand
Free-Video
Santa Fe Institute

Scaling of Information Costs in Firms

0 rewiews
Explore the scaling dynamics of information costs within organizations, examining how firms manage and process data as they grow and evolve in size and complexity.
Add to list
1 Lesons
48 minutes
On-Demand
Free-Video
Santa Fe Institute

Capturing Intelligence at the Level of Thought - Deep Learning and Language Models

0 rewiews
Explore deep learning, language models, and AI alignment challenges in this talk on capturing intelligence at the thought level, offering insights into the future of AI research.
Add to list
16 Lesons
1 hour 31 minutes
On-Demand
Free-Video
Santa Fe Institute

Why is Life So Diverse? - Episode 3

0 rewiews
Exploring biodiversity's origins, constraints, and threats. Discusses scaling laws in evolution, exceptions to rules, and the potential for forecasting biosphere changes, featuring insights from ecology and evolutionary biology experts.
Add to list
1 Lesons
29 minutes
On-Demand
Free-Video
Institute for Pure & Applied Mathematics (IPAM)

The Mathematics of Scaling Laws and Model Collapse in AI

0 rewiews
Explore the mathematics behind AI scaling laws and model collapse, focusing on the shift from linear to flattened performance relationships in large language models.
Add to list
1 Lesons
1 hour 3 minutes
On-Demand
Free-Video
Simons Institute

Re-thinking Transformers: Searching for Efficient Linear Layers over a Continuous Space

0 rewiews
Explore efficient alternatives to dense linear layers in neural networks, examining structured matrices and their compute-optimal scaling laws for improved performance in large language models.
Add to list
1 Lesons
42 minutes
On-Demand
Free-Video
Association for Computing Machinery (ACM)

Scaling Laws for Dense Retrieval

0 rewiews
Explore scaling laws for dense retrieval, examining their impact on information retrieval systems and performance optimization strategies.
Add to list
1 Lesons
15 minutes
On-Demand
Free-Video
Institute for Pure & Applied Mathematics (IPAM)

Infinite Limits and Scaling Laws of Neural Networks

0 rewiews
Explore infinite parameter limits of deep neural networks, scaling laws, and their impact on performance. Gain insights into representation learning and computational resource optimization for neural network training.
Add to list
1 Lesons
1 hour
On-Demand
Free-Video
Institute for Advanced Study

Turbulence as Gibbs Statistics of Vortex Sheets - Alexander Migdal

0 rewiews
Explore vortex sheet dynamics, anomalous Euler equations, and Gibbs statistics in turbulence. Gain insights into scaling laws, spontaneous turbulence, and the ground state of turbulent systems.
Add to list
11 Lesons
1 hour
On-Demand
Free-Video
Alan Turing Institute

City Analytics - Professor Peter Grindrod CBE

0 rewiews
Explore urban analytics, scaling laws, and data science applications in cities. Discover insights on citizen behavior, political trends, and smart city concepts through mathematical modeling and real-world examples.
Add to list
15 Lesons
40 minutes
On-Demand
Free-Video
Center for Language & Speech Processing(CLSP), JHU

Emergence and Reasoning in Large Language Models

0 rewiews
Explore emergence and reasoning in large language models with Google researcher Jason Wei, delving into self-supervised statistical models and their implications.
Add to list
1 Lesons
52 minutes
On-Demand
Free-Video
International Centre for Theoretical Sciences

The Unreasonable Effectiveness of Mathematics in Large Scale Deep Learning - Lecture 3

0 rewiews
Explore the mathematical foundations of large-scale deep learning and their surprising effectiveness in this lecture by Greg Yang, delving into advanced concepts and cutting-edge research.
Add to list
1 Lesons
1 hour 14 minutes
On-Demand
Free-Video
International Centre for Theoretical Sciences

The Unreasonable Effectiveness of Mathematics in Large Scale Deep Learning - Lecture 2

0 rewiews
Explore the mathematical foundations of large-scale deep learning and their surprising effectiveness in this lecture by Greg Yang, delving into advanced concepts and recent developments.
Add to list
1 Lesons
54 minutes
On-Demand
Free-Video
International Centre for Theoretical Sciences

S. Chandrasekhar's Fluid Dynamics by Katepalli Raju Sreenivasan

0 rewiews
Explore S. Chandrasekhar's contributions to fluid dynamics, scaling in physics, and turbulent mixing through lectures by Katepalli Raju Sreenivasan, covering theoretical concepts and their applications.
Add to list
33 Lesons
1 hour 22 minutes
On-Demand
Free-Video
International Centre for Theoretical Sciences

Turbulence Energy Spectrum by Jayanta K. Bhattacharjee

0 rewiews
Explore turbulence energy spectrum, from homogeneous isotropic turbulence to stably stratified fluids. Covers universal range, stochastic models, eddy viscosity, perturbation theory, and Bolgiano-Obukhov scaling.
Add to list
22 Lesons
52 minutes
On-Demand
Free-Video
International Centre for Theoretical Sciences

Physics of Charged Macromolecules - Structure - Lecture 1

0 rewiews
Explore the structure of charged macromolecules in this lecture, delving into fundamental concepts and their applications in soft matter physics and related fields.
Add to list
1 Lesons
1 hour 16 minutes
On-Demand
Free-Video
AGU

Climate Dynamics and Predictability: Insights from Simple Models - 2017 Fall Meeting Lorenz Lecture

0 rewiews
Explore the Lorenz Lecture on simple models in geophysics, covering topics like residual stress, data collapse, and Gutenberg-Richter scaling, with implications for fault behavior and earthquake prediction.
Add to list
16 Lesons
51 minutes
On-Demand
Free-Video
PCS Institute for Basic Science

Critical Site Percolation on the Triangular Lattice

0 rewiews
Explore critical site percolation on triangular lattices, delving into mathematical concepts and applications in statistical mechanics and probability theory.
Add to list
1 Lesons
1 hour 15 minutes
On-Demand
Free-Video
Gresham College

Does Having a Big Brain Make You Smarter?

0 rewiews
Explore the mathematical approach to brain size and intelligence, examining scaling laws and statistical principles in humans and animals to uncover connections between brain size and cognitive abilities.
Add to list
1 Lesons
55 minutes
On-Demand
Free-Video
Dot Physics

The Physics of Scale with Falling Hail

0 rewiews
Explore the fascinating physics of falling hail, examining how changes in size affect its behavior and impact. Learn about scaling laws in meteorology.
Add to list
1 Lesons
11 minutes
On-Demand
Free-Video
Instituto de Física Interdisciplinar y Sistemas Complejos (IFISC)

The Need for Trees: Hierarchies in Urban Systems - Lecture

0 rewiews
Explore hierarchies in urban systems and their impact on complex city structures through an interdisciplinary lens of physics and social sciences.
Add to list
1 Lesons
42 minutes
On-Demand
Free-Video
Aleksa Gordić - The AI Epiphany

OpenAI Whisper - Robust Speech Recognition via Large-Scale Weak Supervision

0 rewiews
Explore OpenAI's Whisper: a robust speech recognition system using large-scale weak supervision. Dive into the paper, code, and architecture, covering dataset collection, evaluation metrics, and practical implementation.
Add to list
17 Lesons
1 hour 3 minutes
On-Demand
Free-Video
Simons Institute

A Theory for Emergence of Complex Skills in Language Models

0 rewiews
Explores statistical framework linking LLM cross-entropy loss to language skill competence, analyzing scaling laws' implications for efficient learning and emergence of complex abilities.
Add to list
1 Lesons
1 hour 5 minutes
On-Demand
Free-Video
Simons Institute

Scaling Data-Constrained Language Models

0 rewiews
Explore strategies for scaling language models in data-constrained environments, addressing data repetition, compute optimization, and mitigating scarcity challenges.
Add to list
1 Lesons
1 hour 4 minutes
On-Demand
Free-Video
Andrej Karpathy

Introduction to Large Language Models - Future and Security Challenges

0 rewiews
Comprehensive introduction to Large Language Models, covering their functionality, training, future potential, and security challenges. Explores applications, scaling, tool use, and emerging paradigms in AI.
Add to list
21 Lesons
1 hour
On-Demand
Free-Video
Open Data Science

Recent Advances in Foundation Models: Scaling Laws, Emergent Behaviors, and AI Democratization

0 rewiews
Explore recent advances in foundation models, scaling laws, and emergent behaviors in AI. Learn about efforts to democratize AI and make cutting-edge technology accessible to all.
Add to list
7 Lesons
36 minutes
On-Demand
Free-Video
Yannic Kilcher

Scalable MatMul-free Language Modeling - Paper Explained

0 rewiews
Explore innovative MatMul-free language modeling techniques using quantization and recurrence, achieving comparable performance to traditional models while significantly reducing computational costs and memory usage.
Add to list
8 Lesons
50 minutes
On-Demand
Free-Video
Yannic Kilcher

Scaling LLM Test-Time Compute Optimally for Improved Performance

0 rewiews
Explore optimal scaling of LLM test-time compute to improve performance on challenging prompts. Learn strategies for efficient allocation and potential to outperform larger models.
Add to list
1 Lesons
53 minutes
On-Demand
Free-Video
Simons Institute

Understanding Higher-Level Intelligence: 10 AIs or 10 Billion AIs

0 rewiews
Explore the future of AI: comparing small, specialized models with large, general-purpose systems. Insights from AI, psychology, and neuroscience on higher-level intelligence.
Add to list
1 Lesons
44 minutes
On-Demand
Free-Video
MLOps.community

What Drives GenAI Development in the Next 3 Years - LLMs in Production Conference

0 rewiews
Explore key drivers shaping Generative AI's future, including scaling laws, agents, multi-modality, and open-source contributions, while addressing challenges like GPU shortages and regulations.
Add to list
7 Lesons
19 minutes
On-Demand
Free-Video
Unify

The Era of 1-bit LLMs Explained - BitNet b1.58 and New Scaling Laws

0 rewiews
Explore groundbreaking research on BitNet b1.58, a ternary parameter model matching full-precision Transformers while offering improved cost-effectiveness and defining new LLM scaling laws.
Add to list
1 Lesons
58 minutes
On-Demand
Free-Video
The Machine Learning Engineer

LLM Quantization: Why Size Matters

0 rewiews
Explore LLM quantization techniques, their impact on model size, and practical applications in training, fine-tuning, and inference. Gain insights into scaling laws and optimization strategies.
Add to list
1 Lesons
47 minutes
On-Demand
Free-Video
Institut des Hautes Etudes Scientifiques (IHES)

Synthetic Data - Friend or Foe in the Age of Scaling?

0 rewiews
Explore synthetic data's impact on AI scaling laws, model performance, and potential degeneration. Analyze theoretical frameworks and experimental findings for future AI development challenges.
Add to list
1 Lesons
56 minutes
On-Demand
Free-Video
PoreLab

Inertial Effects on the Multi-Scale Stick-Slip Dynamics in Adhesive Tape Peeling

0 rewiews
Explore inertial effects on multi-scale stick-slip dynamics in adhesive tape peeling, uncovering complex instabilities and energy balances through experimental studies and quantitative modeling.
Add to list
1 Lesons
1 hour 6 minutes
On-Demand
Free-Video
Inside Livermore Lab

A First-Principles Approach to Understanding Deep Learning

0 rewiews
Delve into the fundamental principles of deep learning through statistical physics, exploring connections between neural networks, Gaussian processes, and scaling laws with insights from a DeepMind researcher.
Add to list
1 Lesons
1 hour 18 minutes
On-Demand
Free-Video