Главная
Study mode:
on
You
History
Saved
In progress 0 courses
compleat 0 courses
#Art & Design #Adobe #ChatGPT #GitHub

#Mixture-of-Experts

Showing: 21 courses
Stanford University

Stanford Seminar - Mixture of Experts Paradigm and the Switch Transformer

0 rewiews
Explore the Mixture of Experts paradigm and Switch Transformer, revolutionizing deep learning with sparsely-activated models for improved efficiency and performance in language processing tasks.
Add to list
1 Lesons
1 hour 6 minutes
On-Demand
Free-Video
Association for Computing Machinery (ACM)

Unsupervised Cross-Domain Image Retrieval with Semantic-Attended Mixture-of-Experts

0 rewiews
Explore unsupervised cross-domain image retrieval using semantic-attended mixture-of-experts, enhancing retrieval accuracy across diverse visual domains.
Add to list
1 Lesons
11 minutes
On-Demand
Free-Video
Association for Computing Machinery (ACM)

When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applications - Lecture 1

0 rewiews
Explore parameter-efficient fine-tuning techniques for multi-task medical applications using Mixture of Experts and Large Language Models.
Add to list
1 Lesons
14 minutes
On-Demand
Free-Video
Discover AI

Understanding Snowflake Arctic 480B - A Mixture of Experts LLM Architecture

0 rewiews
Dive into the architecture and performance analysis of Snowflake's Arctic 480B LLM, exploring how its 128x4B MoE design compares to traditional transformers for enterprise-level AI tasks.
Add to list
10 Lesons
23 minutes
On-Demand
Free-Video
Discover AI

LLM Prompt Formatting: Optimizing Performance for Language Models and RAG Systems

0 rewiews
Master the critical impact of prompt formatting on LLM and RAG system performance, exploring optimization techniques and understanding how different formats influence AI model responses.
Add to list
1 Lesons
25 minutes
On-Demand
Free-Video
Discover AI

Supercharging Multi-LLM Intelligence with CALM - Composition to Augment Language Models

0 rewiews
Discover how CALM (Composition to Augment Language Models) revolutionizes multi-LLM integration through advanced projection layers and cross-attention mechanisms for enhanced AI capabilities.
Add to list
1 Lesons
26 minutes
On-Demand
Free-Video
Discover AI

Mixture of Experts (MoE) in Large Language Models - A Simple Guide

0 rewiews
Delve into the architecture and functionality of Mixture of Experts (MoE) systems in language models through clear examples and technical insights about token routing, gating networks, and computational efficiency.
Add to list
1 Lesons
23 minutes
On-Demand
Free-Video
Alfredo Canziani

Modules and Architectures

0 rewiews
Explore non-linear functions, cost functions, and advanced architectures like multiplicative interaction and mixture of experts in deep learning, with insights from expert Yann LeCun.
Add to list
9 Lesons
1 hour 42 minutes
On-Demand
Free-Video
Association for Computing Machinery (ACM)

Learning Mixtures of Linear Regressions in Subexponential Time via Fourier Moments

0 rewiews
Explore efficient algorithms for learning mixtures of linear regressions using Fourier moments, overcoming previous barriers and achieving subexponential time complexity.
Add to list
12 Lesons
25 minutes
On-Demand
Free-Video
Anyscale

Developing and Serving RAG-Based LLM Applications in Production

0 rewiews
Learn to develop, evaluate, and scale RAG-based LLM applications for production, including advanced topics like hybrid routing to bridge the gap between open-source and closed LLMs.
Add to list
1 Lesons
29 minutes
On-Demand
Free-Video
Sam Witteveen

Microsoft's Phi 3.5 - Latest Small Language Models Overview

0 rewiews
Explore Microsoft's latest Phi 3.5 models, including Mini, MoE, and Vision variants. Learn about their capabilities, performance, and practical applications through demonstrations and code examples.
Add to list
7 Lesons
15 minutes
On-Demand
Free-Video
AutoML Seminars

AutoMoE - Neural Architecture Search for Efficient Sparsely Activated Transformers

0 rewiews
Discover how Neural Architecture Search optimizes Transformer models through sparse activation, achieving 4x FLOP reduction while maintaining performance in machine translation tasks.
Add to list
1 Lesons
47 minutes
On-Demand
Free-Video
AutoML Seminars

Mixture-of-Supernets - Improving Weight-Sharing Supernet Training with Architecture-Routed MoE

0 rewiews
Explore cutting-edge research on Mixture-of-Supernets architecture that enhances neural architecture search efficiency and improves BERT and MT model performance through innovative weight-sharing techniques.
Add to list
1 Lesons
35 minutes
On-Demand
Free-Video
Data Science Festival

Building Intelligent Systems with MoE, Multimodality, and Crowd of Agents

0 rewiews
Explore advanced AI systems using MoE, multimodality, and agent crowds. Learn techniques for building composite intelligent systems beyond single algorithms or models.
Add to list
1 Lesons
47 minutes
On-Demand
Free-Video
EuroPython Conference

Unlocking Mixture of Experts - From One Know-it-all to a Group of Jedi Masters

0 rewiews
Explore Mixture of Experts technique to enhance predictive powers. Dive into principles, challenges, and applications. Learn when to use MoE, discuss business metrics, and access resources for implementation.
Add to list
1 Lesons
31 minutes
On-Demand
Free-Video
MLOps.community

GenAI in Production - Challenges and Trends - Lecture 224

0 rewiews
Explore challenges and trends in Generative AI production, including model size, context windows, multimodality, and regulation. Gain insights from Gemini 1.0 vs 1.5 comparisons and industry expert Verena Weber's experiences.
Add to list
21 Lesons
49 minutes
On-Demand
Free-Video
Aleksa Gordić - The AI Epiphany

LLaMA 3 Deep Dive - Synthetic Data, Privacy, and Model Architecture

0 rewiews
Explore LLaMA 3's innovations with Meta's Thomas Scialom, covering synthetic data, privacy concerns, scaling techniques, and architectural choices in this in-depth discussion on advanced language models.
Add to list
12 Lesons
53 minutes
On-Demand
Free-Video
Databricks

Pioneering a Hybrid SSM Transformer Architecture - Jamba Foundation Model

0 rewiews
Explore AI21 Labs' Jamba: a groundbreaking hybrid Transformer-Mamba MoE model with unparalleled throughput and a 256K context window, revolutionizing large language model development.
Add to list
1 Lesons
33 minutes
On-Demand
Free-Video
Yannic Kilcher

GShard- Scaling Giant Models with Conditional Computation and Automatic Sharding

0 rewiews
Detailed explanation of Google's 600 billion parameter transformer for multilingual translation, focusing on scaling techniques, mixture-of-experts, and automatic sharding implementation on TPUs.
Add to list
10 Lesons
1 hour 13 minutes
On-Demand
Free-Video
Generative AI on AWS

Pre-training Mixtral MoE Model with SageMaker HyperPod - Fine-Tuning and Continued Pre-Training

0 rewiews
Master advanced techniques for pre-training and fine-tuning Mixtral MoE models using AWS SageMaker HyperPod and SLURM, covering implementation strategies and continued pre-training approaches.
Add to list
1 Lesons
1 hour 9 minutes
On-Demand
Free-Video
Unify

OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models

0 rewiews
Explore OpenMoE, an open-source Mixture-of-Experts language model series. Discover its cost-effectiveness, routing mechanisms, and key insights in comparison to dense LLMs.
Add to list
1 Lesons
1 hour 3 minutes
On-Demand
Free-Video