Do Chemformers Dream of Organic Matter? Evaluating Transformer Models for Synthesis Prediction
Explore transformer models for synthesis prediction in drug discovery, including challenges, comparisons, and performance in product and retrosynthesis prediction for pharmaceutical applications.
Boosting Cybersecurity Awareness with Transformer Models for Threat-Informed Defense
Discover how transformer models and semantic search enhance cybersecurity by linking vulnerabilities to adversarial tactics, enabling better threat detection and proactive defense measures.
Enhancing Speech Analytics with Whisper: A Speech Recognition Evaluation
Explore how Whisper speech recognition enhances Athena Speech Analytics, comparing its performance to task-specific models for improved customer experience and workforce efficiency.
Efficient Inference of Extremely Large Transformer Models
Explore techniques for optimizing large transformer models, including compression, efficient attention, and parallelism for faster, smaller, and cost-effective inference.
LLMs vs LMs in Production - Key Differences in Using 100M vs 100B Parameter Models
Explore key differences between using 100M vs 100B parameter models in production, covering MLOps processes, prompt testing, automated training, and real-time inference for conversational AI.
LLMs: Understanding Temperature and Context Length of GPT Models
Explore temperature and context length in GPT models to enhance LLM research. Learn how these parameters impact results and gain insights for more effective AI interactions.
Embeddings vs Fine-Tuning - Part 3: Unsupervised Fine-Tuning
Explore unsupervised fine-tuning techniques for embeddings, including dataset cleanup, Google Colab implementation, and expert tips for optimal results.
Prompt Poet - Character AI's Framework for Assembling ML Chat Prompts
Learn Character AI's Prompt Poet framework for efficient prompt assembly and injection. Explore its application in LLM chat formats and discover techniques for enhancing AI interactions.
Linformer - Self-Attention with Linear Complexity
Detailed explanation of the Linformer model, which reduces self-attention complexity in transformers from O(n²) to O(n), improving efficiency while maintaining performance in NLP tasks.
Transformers Are RNNs- Fast Autoregressive Transformers With Linear Attention
Explore a novel approach to transformers using linear attention, reducing computational complexity and revealing connections to RNNs. Gain insights into faster, more efficient deep learning models for long sequences.
Large Language Models for Compiler Optimization
Explore how large language models can enhance compiler optimization, focusing on a custom 7B parameter Transformer model that generates optimal compiler options for minimizing code size.
BERTopic Explained
Explore BERTopic, an advanced topic modeling technique using transformers, UMAP, and HDBSCAN. Learn its components, implementation, and customization for organizing unstructured text data effectively.
How to Build a Bert WordPiece Tokenizer in Python and HuggingFace
Learn to build a custom BERT WordPiece tokenizer in Python using HuggingFace, essential for creating transformer models for specific languages or domains. Includes step-by-step walkthrough and code implementation.
Demystifying the Communication Characteristics for Distributed Transformer Models
Explore communication patterns and optimization strategies for distributed transformer models, focusing on collective operations and performance characteristics in large-scale deployments.
Beyond Rules and Rewards: From Pixels to Adaptive Policies Through Imitation, Reinforcement, and Multimodal Learning
Explore advanced robotic learning methodologies, from imitation-based training to multimodal systems, focusing on adaptive policies and vision-language models for enhanced real-world robot interactions.
Accelerating Data Intensive ML Applications with the Graphcore IPU
Explore how Graphcore's Intelligence Processing Unit accelerates AI development, focusing on BERT optimization and implementation using Spell's Cloud MLOps platform and HuggingFace tools.
Do Androids Know They're Only Dreaming of Electric Sheep?
Explore transformer language models' internal representations to detect and analyze hallucinatory behavior in AI-generated content, with insights on task-dependent patterns and evaluation methods.
Optimizing Pinterest Shopping Recommendations for Purchases
Discover how Pinterest optimizes shopping recommendations across platforms to drive purchases using advanced AI techniques, item embeddings, and conversion models.
Train Your First NLP Transformer Model with Amazon SageMaker
Learn to train and deploy NLP Transformer models using Amazon SageMaker and Hugging Face. Gain hands-on experience with cutting-edge deep learning techniques for natural language processing.
Bringing Structure Into an Unstructured World - Applying State-of-the-Art Machine Learning at Digits
Explore how Digits applies transformer models to extract structured information from unstructured financial data and deploys ML experiments in production using TensorFlow.
Ads Ranking Evolution at Pinterest - From Logistic Regression to Deep Learning
Explore Pinterest's ads ranking evolution, from logistic regression to deep learning transformers, incorporating sequential signals and multi-task learning. Gain insights on overcoming challenges and advancing ML platforms.