Hyperparameter Tuning Using Tidymodels
Explore hyperparameter tuning for random forest models using global food consumption data, enhancing model performance and gaining insights into international dietary patterns.
What Matters in On-Policy Reinforcement Learning? A Large-Scale Empirical Study
Comprehensive study on on-policy reinforcement learning, examining 50+ design choices across 5 environments. Provides insights and recommendations for practitioners to optimize agent performance in continuous control tasks.
RoBERTa - A Robustly Optimized BERT Pretraining Approach
Explore how RoBERTa improves BERT's performance through optimized training, challenging recent model enhancements and highlighting the impact of hyperparameter choices in language model pretraining.
Optimization
Explore advanced optimization techniques for tall dense linear programs, including faster energy maximization for maximum flow problems.
Automated Hyperparameter Tuning for Deep Neural Networks
Comprehensive guide to automated hyperparameter tuning for deep neural networks using Optuna, covering dataset preparation, model design, and optimization techniques in PyTorch.
Hyperparameter Optimization - This Tutorial Is All You Need
Explore various hyperparameter optimization techniques including Grid Search, Random Search, Bayesian Optimization, Hyperopt, and Optuna to fine-tune models and optimize functions effectively.
Efficient Distributed Hyperparameter Tuning with Apache Spark
Learn to efficiently distribute hyperparameter tuning workloads using Apache Spark, avoiding common pitfalls and optimizing performance. Explore best practices with Hyperopt and joblib-spark for scaling ML model training.
CMSIS-NN & Optimizations for Edge AI
Explore Edge AI optimizations, CMSIS-NN library, and TensorFlow Lite for microcontrollers. Learn performance enhancement techniques and see a live demo on Arduino Nano 33 BLE Sense board.
Hyperparameter Optimization for Reinforcement Learning Using Meta's Ax
Learn to optimize hyperparameters for reinforcement learning using Meta's Ax framework. Explore grid search, random search, and Bayesian optimization techniques to improve machine learning model performance.
TinyRL: Teaching AI to Swing Up a Real Pendulum
Explore reinforcement learning to train an AI agent to swing up a real pendulum using Arduino, Python frameworks, and ESP32 deployment, with practical demonstrations and troubleshooting tips.
Training and Optimisation of Large Transformer Models - An ATLAS and CERN Use Case
Explore CERN's implementation of transformer models for Jet Flavour Tagging, utilizing Kubeflow for machine learning and Katib for hyperparameter optimization in large-scale particle physics data analysis.
Deep Reinforcement Learning Agent for Snake Game
Explore deep reinforcement learning as an AI agent masters the classic snake game, with code review and optimization techniques for Python-based machine learning projects.
Neural Architecture Search: Coming of Age
Explore Neural Architecture Search advancements, including benchmarks, speedup techniques, AutoML integration, and neural ensemble search. Gain insights from a leading expert in automated machine learning.
Learning Neural Network Hyperparameters for Machine Translation - 2019
Explore neural network hyperparameter optimization for machine translation, focusing on efficient methods to learn parameters during training without extensive grid searches.
A Hyperparameter Optimization Toolkit for Neural Machine Translation Research
Explore a toolkit for optimizing hyperparameters in neural machine translation research, enhancing efficiency and performance in NMT model development.
Auto-Sklearn - Automated Machine Learning in Python
Discover Auto-sklearn, an open-source AutoML tool that simplifies machine learning pipeline development. Learn its functionality, benefits, and how to implement it as a scikit-learn replacement.
Unveiling Precision: A Novel Machine Learning Framework for Accurate Probability Estimates in Financial Industries
Explore a cutting-edge ML framework for precise probability estimates in finance. Learn advanced calibration metrics and optimization techniques to significantly improve cash flow predictions.
Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face-Recognition
Explore groundbreaking research on addressing bias in face recognition systems through neural architecture optimization, revealing how architectural choices impact fairness more than data preprocessing alone.
AutoGluon 1.0 - Shattering SOTA with Zeroshot-HPO and Dynamic Stacking
Discover how AutoGluon 1.0 revolutionizes machine learning with Zeroshot-HPO and Dynamic Stacking, achieving superior performance in automated model training and ensemble stability.
Vanilla Bayesian Optimization Performs Great in High Dimensions
Discover how scaling Gaussian process lengthscale prior with dimensionality enables vanilla Bayesian optimization to excel in high-dimensional optimization problems, outperforming complex alternatives.
Reproducibility and Versioning of Machine Learning Systems
Explore essential aspects of ML system reproducibility, from dataset versioning to containerization, ensuring reliable model performance and regulatory compliance in production environments.