Horovod - Distributed Deep Learning for Reliable MLOps
Explore Uber's Horovod framework for distributed deep learning, covering its adoption, techniques, and integration with Spark for efficient large-scale model training and deployment.
Scala and Spark in the New Deep Learning Era
Explore integrating large language models into big data infrastructures using Apache Spark, Scala, and BigDL. Learn distributed fine-tuning for pre-trained models and their representation as Spark estimators.
Untwisting the Mersenne Twister: How I Killed the PRNG Moloch
Unraveling the Mersenne Twister algorithm: exploring its vulnerabilities, testing methods, and implications for pseudorandom number generation in various applications.
MegaScale - Scaling Large Language Model Training to More Than 10,000 GPUs
Innovative system for training large language models on 10,000+ GPUs, addressing efficiency and stability challenges through full-stack optimization and advanced diagnostic tools.
The Bedrock of Byzantine Fault Tolerance: A Unified Platform for BFT Protocols - NSDI '24
Unified platform for analyzing, implementing, and experimenting with Byzantine Fault-Tolerant protocols, exploring design dimensions and trade-offs to navigate the complex BFT landscape.
Consensus Protocols
Explore cutting-edge consensus protocols in cryptography at Eurocrypt 2024, chaired by Christian Cachin. Gain insights into the latest advancements and research in this critical field.
A NASA Perspective on Quantum Computing - Recent Results in Distributed Computing
Explore NASA's quantum computing research, focusing on distributed computing advancements in the quantum CONGEST-CLIQUE Model for optimization problems relevant to space missions.
Arras - MoonRay's Distributed Computational Framework for Ray-Trace Rendering
Explore Arras, a scalable framework enabling distributed computations for ray-trace rendering. Learn how it enhances MoonRay's capabilities, allowing for unlimited computational power and accelerating processor-intensive operations in film production.
YTsaurus as a Distributed Coordination Service
Explore YTsaurus as a powerful tool for distributed system coordination, comparing its rich functionality with similar systems and learning how it simplifies complex distributed algorithms.
Synchronous Consensus with Optimal Asynchronous Fallback Guarantees
Explore optimal consensus protocols balancing synchronous efficiency with robust asynchronous fallback, enhancing blockchain and distributed systems reliability.
Everywhere Computer Overview - Introduction to IPVM and Wasm Functions
Overview of Everywhere Computer: background, IPVM, Homestar Rust implementation, and Wasm functions. Learn about local installation, beta signup, and community discussions.
PyTorch 2.1 - New Features and Accelerating Generative AI Models
Explore PyTorch 2.1's new features for AI model acceleration, including compile, distributed, inference, and edge technologies, with insights on optimizing generative AI models for enhanced performance.
Everywhere Computer Overview - Recent Updates and Features
Overview of Everywhere Computer: recent updates, IPVM, subnets, payment channels, and Farcaster frames experiments. Learn about local installation and join the beta for this distributed computing platform.
From Consensus Back to Agreement
Explore the journey from consensus to agreement in distributed systems, featuring insights from Silvio Micali on innovative approaches and theoretical advancements.
Graph Algorithms in the Massively Parallel Computation Model
Explore efficient graph algorithms in the Massively Parallel Computation model, focusing on techniques for near-linear memory regime and comparing MPC to other distributed/parallel models.
Conditional Hardness for Massively Parallel Computing Via Distributed Lower Bounds
Explore conditional hardness in massively parallel computing through distributed lower bounds, examining theoretical challenges and algorithmic implications for sublinear algorithms.
An Introduction to Distributed, Massively Parallel, and Local Computation Algorithms
Explore distributed, massively parallel, and local computation algorithms, focusing on their applications, challenges, and recent advancements in sublinear algorithmic techniques.
Sparsity and Privacy in Distributed Matrix Multiplication
Explore advanced techniques for distributed matrix multiplication, focusing on sparsity and privacy considerations in large-scale computations.
Coded Matrix Computation: Numerical Stability, Partial Stragglers, and Sparse Input Matrices
Explore advanced techniques for high-dimensional matrix computations in distributed systems, addressing numerical stability, partial stragglers, and sparse input matrices.
Polar Codes for IDS Channels
Explore polar codes for IDS channels, addressing numerical instability, partial stragglers, and worker computation time in sparse matrix scenarios. Learn recent contributions to overcome these challenges.
Multi-Party Computation - PKC 2024 Session
Explore cutting-edge developments in Multi-Party Computation at PKC 2024, featuring expert presentations and discussions on advanced cryptographic protocols and secure data processing techniques.