High Throughput Data Processing with GenStage

High Throughput Data Processing with GenStage

Explore high-throughput data processing techniques using GenStage in this 22-minute conference talk from Code BEAM America 2022. Dive into the building blocks Elixir offers for constructing various ingestion topologies, addressing crucial aspects such as backpressure, partitioning, retries, and batching. Learn how to effectively handle growing data volumes and adapt your processing techniques to safely and efficiently ingest large-scale data. Gain insights into advanced data processing strategies applicable across multiple technology disciplines, equipping yourself with the knowledge to tackle complex data ingestion challenges in Elixir-based systems.