Realtime Distributed Computing at Scale - Storm and Streamparse
Explore realtime distributed computing at scale using Apache Storm and Streamparse in this 30-minute EuroPython Conference talk. Learn how to handle large data pipelines with low latency and high availability while processing thousands of items per second in pure Python. Discover the basics of Apache Storm, its elegant solution for realtime distributed computing, and how Streamparse enables writing Storm components in Python. Gain insights into Parsely's production use of Storm to manage billions of realtime events monthly. Understand Storm's architecture, including spouts, bolts, and topologies, as well as its advantages over other Python data streaming solutions. By the end of the talk, grasp the fundamentals of Apache Storm, its applications, and how to implement it using Streamparse in high-availability, low-latency production environments.