Analytics: The Final Data Frontier - Why Users Need Your Data and How Pinot Serves It
Explore Apache Pinot's real-time analytics capabilities for user-facing applications, leveraging streaming data from Apache Kafka to deliver rapid insights across diverse business domains.
Need for Speed: Machine Learning in the Era of Real-Time
Explore the evolution of real-time machine learning techniques, addressing low latency, dynamic data adaptability, and resource efficiency challenges in modern ML systems.
Building Nucleus: Community Brands' Real-Time Analytics Platform
Explore the architecture and design of a real-time analytics platform, featuring sub-second latency, cloud-native services, and CDC streams for efficient data processing and customer insights.
Handle Millions of IoT Devices Connected to Kafka via MQTT
Learn to manage massive IoT device networks using Kafka and MQTT for real-time data ingestion, analysis, and control in applications like vehicle communication and predictive maintenance.
Change Data Streaming Patterns with Debezium and Apache Flink
Explore change data capture with Debezium and Apache Flink for microservices. Learn outbox pattern, strangler fig pattern, and saga orchestration for reliable data exchange and long-running transactions.
Real-time Schema Discovery in Distributed Systems
Explore real-time schema discovery in high-volume distributed systems. Learn about schema versioning, conflict detection, compatibility, and normalization without batching processes.
Real-Time Streaming Using Apache Kafka
Explore Apache Kafka streams for building scalable, fault-tolerant streaming applications with parallel processing capabilities.
Deep Dive into Kafka for Big Data Applications
Explore Kafka's components, configurations, and internal workings for efficient big data applications and pub/sub models.
Bringing Machine Learning to Streaming Data with a Few Lines of Code
Explore ML-powered stream processing with Dataflow and Apache Beam. Learn about Dataflow ML's integration with Vertex AI and Etsy's customer analytics platform journey.
Bringing Machine Learning to Streaming Data - Dataflow ML Innovations
Deploy and manage ML pipelines for streaming data, including inference, image classification, and custom model handling. Learn from Spotify's experience in large-scale ML podcast preview generation.
Migrating Kafka Cluster from ZooKeeper to KRaft with Strimzi
Learn to migrate Kafka clusters from ZooKeeper to KRaft using Strimzi, covering the migration process, Strimzi's support, and a practical demonstration with step-by-step guidance.
Enhancing Kafka Topic Management in Kubernetes with the Unidirectional Topic Operator
Streamline Kafka topic management in Kubernetes using the Unidirectional Topic Operator. Learn scalable, declarative approaches for efficient administration and migration strategies.
MLOps for Ad Platforms - Lessons from Ad Tech - Coffee Session 130
Explore MLOps in ad platforms with Andrew Yates. Learn about designing ML components, monitoring systems, and optimizing billion-dollar content marketplaces for long-term revenue and user experience.
Real-time Machine Learning - MLOps Coffee Sessions
Explore real-time machine learning with Chip Huyen, covering learning strategies, MLOps challenges, and streaming complexities. Gain insights on when to implement real-time solutions and avoid common company mistakes.
Apache Kafka Without ZooKeeper - Transitioning to KRaft
Explore Apache Kafka's transition from ZooKeeper to KRaft, understanding advantages, challenges, and implications for Kubernetes deployments and the Strimzi project.
Streaming Data Pipelines From Supernovas to LLMs
Hands-on tutorial for building real-time data pipelines using Databricks, from ingesting NASA supernova data to implementing LLMs with RAG. Covers ETL, stream processing, and natural language analytics.
Scaling Real-Time Healthcare Data Processing for Veterans Affairs
Optimizing VA healthcare data processing with Azure Databricks: Streamlining data ingestion, real-time analysis, and care delivery for 9 million veterans across 1,372 facilities.
Effective Lakehouse Streaming with Delta Lake
Discover the power of streaming lakehouse architecture, achieving success at scale with Delta Lake as the key to a consistent data foundation and stress-free data ecosystem.
Improving Kafka Performance: Switching from ext4 to XFS for 80% Faster Writes
Detailed analysis of Kafka performance optimization, exploring file system impact on latency. Covers Kafka internals, tracing, journaled file systems, and the switch from ext4 to XFS for 80% speed improvement.
Fast Cars, Big Data - How Streaming Can Help Formula 1
Explore how data streaming technologies like Kafka and Apache Spark can revolutionize Formula 1 racing, enabling real-time analysis and visualization of car performance data from simulator to pit to HQ.
Building a High-Performance Real-Time Analytics Database with Apache Kafka and Druid
Master building a real-time analytics database using Apache ecosystem tools including Kafka, Druid, and Superset. Learn data streaming, processing, and containerization with hands-on implementation.