Rule Based Asset Management Workflow Automation at Netflix
Explore Netflix's innovative approach to automating asset management workflows using rule-based systems, enhancing efficiency and scalability.
Business Event-Driven Architecture and Governance in Action
Implement Event-Driven Architecture effectively with a Center of Excellence. Learn from real-life experiences in large industries to set up strong foundations, define designs, and guide development teams.
Configuring Kafka Connect for Scalability - Best Practices
Optimize Kafka Connect clusters for scalability. Learn best practices to configure and manage Kafka Connect effectively, ensuring successful integration of external systems with Apache Kafka at scale.
Maximizing Real-Time Data Processing with Apache Kafka and InfluxDB - A Comprehensive Guide
Learn to create powerful data pipelines by combining Apache Kafka and InfluxDB for real-time processing, analysis, and visualization of large-scale data, especially in IoT applications.
Evolution of Streaming Pipeline at Lyft - Real-Time Optimization Platform
Explore Lyft's real-time optimization platform evolution, focusing on streaming infrastructure for marketplace balance, scalability, and decision-making using Kafka and data science tools.
Restate: Stream Processing for Microservices
Explore a novel system for microservices that handles state, communication, and consistency. Learn how it complements event-processing systems for complex control flow and coordination in distributed applications.
Flink SQL: The Challenges to Build a Streaming SQL Engine
Explore challenges in building a streaming SQL engine like Flink SQL. Learn about late data handling, change data processing, event ordering, nondeterminism, and state storage in stream processing.
Debezium Snapshots Revisited - Incremental Snapshots for CDC Pipelines
Explore innovative incremental snapshot techniques for Debezium CDC connectors. Learn to pause, resume, and parallelize snapshots, and customize snapshot contents for efficient data pipeline management.
Dynamic Change Data Capture with Flink CDC and Consistent Hashing
Implement dynamic Change Data Capture for large databases using Flink CDC connectors and consistent hashing. Overcome challenges with incremental snapshotting and Postgres replication slots.
Automatically Detect and Remediate Degraded Storage in Kafka
Discover an automated system for detecting and remediating degraded storage in Kafka, improving cluster performance and availability. Learn about monitoring, algorithm formulation, and mitigation strategies.
Sustainability and Streaming Data: Merging Real-Time Insights, Green Futures and Profitability
Explore how streaming data applications enable real-time environmental insights, driving sustainable decisions and cost savings while addressing ethical considerations and maintaining profitability.
Exactly-Once Semantics Revisited: Distributed Transactions Across Flink and Kafka
Explore challenges and improvements in Exactly-Once Semantics for distributed transactions between Apache Flink and Kafka. Learn about proposed protocol changes and enhanced integration for robust data processing.
5-Minute Practical Streaming Techniques That Can Save You Millions
Learn cost-effective streaming optimization techniques to drastically reduce infrastructure expenses. Discover simple SQL methods and advanced strategies for distributed storage and compute stacks.
Save Money by Uncovering Kafka's Hidden Cloud Costs
Uncover hidden Kafka cloud costs, optimize spending, and justify deployments. Learn to calculate and anticipate bills, explore cost-reduction strategies, and increase efficiency in cloud-based Kafka usage.
Learnings of Running Kafka Tiered Storage at Scale
Explore Kafka tiered storage implementation, deployment, and production learnings at scale. Gain insights on principles, workloads, extended features, and issue mitigation for improved scalability and efficiency.
Anomaly Detection on Time Series Data Using Apache Flink
Implement real-time anomaly detection on network activity time series data using Apache Flink. Compare EWMA and PEWMA algorithms for effective intrusion detection in cloud-native deployments.
Autoscaling Confluent Cloud: Should We and How Would We?
Explore strategies for autoscaling Confluent Cloud resources. Learn when and how to implement scaling for cloud-based Kafka, handle ephemeral workloads, and create effective monitoring policies for optimal performance.
The Nuts and Bolts of Kafka Streams - An Architectural Deep Dive
Explore Kafka Streams' internal architecture for efficient application deployment and tuning. Learn threading models, partition assignment, and key configurations to optimize performance and scalability.
The Wonderful World of Apache Kafka
Explore Apache Kafka's ecosystem, including Producer and Consumer libraries, Connect, Streams, and Schema Registry. Gain insights for implementing Kafka in your organization.
Isolating Streaming Ingest and Queries Using RocksDB
Explore a real-time analytics architecture using RocksDB to isolate streaming data ingestion from query serving. Learn about compute-storage separation and memtable replication for efficient data processing.
Analytics: The Final Data Frontier - Why Users Need Your Data and How Pinot Serves It
Explore Apache Pinot's real-time analytics capabilities for user-facing applications, leveraging streaming data from Apache Kafka to deliver rapid insights across diverse business domains.