Data Contracts for Long-Term Schema Management in Apache Kafka
Learn effective long-term schema management using data contracts. Explore advantages of Avro and Protobuf, schema references, compatibility types, topic versioning, and tools for data discoverability in Apache Kafka.
Real-Time Data Transformation and Analytics with dbt Labs
Explore real-time data transformation and analytics with dbt Labs. Learn about Modern Data Stack, streaming analytics, and best practices for building efficient data pipelines and democratizing data access.
The Future of Streaming Data - Challenges and Opportunities
Explore the future of streaming data, focusing on managing complex data connections, adopting Kafka internally, and addressing challenges in data governance, security, and movement across organizations.
What Apache Kafka Developers Can Learn from Online Gaming
Explore how online gaming concepts enhance large-scale event management in Apache Kafka, including latency masking, conflict resolution, and seamless collaboration techniques for improved real-time data processing.
How to Use OpenTelemetry to Trace and Monitor Apache Kafka Systems
Gain insights into Apache Kafka event systems using OpenTelemetry for tracing and monitoring. Learn about application-level tracing, native Kafka support, and implementing event-level tracing in distributed systems.
Git for Data: Managing Data like Code with lakeFS
Explore lakeFS, an open-source tool transforming object storage into Git-like repositories for data version control. Learn its benefits for data management, reproducibility, and reprocessing in various industries.
Improving Scalability and Performance with Kafka Leader Election
Explore Kafka leader election's role in improving scalability and performance. Learn about failover processes, preferred leaders, and optimizations for efficient data replication and consistency in distributed systems.
Real-Time Machine Learning and Smarter AI with Data Streaming
Explore real-time machine learning and AI with data streaming. Learn how Airy's open-source platform uses Apache Kafka to improve customer experiences through integrated, accessible data and conversational AI.
The Present and Future of Stream Processing - Trends and Innovations
Explore trends in data streaming, Apache Kafka adoption, and the future of stream processing with industry experts. Gain insights on best practices, emerging use cases, and technological advancements.
Building and Designing Events and Event Streams with Apache Kafka
Learn to design effective event-driven architectures using Apache Kafka. Explore key concepts like internal vs. external events, fact vs. delta, and normalization strategies to build scalable, responsive systems.
Rethinking Apache Kafka Security and Account Management - Centralized Identity Management
Explore centralized identity management for Apache Kafka, focusing on OAuth integration, security enhancements, and best practices for seamless access control across cloud and on-premises environments.
Optimizing Speed and Scale of User-Facing Analytics Using Apache Kafka and Pinot
Explore real-time analytics optimization using Apache Kafka and Pinot. Learn how these powerful tools work together to deliver scalable, low-latency solutions for user-facing applications.
Keep Your Cache Always Fresh with Debezium
Explore how to maintain synchronized read views in distributed caches using change data capture, Debezium, Apache Kafka, and Infinispan. Learn to create denormalized data views and implement cross-site replication for cache updates.
Event-Driven Autoscaling for Serverless Java
Explore event-driven autoscaling for serverless Java on Kubernetes using KEDA and Knative, focusing on Apache Kafka metrics for efficient scaling of Quarkus applications.
Creating Event-Driven Microservices - The Why, How, and What
Explore event-driven microservices architecture, including key patterns, Apache Kafka's role, and practical implementation strategies for building scalable and resilient systems.
From Zero to Hero with Kafka Connect
Explore Kafka Connect's power in integrating data systems, from basics to advanced techniques for efficient and scalable data pipelines.
Event Streaming Applications with Kafka Streams, Spring Kafka, and Actuator
Explore event streaming with Kafka Streams, Spring Kafka, and Actuator. Learn to build scalable, fault-tolerant applications using live coding examples for consumers, producers, and fraud detection streams.
Using Open Source Tech to Swap Out Components of Your Data Pipeline
Explore open-source technologies for flexible data pipelines, from Apache Kafka to BigQuery, with easy component swapping and cloud deployment options.
Taming IoT Data - Making Sense of Sensors with SQL Streaming
Explore IoT data processing with KSQL, Apache Kafka's SQL streaming engine. Learn to ingest, process, and visualize smart home energy data in real-time using a simplified IoT architecture.
From Hot Data Sources to Interactive Clients in a Hurry
Explore reactive applications in Micronaut, handling hot data sources with Apache Kafka, and creating interactive web clients using D3.js. Learn testable approaches for efficient data processing and visualization.
Streaming ETL on the Shoulders of Giants
Explore configuration-based streaming ETL pipelines between MongoDB and Apache Kafka using Kafka Connect framework, focusing on data integration scenarios without coding.