Build Real-Time Applications with Databricks Streaming - Fire Department Use Case
Learn to build real-time applications using Databricks Streaming, focusing on a fire department use case. Explore architecture, data sources, and implementation for live tracking of equipment, personnel, and incidents.
NBA Analytics - Evolution and Impact in Professional Sports
Explore the evolution of sports analytics in the NBA, its impact on teams, and how data drives competitive advantage in professional basketball.
Delta from a Data Engineer's Perspective - Creating Robust Big Data Solutions
Explore a data engineer's challenges in creating robust Big Data solutions, covering Delta, Spark streaming, schema enforcement, and time travel functionality in data processing.
Preventing Common Pitfalls in Production Streaming Jobs
Explore key strategies for optimizing streaming jobs in production, covering input parameters, stateful streaming, output configurations, and job modifications to ensure performance and fault tolerance.
How to Build a Cloud Data Platform - Machine Learning and Business Intelligence - Part 4
Learn to leverage Delta Lake for dashboards and advanced analytics, enabling downstream teams with machine learning and business intelligence capabilities on a unified data platform.
Modern ETL Pipelines with Change Data Capture - Building Resilient Data Streams
Discover how GetYourGuide built a resilient ETL pipeline using Debezium, Kafka, Spark, and Airflow. Learn to handle schema changes automatically, stream data from SQL databases, and refresh data lakes multiple times daily for fresher insights.
From Rough Paths to Streamed Data
Explore the mathematical connection between rough paths theory and streamed data analysis, bridging theoretical concepts with practical applications in machine learning and dynamical systems.
How to Avoid Overcomplicating Your Data Architecture
Explore strategies for simplifying data architectures, modernizing infrastructures, and leveraging real-time streaming for AI. Learn to navigate complexity and achieve faster results in data engineering.
Building Modern Data Streaming Apps with Open Source
Discover best practices for building data streaming applications using open-source frameworks. Learn to orchestrate streams, perform ETL, enhance events, and make continuous queries with tools like Apache NiFi, Pulsar, Spark, and Flink SQL.
Bringing Transactionality to the Streaming Ecosystem - Webinar
Explore modern streaming data platforms for real-time transaction processing, focusing on durability, scalability, and performance in critical data paths. Learn from Alpaca's experience re-engineering their order management system.
Hail Hydrate - From Stream to Lake Using Open Source
Explore open-source tools for efficient data streaming and lake management, enhancing your skills in modern data architecture and processing techniques.
Real-time Trade Data Processing and Machine Learning at Giga-Scale with Hazelcast and FINOS Perspective
Explore scalable real-time trade data processing using Hazelcast and FINOS Perspective. Learn to architect high-performance applications combining streaming data, reference data, and machine learning for front and back office use-cases.
Building Next-Generation Audience Targeting and Analytics at NBCUniversal
Explore NBCUniversal's data-driven approach to audience targeting using Apache Mesos, DC/OS, Spark, Kafka, and Cassandra for real-time analytics and personalized data services.
Building Robust Streaming Data Pipelines with Apache Spark
Learn to build robust streaming data pipelines using Apache Spark, Kafka, and Camel. Explore ETL challenges, data management, and lessons from running these technologies in Docker.
Introduction to Fluvio - The Programmable Platform for Data in Motion
Explore Fluvio, a programmable platform revolutionizing data-in-motion processing. Learn its key features and applications in modern data architectures for efficient, real-time data handling.
Let's Play with Charmed Spark - Apache Spark on Kubernetes
Explore Apache Spark on Kubernetes using Charmed Spark. Learn to deploy, configure, and run Spark workloads, integrate with Kafka, and monitor jobs through hands-on demonstrations.
Database Native Support for CDC Streaming Pipeline
Explore a database-native solution for Cassandra's CDC logs, addressing common challenges and proposing an improved architecture based on industry insights and managed CDC solutions.
Declarative Reasoning with Timelines: The Next Step in Event Processing
Explore declarative reasoning with timelines for advanced event processing. Learn stream-native query abstractions and simplified time-based reasoning techniques for modern data processing challenges.
Introducing Apache Pinot: Real-time Analytics for Large-Scale Data
Explore Apache Pinot's real-time analytics capabilities, architecture, and data model. Learn about its query language, indexing, and use cases in high-performance applications.
Real-Time Data Integration Practice Based on Flink CDC at Alibaba Cloud
Explore real-time data integration using Flink CDC, covering core design, key implementations, and Alibaba Cloud's solutions for data lake and warehouse integration scenarios.
Building a Real-Time Analytics Database
Odkryj tajniki tworzenia bazy danych do analityki w czasie rzeczywistym. Poznaj kluczowe koncepcje i najlepsze praktyki w tej dziedzinie.