Streaming CDC Data from PostgreSQL to Snowflake - Challenges and Solutions
Uncover streaming ETL secrets: Postgres to Snowflake data ingestion, change data capture, dynamic tables, and Snowpipe streaming. Learn solutions for lower latency, cost savings, and enhanced scalability.
Foundations for a Multi-Modal Lakehouse for AI
Explore multi-modal AI data management challenges and solutions. Learn about Lance columnar format for next-gen AI infrastructure through real-world use cases and technical insights.
Open Data Foundations Across Hudi, Iceberg and Delta - OneTable Integration
Explore OneTable's innovative approach to optimizing data across Hudi, Iceberg, and Delta Lake. Learn how it enhances workloads for various query engines and streamlines data analysis.
Why Streaming SQL? The Semantics and Challenges of Applying SQL to Unbounded Data
Explore SQL's application to unbounded data streams, covering time-oriented elements, continuous pipeline challenges, and insights for data professionals.
Building Real-Time Customer-Facing Analytics at Scale - From Twilio to Propel
Explore real-time customer analytics architecture at Twilio, including benefits, challenges, and sub-second latency impact. Learn how these insights influenced Propel's approach to diverse analytics use cases.
Real-Time Analytics for Small Data Teams
Discover strategies for implementing real-time analytics with limited resources. Learn from Materialize's adoption experience and optimize data workflows for efficiency and cost-effectiveness.
Decoupling Compute and Storage for Stream Processing Systems
Explore the challenges and solutions of decoupled compute and storage in stream processing systems, focusing on tiered storage mechanisms to balance performance and cost-efficiency.
Troubleshooting Unstructured Data with Embeddings
Explore embedding techniques for troubleshooting unstructured data models, gaining insights into internal representations and improving ML workflows.
Big Data's Fourth V - Or Why We'll Never Find the Loch Ness Monster
Explore the fourth V of Big Data and its implications for mythical creature discovery in this thought-provoking talk by Davi Ottenheimer at BSidesLV.
Hyper Speed! When Big Data Blooms
Explore high-speed data processing using Bloom Filters, a powerful probabilistic data structure. Learn to handle massive data volumes efficiently, with real-world examples and advanced techniques.
Hyper Speed! When Big Data Blooms
Explore techniques for processing massive data volumes at high speeds, with insights from Report URI's handling of 65,000 JSON payloads per second in global telemetry.
Hyper Speed! When Big Data Blooms
Explore high-speed data processing techniques using Bloom Filters to handle massive volumes of JSON payloads efficiently, as implemented by Report URI for global client telemetry.
Tracking Aircraft with Redis & Software-Defined Radio
Learn to build a real-time flight tracking dashboard using software-defined radio, Redis Streams, Node.js, and JavaScript. Explore ADS-B data capture, streaming architecture, and microservices implementation.
Building a Telegram Bot with Apache Kafka and ksqlDB
Hands-on demonstration of building a Telegram bot using Apache Kafka and ksqlDB, showcasing real-time data processing, querying, and integration capabilities without additional datastores.
AI-Ready Data Infrastructure for Real-Time Sensor Data Analytics on the Edge
Explore practical strategies for building edge-based real-time sensor data analytics infrastructure, using race strategy analytics as a case study to demonstrate cross-industry applications.
Real-Time Event Streaming Patterns for AI-Native Applications
Explore how event streaming patterns power AI applications through real-time analytics, data enrichment, and stream processing for enhanced intelligence and reliable infrastructure.
Elasticsearch Vector Database - Introduction to Vector Search and HNSW Algorithm
Dive into Elasticsearch's evolution from a search engine to a powerful vector database, exploring HNSW algorithms, vector compression, and hybrid search capabilities for enhanced data retrieval.
High Performance Scalable Support for Big Data Stacks with MPI - Leveraging MPI4Spark and MPI4Dask
Discover how MPI4Spark and MPI4Dask enhance big data frameworks by leveraging high-speed networks and HPC systems for improved performance and scalability in distributed computing environments.
Implementing InfluxDB IOx Using Apache Arrow, DataFusion, and Rust
Discover how modern database systems are built using Apache Arrow, DataFusion, and Rust, exploring the architecture and implementation of InfluxDB IOx through deconstructed database approaches and open-source components.
Time Series Analytics with Apache Arrow, Pandas and Parquet - A Beginner's Guide
Discover how to build high-performance time series analytics applications using Apache Arrow Flight, Parquet, and Pandas, focusing on efficient data processing and querying techniques for columnar databases.
Exploiting the Unexploitable - Advanced JavaScript Vulnerability Chains in Kibana
Dive into advanced exploitation techniques for JavaScript vulnerabilities, focusing on Prototype Pollution attacks and RCE chains through real-world Kibana Bug Bounty examples and defense strategies.