Building Hyper-Personalized LLM Applications with Rich Contextual Data - DE4AI
Explore the concept of Full RAG (Retrieval-Augmented Generation) and its potential to revolutionize user experiences across industries in this 28-minute talk by Mike Del Balso, co-founder of Tecton. Examine four levels of context personalization, from ba…
Real-Time Data Streaming Architectures for Generative AI
Explore the evolution of data processing architectures for Generative AI in this 12-minute talk by Emily Ekdahl at the MLOps.community event. Discover how real-time data streaming solutions using Apache Kafka and Apache Flink are revolutionizing the way…
A Kafka Producer's Request: From Send() to Disk and Back
Explore the intricate journey of data into Apache Kafka® in this 49-minute conference talk from Devoxx. Delve into the complex process behind the seemingly simple producer.send() call, tracing the path of a request from its inception to disk storage and…
Data Streaming with Confluent: Stream, Connect, Govern, and Process Information
Explore the world of data streaming through this 39-minute conference talk from Devoxx. Dive into Confluent's Data Streaming Platform and discover how to Stream, Connect, Govern, and Process large volumes of information effectively. Learn about the revol…
Realtime Streaming for Anomaly Detection - An End-to-End Data Engineering Project
Build a real-time anomaly detection system using streaming data engineering techniques. Learn end-to-end implementation for monitoring and identifying unusual patterns in data streams.
15 Essential Do's and Don'ts with Apache Kafka
Discover 15 crucial best practices for Apache Kafka, covering naming conventions, replication, partitioning, data quality, and more. Gain practical insights to optimize your Kafka environment.
Cloud Platform Observability: Streaming Logs from AWS Firehose to Dynatrace
Integrate AWS Firehose logs with Dynatrace Grail for AI-powered observability. Learn setup, analysis, and multi-cloud log management to mitigate issues and enhance security.
A Brief History of Data - From Early Computing to Real-Time Streaming
Explore the evolution of data management from early computing to modern real-time systems. Gain insights into technological advancements shaping our understanding and utilization of data.
Replication in Apache Kafka Explained - Monitoring and Troubleshooting Data Streaming Applications
Explore Apache Kafka® replication: challenges, approaches, monitoring, and failure handling. Gain practical insights through Docker and Jupyter notebook experiments, with code available on GitHub.
A Kafka Producer's Request: From Send() to Disk and Back
Explore the lifecycle of Kafka producer requests, from initial call to disk storage and back, enhancing your debugging and performance analysis skills for Apache Kafka.
Machine Learning Pipeline Using Streaming IoT Sensor Data
ストリーミングIoTセンサーデータを活用した実用的な機械学習パイプラインの構築方法を紹介。MapRとH2Oを使用し、リアルタイム予測を実現する大規模IoTシステムの実装プロセスを解説。
Machine Learning Without Batteries - The Case for Light-Powered TinyML
Explore light-powered tinyML for batteryless smart sensors, covering design methodology, gesture detection, and implications for IoT. Learn about energy harvesting and sustainable machine learning solutions.
Insights on Re-Architecting to a Single Codebase for Multiple Hardware Platforms
Explore strategies for unifying codebases across diverse hardware platforms using Zephyr OS, enhancing efficiency in multi-product portfolios with common sensor and data functionalities.
Small Space Differentially Private Graph Algorithms in the Continual Release Model
Explore sublinear space differentially private graph algorithms for continual release, covering densest subgraphs, k-core decomposition, maximum matching, and vertex cover.
Real-Time Revolution: Kickstarting Your Journey in Streaming Data
Dive into stream processing fundamentals and learn to build real-time data applications using Python's Bytewax framework, debunking common misconceptions along the way.
Navigating the Landscape of a Fully Open Source Data Stack in 2023
Explore the architecture of modern data stacks, from warehousing to streaming solutions, while understanding the potential and limitations of open-source tools in today's data infrastructure.
Streaming Featurization with Ibis, Substrait and Apache Arrow
Explore real-time streaming data processing using Ibis, Substrait, and Apache Arrow. Learn how this software stack enhances featurization workflows for fast, accurate insights and decision-making in data science.
Real-Time Analytics of Customer Financial Activities with Apache Flink
Explore real-time analytics for financial activities using Apache Flink. Learn about Capital One's approach to processing customer data, event-time processing, and applications in fraud detection.
How Digital Data Collection Methods Impact Scientific Inference - Dr. Rebekah Tromble
Explore how digital data collection methods impact scientific inference, focusing on Twitter data analysis, APIs, and logit regression. Learn to navigate challenges in social and cultural research.
Designing and Implementing a Real-time Data Lake with Dynamically Changing Schema
Learn to build a robust streaming ETL pipeline that handles dynamically changing schemas and new event types without downtime, using Delta Lake and Databricks for real-time data lake implementation.
Demystifying Delta Lake - Data Reliability for Data Lakes
Explore Delta Lake's reliability features for data lakes with Apache Spark creator Michael Armbrust. Learn about ACID transactions, metadata handling, and unified data processing.