Introduction to Vector Search on Databricks
Explore vector search integration in Databricks for enhanced data retrieval. Learn fundamentals, implementation, optimization, and real-world applications to transform your data processes.
Eight Weeks, Two Developers, One Production AI Conference Assistant
Discover the journey of creating Brickbot, an AI assistant for DAIS '24. Learn about design decisions, technical challenges, and insights gained from real-world user interactions in this behind-the-scenes discussion.
Pandas and Dask DataFrame 2.0 - Comparison to Spark, DuckDB and Polars
Explore Dask DataFrame 2.0's improvements, comparing its performance to Spark, DuckDB, and Polars using TPC-H benchmarks. Learn about new features enhancing speed, efficiency, and usability in big data processing.
Python and SQL: Better Together, Powered by DuckDB
Explore DuckDB: A powerful database system integrating seamlessly with Python, offering efficient data processing and easy-to-use SQL capabilities for data scientists and analysts.
Speed is Not All You Need for Data Processing
Exploring data processing frameworks beyond Pandas, challenging assumptions about speed, and emphasizing practical considerations for choosing tools that best serve data practitioners.
Improving Kafka Performance: Switching from ext4 to XFS for 80% Faster Writes
Detailed analysis of Kafka performance optimization, exploring file system impact on latency. Covers Kafka internals, tracing, journaled file systems, and the switch from ext4 to XFS for 80% speed improvement.
Building an Exciting Stock Market Twitter Sentiment App
Develop a Twitter sentiment analysis app for stock market insights using SingleStore AI. Learn to integrate APIs, process real-time data, and create interactive visualizations.
Cloud Native Streaming and Event-Driven Microservices
Explore event-driven microservices and data processing pipelines using Spring Cloud Stream and Spring Cloud Data Flow. Learn to create scalable, cloud-native applications with live coding demonstrations.
Reactive Streams Principles Applied in Akka Streams
Explore Akka Streams and Reactive Streams principles for building responsive, resilient applications with non-blocking back pressure. Learn through real-life scenarios and practical demonstrations.
Fast Cars, Big Data - How Streaming Can Help Formula 1
Explore how data streaming technologies like Kafka and Apache Spark can revolutionize Formula 1 racing, enabling real-time analysis and visualization of car performance data from simulator to pit to HQ.
Kafka as a Platform - The Ecosystem from the Ground Up
Comprehensive exploration of Apache Kafka ecosystem: from basic concepts to advanced features, including topics, APIs, stream processing, and enterprise-grade capabilities.
Hyper Speed - When Big Data Blooms
Explore high-speed data processing techniques, focusing on Bloom Filters for efficient handling of massive data volumes in web security and content delivery applications.
Hyper Speed - When Big Data Blooms
Explore high-speed data processing techniques, including Bloom Filters, to handle massive volumes of telemetry data efficiently. Learn infrastructure strategies for processing 65,000 JSON payloads per second.
Calculating the Value of Pie - Real-Time Survey Analysis With Apache Kafka
Learn to create real-time survey bots using Apache Kafka® and ksqlDB. Explore data processing, schema usage, and Kafka architecture while building an interactive Telegram bot for pastry preference polling.
Practical Pipelines - A Houseplant Soil Alerting System with ksqlDB
Learn to build a houseplant monitoring system using Raspberry Pi, Apache Kafka, and ksqlDB. Explore event-driven pipelines, stream processing, and real-time alerts for practical home automation projects.
Count-min Sketch to Infinity - Using Probabilistic Data Structures to Solve Counting Problems in .NET
Explore probabilistic data structures like Count-Min Sketch, Bloom Filter, and HyperLogLog to efficiently solve counting problems in large-scale .NET applications.
An Introduction to Elasticsearch for .NET Developers
Discover how to leverage Elasticsearch in .NET applications using the Elasticsearch.NET client library. Learn indexing, searching, and core concepts to enhance your software with powerful search capabilities.
Tracking the Pandemic: Data Science and AI in Tackling Covid-19
Explore data science's role in tackling Covid-19, including smartphone tracking and AI research for crisis solutions, with Jon Crowcroft from the Alan Turing Institute.
Best Practices for Architecting Data Collaboration At-Scale Across Clouds, Regions, and Platforms
Explore best practices for large-scale data collaboration using Delta Sharing, covering replication strategies, security measures, D2O integration, and AI model sharing benefits across diverse platforms.
Building a State-of-the-Art Open-Source Model - DBRX Development Story
Discover the journey behind DBRX, Databricks' open-source foundation model. Learn tools, methods, and insights for building high-quality LLMs, with real-world examples and best practices from the development team.
Deep Dive into Delta Lake and UniForm on Databricks
Explore Delta Lake's architecture, innovations, and use cases for reliable data lake management. Learn how it enhances performance, governance, and quality across various industries.