Low-Latency & High-Concurrency Analytics Over Data Lakes
Explore advanced techniques for achieving low-latency, high-concurrency analytics on large-scale data lakes. Learn about optimized storage, indexing, and practical approaches to handle massive data volumes efficiently.
Large Scale Geospatial Indexing and Analysis on Apache Spark
Explore large-scale geospatial indexing and analysis using Apache Spark, covering challenges, frameworks, data structures, and practical applications in cloud-first architecture with Databricks.
Unsupervised Discovery of Temporal Sequences in High-Dimensional Datasets
Explore unsupervised discovery of temporal sequences in high-dimensional datasets using seqNMF, a tool extending convolutional NMF. Learn to extract and validate neural sequences from large-scale recordings.
What is Your Data Worth? Equitable Data Valuation in Machine Learning
Explore equitable data valuation in machine learning, focusing on Data Shapley Value and its applications in healthcare, face recognition, and NLP.
Delta Lake 2.0 Overview - New Features and Community Collaborations
Overview of Delta Lake 2.0 features, integrations, and community collaboration. Highlights include data skipping, Change Data Feed, column mapping, multi-cluster S3 writes, and support for various languages and platforms.
Gazelle-JNI: Offloading Spark SQL to Native Engines for Execution Acceleration
Explore Gazelle-Jni, a middle layer integrating native SQL engines with Spark SQL for accelerated execution through Substrait-transformed physical plan offloading.
Democratizing Metrics at Airbnb - Minerva Platform Architecture and Future Plans
Explore Airbnb's Minerva platform for data consistency at scale, architectural improvements for flexibility, and plans for open-sourcing this centralized metrics solution.
Enable Production ML with Databricks Feature Store
Simplify production ML with Databricks Feature Store. Learn to overcome data challenges, enable real-time inference, and streamline ML projects using a unified data lakehouse platform integrated with Apache Spark and MLflow.
Delta Live Tables: Modern Software Engineering for ETL Pipelines
Learn how Delta Live Tables simplifies ETL, enhances data pipeline reliability, and automates tasks. Discover modern software engineering practices for efficient data transformation and improved analytics, data science, and ML outcomes.
DataFusion and Apache Arrow: Supercharging Data Analytics with a Rust-Based Query Engine
Explore Rust, Apache Arrow, and DataFusion to accelerate modern data stacks. Learn implementation timelines, optimization techniques, and key features for efficient data analysis and querying.
Intermittent Demand Forecasting at Scale Using Meta-Modeling - Deep Auto-Regressive Linear Dynamic Systems
Discover Walmart's innovative solution for predicting demand of slow-moving items using meta-modeling, combining linear dynamic systems and deep auto-regressive networks for accurate forecasts across thousands of SKUs and stores.
Databricks and Enterprise Observability with Overwatch - Understanding Cost, Utilization, and Workloads
Explore Overwatch's capabilities for monitoring Databricks platform costs, utilization, and workloads. Learn implementation, use cases, and solutions to common observability challenges.
Cloud Fetch: High-Bandwidth Connectivity for BI Tools - Databricks
Explore high-bandwidth connectivity for BI tools using Cloud Fetch, a parallel data extraction mechanism that significantly speeds up query result retrieval from Databricks SQL endpoints.
Recent Parquet Improvements in Apache Spark - Vectorized Complex Types and Column Index Support
Explore recent improvements in Apache Spark's Parquet performance, including vectorized read support for complex types and column index support, leading to significant speed enhancements and efficient data processing.
An Introduction to Open Source Presto
Explore Presto, a distributed SQL engine for data lake analytics. Learn its features, benefits, and use cases through an introduction and demo on AWS implementation.
Time Series Forecasting with PyCaret
Explore automated time series forecasting with PyCaret's low-code module. Learn setup, EDA, training, and forecasting techniques to streamline your predictive modeling workflow.
NBA Analytics - Evolution and Impact in Professional Sports
Explore the evolution of sports analytics in the NBA, its impact on teams, and how data drives competitive advantage in professional basketball.
Scaling XGBoost for Thousands of Features with Databricks
Scaling XGBoost for online advertising: Learn to handle thousands of features, optimize model training, and avoid common pitfalls in both Python and Scala implementations on Spark.
Databricks University Alliance: Teaching with Databricks - Community Lightning Talks
Professors share experiences using Databricks in classrooms, covering course content, platform setup, and key observations. Insights from diverse universities on teaching data science and analytics with Databricks.
Discover the Data Lakehouse: Simplifying Data Architecture for Analytics and ML
Explore the data lakehouse architecture for managing massive data, supporting diverse analytics and ML requirements across multi-cloud environments, and enabling data teams to derive value efficiently.
Solving Business Problems with Data - Delivering Value Through Use Case Deconstruction
Explore strategies for aligning data teams with business goals, focusing on use case deconstruction and value delivery. Learn to bridge the gap between technical expertise and practical business impact.