State Reader API: The New "Statestore" Data Source for Structured Streaming
Explore Databricks' State Reader API for accessing and analyzing Structured Streaming's internal state data, aiding development and troubleshooting of stateful workloads in Apache Spark 4.0.0.
Delta Lake for Polyglot Data and Machine Learning Workloads
Explore Delta Lake's power for data streams, analysis, and ML workloads. Learn about data quality monitoring, efficient job management, and leveraging Delta for auto-ML models and Spark Structured Streaming.
Streamlined Monitoring of Databricks Workflows with Deloitte
Discover Deloitte's Automated Workflow Monitoring solution for Databricks, offering streamlined tracking of data engineering pipeline statuses with minimal overhead and a simplified view, built on Databricks' SDK and SQL dashboards.
GenAI-Enabled Co-Pilots for Data Management on Databricks Platform
Explore how GenAI co-pilots accelerate data modernization for enterprises, enhancing efficiency in data management and operations while maintaining value in strategic transformations.
Delta Tensor: Efficient Vector and Tensor Storage in Delta Lake
Efficient tensor storage solution for machine learning workflows, using chunking and sparse encoding to reduce IO costs and improve storage efficiency in cloud-native Lakehouse environments.
Transforming Legacy Reporting to Cloud-Based BI Applications
Streamlining 900+ legacy reports into a centralized cloud-based metric hub for TD's Personal Banking, enhancing data governance and cost-efficiency while providing a single source of truth.
Developing Data Pipelines with Branch Deployments - A New Approach
Explore a new approach to data pipeline development using branch deployments, enabling safer testing on production data and improving productivity, data reliability, and cost-efficiency.
Architecture Analysis for ETL Processing - CPU vs GPU
Explore GPU acceleration for ETL operations, comparing CPU and GPU architectures. Learn about performance gains in database operations and SQL query acceleration using GPUs.
Driving Data Transformation in the AI Era with Databricks and Microsoft Fabric
Explore data transformation challenges and solutions in the AI era, focusing on overcoming data silos, accelerating insights, and building critical foundations for AI ambition with Databricks and Microsoft Fabric.
Efficient Near Real-Time Event Ingestion using DLT - Insights and Lessons
Explore Nextdoor's shift to near-real-time streaming with DLT, enabling quick event querying for analysis and monitoring while reducing costs. Learn about challenges, lessons, and optimization techniques.
Integrating Informatica Cloud Data Integration with Databricks Unity Catalog
Integrate Informatica Cloud with Databricks Unity Catalog for enhanced data quality, lineage tracking, and analytics. Learn to configure Databricks connectors in Informatica for seamless data ingestion and transformation.
Transforming Talent - Unilever's Data-Driven Success with Databricks Training
Unilever's data-driven success story: fostering innovation, collaboration, and continuous learning with Databricks. Thousands of active users and hundreds of certified professionals driving customer value through data excellence.
Fabricator - Streamlining Declarative Feature Engineering at DoorDash
Découvrez comment DoorDash a développé Fabricator, un framework complet pour rationaliser l'ingénierie des caractéristiques déclaratives, orchestrant efficacement 1400 tâches quotidiennes et gérant 2,2 billions de valeurs.
Databricks Vector Search - What, Why and How
Explore Databricks Vector Search for enhancing GenAI applications with semantic search capabilities, addressing challenges in scalability, accuracy, and production deployment.
Taking Good Flight with Reliable Data at American Airlines
American Airlines' data modernization journey: Enhancing efficiency, scalability, and reliability through cloud transition and data observability, leading to reduced downtime and faster insights for the world's largest airline.
Unlocking the Lakehouse with Efficient Data Pipelines - Capital One's Journey
Explore Capital One's data-driven transformation using Databricks Lakehouse, featuring efficient data pipelines, Delta Lake, and best practices for building a centralized data ecosystem.
Introducing the New Python Data Source API for Apache Spark
Simplify big data processing with Python in Apache Spark™. Learn key features of the new Data Source API, enabling custom data source implementation without Scala knowledge. Discover benefits for Python developers in Spark ecosystem.
dbt Cloud and AI - Where Transformation and Metadata Meet
Explore how dbt Cloud enhances Databricks transformations and enables AI-driven insights through accurate metadata and business context, reducing hallucinations in LLMs.
Power Up Your Lakehouse with Git Semantics and Delta Lake
Enhance data versioning in lakehouses using Delta Lake and lakeFS, enabling git-like semantics for improved time travel, data quality, and operational economics.
Empowering Marketing through Data Sharing with Twilio Segment and Databricks
Explore real-time data pipelines and customer data platforms to enhance marketing capabilities, drive customer behavior, and deliver actionable insights for improved customer experiences.
Tools for Improving the Developer Experience in Databricks
Discover time-saving tools for Databricks ecosystem development: SDKs, CLI, Asset Bundles, and VS Code integration. Streamline your workflow from development to production.