A Holistic Approach to Securing Spark-Based Data Engineering
Learn to secure Apache Spark-based data engineering applications. Explore security best practices, identify threats, prioritize requirements, and implement practical steps for Kubernetes and object storage environments.
A Data Lake on Your Cloud with Spark, Kubernetes and OpenStack
Explore data lake architecture using Spark, Kubernetes, and OpenStack for flexible, scalable, and cost-effective large-scale data processing on private cloud platforms.
Functional Programming and Scala for Machine Learning - YOW! 2015
Explore how functional programming and Scala can revolutionize machine learning, offering strongly-typed solutions for efficient algorithm implementation and scalable data processing.
Streaming Data Pipelines From Supernovas to LLMs
Hands-on tutorial for building real-time data pipelines using Databricks, from ingesting NASA supernova data to implementing LLMs with RAG. Covers ETL, stream processing, and natural language analytics.
AT&T's Journey Towards a Serverless Data Intelligence Platform
Explore AT&T's evolution on Databricks Platform, scaling data projects with automated pipelining, serverless SQL warehouses, and AI/ML use cases while meeting security and regulatory requirements.
Spark RAPIDS ML - GPU Accelerated Distributed Machine Learning in Spark Clusters
GPU-accelerated machine learning in Spark using RAPIDS ML, offering significant speedup and cost savings over traditional MLlib implementations for large-scale distributed ML applications.
How to Make Money Betting on NBA Using Rocket Science
Explore how Kalman filters, used in rocket science, are applied to NBA betting predictions. Learn about DraftKings' data-driven approach to generate accurate probabilities for bookmaking.
From Excel to Real-Time Insights Using Databricks, ThoughtSpot and Power BI
Transforme relatórios estáticos em insights em tempo real usando Databricks, ThoughtSpot e Power BI. Aprenda a construir uma plataforma de análise avançada para capacitar gerentes e analistas com dados atualizados.
How to Migrate from Snowflake to an Open Data Lakehouse Using Delta Lake UniForm
Explore Delta Lake UniForm's ability to create a single data set accessible across multiple open table formats, enhancing data lakehouse architecture efficiency and flexibility.
Automating Spark Upgrades and Migrations at Netflix
Learn techniques for automating Apache Spark upgrades and migrations, including open-source tools for code rewriting, production testing, and job tracking. Discover strategies for seamless upgrades and pipeline validation.
Delta Lake 4.0 and Beyond - New Features and Future Developments
Explore the latest features of Delta Lake 4.0, the unified storage layer for data lakehouses, and get insights into its future developments from Databricks experts.
Data Evolution at Inari - Harnessing Delta Live Tables and Unity Catalog
Explore Inari's journey in adopting Databricks, implementing Delta Live Tables, and leveraging Unity Catalog for efficient data management in sustainable agriculture.
Capital One's Data Innovation Strategy - You Build, Your Data (YBYD)
Capital One's cloud-based data ecosystem enables self-service innovation for 13,000+ technologists. Learn about their "you build, your data" strategy, enterprise data platforms, and best practices for leveraging data at scale.
Building a Multi-Petabyte Data Platform on Delta Lake at Zalando
Zalando's journey transforming multi-petabyte data platforms: challenges, strategies, and lessons learned in migrating to modern data-mesh architectures using Databricks and AWS ecosystems.
Neuralake - Complex Data, Simple Systems
Explore Neuralake: a multimodal data lake for managing complex neural data. Learn about its Rust-based stack, real-time ingestion, and scalable architecture for efficient data access and retrieval.
Effective Lakehouse Streaming with Delta Lake
Discover the power of streaming lakehouse architecture, achieving success at scale with Delta Lake as the key to a consistent data foundation and stress-free data ecosystem.
How DLT Stretched CDC Capabilities and Kept ETL Limber at Hinge Health
Explore how Hinge Health optimized CDC architecture using Delta Live Tables, enhancing data reliability and scalability for their digital MSK clinic while reducing costs and meeting SLAs.
New Features of Apache Spark 3.5 - In-Depth Analysis
Explore Apache Spark 3.5's advancements: Spark Connect, DeepSpeed integration, performance optimizations, new PySpark and SQL features for enhanced big data processing and AI capabilities.
Real-time Omnichannel Banking with Delta Live Tables, Databricks SQL and PowerBI
Explore real-time analytics in banking using Delta Live Tables, showcasing Navy Federal's approach to member personalization, data quality, and scalable pipelines for omnichannel experiences.
Introducing Data Intelligence to Delta Lake with DatabricksIQ
Explore DatabricksIQ's AI-powered optimizations for Delta Lake tables, including Predictive Optimization and Liquid Clustering, to enhance performance and efficiency without manual tuning.
Delta Lake Meets DuckDB via Delta Kernel
Explore Delta kernel rust's integration with DuckDB, enhancing Delta support in third-party connectors. Learn about architecture, implementation, and performance through demos and benchmarks.