What's New in Databricks Workflows - with Live Demos
Explore latest Databricks Workflows features: enhanced orchestration, run repairs, control flow, scheduling, and Python authoring. Live demos showcase innovations for ETL, analytics, and ML pipeline management.
Bringing Text-to-SQL to Business Intelligence Production in Large Enterprises
Explore Text-to-SQL implementation in large enterprises, focusing on model selection, fine-tuning, and performance optimization for accurate natural language querying in business intelligence contexts.
Unlock Data and AI Potential with a Fully Orchestrated Health Lakehouse
Explore how a modern healthcare data lakehouse integrates diverse data sources, leveraging AI and orchestration for improved patient care, risk management, and clinical decision support.
GenAI Pipelines: From Data Exploration to Prototype to Production
Explore building GenAI data pipelines using PyAirbyte and ELTP framework. Learn efficient data sourcing, prototype-to-production steps, and strategies for managing LLM documents in the GenAI era.
Modernizing Data Pipelines with Databricks - IAS Journey
Discover how IAS modernized data pipelines using Databricks, migrating from Airflow to Workflows, implementing Data Mesh, and leveraging Unity Catalog for seamless data sharing and improved decision-making.
Drastically Reducing Processing Costs with Delta Lake
Optimize data pipelines using Delta Lake features on Databricks. Learn techniques to address read-write amplification, improve performance, and reduce costs in large-scale data processing.
Building a Modern Marketing Team with Machine Learning and Databricks
Discover how Rogers leverages ML and Databricks to revolutionize marketing, featuring a reusable framework for data science across industries and insights on implementing key marketing models.
Trek Bikes Accelerates Retail Analytics with Databricks
Trek Bikes optimizes retail analytics using Databricks, achieving near real-time data integration, 80-90% faster analytics, improved data accessibility, and cost reduction through innovative lakehouse architecture.
Optimizing MERGE Performance Using Liquid Clustering and Photon
Explore techniques to enhance MERGE operations using Liquid Clustering, Deletion Vectors, and Predictive I/O for Updates, improving performance and predictability in Delta Lake and Photon.
Databricks SQL - Addressing Data Warehousing Challenges with Data Intelligence
Explore AI-powered data warehousing with Databricks SQL, addressing performance, governance, and usability challenges through intelligent data understanding and innovative features like natural language queries.
Lessons Learned from Migrating the Largest Immunization Analytics Platform
Insights from migrating a massive immunization registry to Databricks, covering data understanding, file structure impact, compute requirements, and workflow optimization for healthcare analytics.
Scalable Data Pipelines for ML - Integrating Argo Workflows and dbt
Discover how to build scalable ML data pipelines by integrating Argo Workflows and dbt. Learn to handle large datasets, optimize infrastructure, and enhance ML project efficiency through robust ELT processes.
Getting in the Weeds with Time-Series Databases for AI
Explore integrating time-series databases and tools like InfluxDB 3.0 and Bytewax to develop AI-driven applications for effective real-time data capture and management.
Making Sense of Unstructured Data with AI
Explore AI-powered techniques to extract, analyze, and utilize information from unstructured data formats using Azure Cognitive Services and Search for intelligent application experiences.
Deep Dive into Delta Lake and UniForm on Databricks
Explore Delta Lake's architecture, innovations, and use cases for reliable data lake management. Learn how it enhances performance, governance, and quality across various industries.
Building Your Own ChatGPT-style LLM AI Infrastructure with Kubernetes
Explore building AI infrastructure with Kubernetes, covering open-source LLMs, data engineering, and cost optimization. Gain insights on deployment, scalability, and choosing the right tools for AI-enabled applications.
Fall in Love with Data Transformation - Using DBT for Effective Data Workflows
Master data transformation with DBT, exploring its integration with SQL and Python. Learn fundamental use cases and workflows to streamline data processes and enhance efficiency in modern data engineering practices.
Airflow's Limitations for MLOps - Challenges and Alternatives
Explore challenges in MLOps, data platforms, and Airflow with Stephen Bailey. Gain insights on modular job design, data classification, and practical approaches to data engineering and machine learning workflows.
Applying DevOps Practices in Data and ML Engineering
Explore DevOps practices in data and ML engineering. Learn to create efficient data pipelines using Versatile Data Kit. Gain insights on automating development processes and abstracting data journeys for agile, quality-focused data engineering.
Building a High-Performance Real-Time Analytics Database with Apache Kafka and Druid
Master building a real-time analytics database using Apache ecosystem tools including Kafka, Druid, and Superset. Learn data streaming, processing, and containerization with hands-on implementation.
Modular Solutions for Knowledge Management at Scale in RAG Systems
Discover how to build scalable RAG systems with modular document embedding pipelines, focusing on efficient processing, ingestion, and indexing for enterprise-level knowledge management.