Learning Agents for Games using Databricks
Accelerate reinforcement learning for games with Databricks' advanced analytics, collaborative tools, and rapid deployment capabilities.
DataDevOps for the Modern Data Warehouse on Microsoft Azure
Explore DevOps principles for Big Data Analytical Pipelines using Azure Data Platform, including Data Factory, Databricks, and Data Lake Gen2. Learn to build and operationalize multi-source Modern Data Warehouses.
From ETL to Data Engineering with Azure Data Factory
Explore modern Azure Data Factory features for efficient, scalable data pipelines. Learn parameterization, dynamic workflows, and integration with Azure Databricks for cloud-native ETL solutions.
An Azure Data Engineer's ETL Toolkit
Explore Azure's data movement and transformation options, comparing SSIS with Data Factory, Databricks, and Logic Apps. Learn ETL patterns and Data Flow features for scalable cloud migration.
Hidden Differences Between Azure ML Products Revealed
Explore Azure ML products, their differences, and use cases. Learn to create end-to-end ML workflows, integrate with SQL Server, and manage models in production using various Azure tools.
Data Warehousing - Which of the Many Cloud Products is the Right One for You
Explore cloud-based data warehousing options, comparing Snowflake, Databricks, and Azure solutions. Learn to choose the best fit for your environment based on size, architecture, and unique features.
Data Analysis with Spark and Databricks in Azure Synapse
Comparing Spark and Databricks in Azure Synapse: use cases, costs, data types, processing volumes, and implementation demos. Learn when to choose Spark-based tools vs. alternatives like SQL on-demand or ELT.
Processing and Storing Time Series Instrument Data with Pandas and PySpark
Master data processing techniques for handling large-scale time series instrument data using pandas and PySpark, focusing on efficient solutions for scientific and laboratory information management challenges.
Secure and Efficient Data Sharing with Federated Cloud Storage
Discover how to build a virtual data lake system using federated cloud storage, focusing on secure data sharing between enterprises through metadata management and integration of open-source tools.
Creating Your AI/BI Genie Space for Business Data Analytics
Discover how to empower business teams with AI/BI Genie - a conversational interface that enables natural language data exploration and self-service analytics for instant insights.
Databricks Distributed File System (DBFS) vs Local Files on Spark Cluster Driver Node
Understand the key differences between Databricks File System (DBFS) and local driver node storage, exploring distributed storage capabilities and FUSE mount implementation for cloud data access.
Lakehouse Architecture with Delta Lake and Databricks
Dive into Lakehouse architecture fundamentals, exploring Delta Lake format and Databricks platform implementation for modern data management and analytics solutions.
Machine Learning in Production on Databricks - Deployment and Monitoring Best Practices
Discover practical strategies for deploying ML models in production using Databricks, covering CI/CD integration, monitoring best practices, and real-world implementation challenges.
How to Improve LLM Factual Accuracy and Reliability
Explore techniques for improving LLM factual accuracy, including DSP framework and MLflow LLMOps tools, to create reliable AI applications for production use.
Data Governance with Unity Catalog
Explore Databricks Unity Catalog's unified governance solution for data and AI on the lakehouse, enabling secure discovery, access, and collaboration across clouds.
Cloud Storage Infrastructure for Data-Intensive Workloads - Featuring Flipkart and Databricks
Optimize data-intensive workloads with Cloud Storage. Learn from Flipkart's experience and explore Databricks integration for scalable, secure, and cost-effective data lakes.
MLOps with MLflow - Creating Execution Pipelines Using Projects and Databricks
Explore MLflow Projects to create execution pipelines locally and leverage Databricks for tracking and artifact storage in machine learning workflows.
ML and MLOps: Databricks Secrets and Integration with Azure KeyVault
Explore Databricks Secrets and Azure KeyVault integration for secure ML & MLOps workflows in data science and machine learning projects.
Towards Multi-Table Transactions in Delta Lake
Explore managed-commits in Delta Lake: a new protocol enabling multi-table transactions, reliable commit semantics, and enhanced data governance for cloud storage-based data lakes.
State Reader API: The New "Statestore" Data Source for Structured Streaming
Explore Databricks' State Reader API for accessing and analyzing Structured Streaming's internal state data, aiding development and troubleshooting of stateful workloads in Apache Spark 4.0.0.
Many Model Forecasting in Real-Time with Databricks Online Store
Learn real-time forecasting techniques using Spark, Delta, and Databricks' latest features. Explore model fitting, monitoring, and serving strategies for efficient, large-scale predictions across various scenarios.