Flappybird Game and Real-Time Data Pipeline Workshop - Tinybird
Build a real-time data pipeline for Flappybird's leaderboard. Capture in-game events, stream data, and create REST APIs while enhancing SQL skills in this hands-on workshop.
Building a Reliable, Secure and Efficient Event Ingestion Pipeline
Explore challenges in data pipelines, from client interactions to backend complexities. Gain insights into building reliable, secure, and efficient event ingestion systems.
Orchestration of Data Pipelines Using Airflow
Learn to orchestrate data pipelines with Airflow, integrating various operators like Bash, Python, Spark, Email, and Slack for efficient workflow management and automation.
Build Continuous Data and AI Pipelines with BigQuery Continuous Queries
Revolutionize data engineering with BigQuery continuous queries for real-time AI insights. Explore event-driven pipelines using Vertex AI, Pub/Sub, and Bigtable through Cloud SQL.
Optimizing BigQuery Operations for Large-Scale Data Management
Harness BigQuery for robust data-driven culture, processing petabytes daily. Learn strategies to boost efficiency and cost-effectiveness for large-scale operations.
Orchestrating Generative AI with Workflows
Explore orchestrating generative AI calls using Workflows, with a demo on parallelizing AI for summarizing large text volumes efficiently.
Real-Time Machine Learning: Features and Inference - MLOps Podcast #135
Explore real-time ML features and inference with LinkedIn experts. Gain insights on implementation, challenges, and best practices for moving from batch to interactive near real-time machine learning.
Eliminating Garbage In/Garbage Out for Analytics and ML
Discover strategies to eliminate bad data at the source, improve data quality ownership, and enhance observability in Analytics/ML stacks. Learn from experts in data engineering and product management.
The Rise of Modern Data Management - MLOps Podcast #226
Explore modern data management practices, including data contracts and observability, to improve handling and decision-making in the age of AI and cloud computing.
Knative and Kafka - The Superheroes in Event-Driven Architecture
Explore event-driven architectures with Knative Eventing and Apache Kafka. Learn key concepts and see a live demo of a customer review moderation pipeline with AI/ML integration.
Cruise.data - A New Dataset Processing Pipeline for Cruise ML
Explore Cruise.data, a novel ML data pre-processing framework combining tf.data, PyTorch, and large-scale processing capabilities for efficient and scalable dataset handling in autonomous vehicle development.
Using Julia as Part of an Anomaly Detection Pipeline
Explore Julia's role in anomaly detection pipelines, integrating data analysis, algorithm development, and real-time processing with Java-based web applications for efficient business solutions.
Databricks Asset Bundles: A Unifying Tool for Deployment
Explore Databricks Asset Bundles (DABs) for streamlined data project management. Learn core concepts, best practices, and deployment patterns using Databricks CLI, with real-world examples and future integrations.
Pivot Bio's Spatial Analytics Evolution with Databricks and CARTO
Explore how Pivot Bio revolutionizes agricultural analytics using Databricks and CARTO, integrating diverse datasets for comprehensive farming insights and empowering spatial analysis in modern agriculture.
Lakehouse Monitoring - Profiling, Diagnosing, and Enforcing Data Quality with Intelligence
Discover how Databricks Lakehouse Monitoring enhances data pipeline and ML model oversight, ensuring quality and governance for a self-serve data platform through continuous assessment and intelligent issue prevention.
Automating Spark Upgrades and Migrations at Netflix
Learn techniques for automating Apache Spark upgrades and migrations, including open-source tools for code rewriting, production testing, and job tracking. Discover strategies for seamless upgrades and pipeline validation.
Introducing Databricks' New Native Ingestion Connectors
Explore Databricks' new native ingestion connectors for SaaS apps, databases, and file sources. Learn about auto-optimized, low-maintenance solutions integrated with Data Intelligence Platform features.
Real-time Omnichannel Banking with Delta Live Tables, Databricks SQL and PowerBI
Explore real-time analytics in banking using Delta Live Tables, showcasing Navy Federal's approach to member personalization, data quality, and scalable pipelines for omnichannel experiences.
Rise of the Medallion Mesh - Innovative Data Architecture Solutions
Explore innovative data architecture solutions combining Medallion and Data Mesh patterns to enhance productivity, democratize data access, and ensure scalable, efficient data management in large organizations.
Accelerating Operational Excellence with Generative AI - Implementing RAG for Customer Service Efficiency
Discover how a financial company implemented RAG to enhance customer service, exploring architecture, data pipelines, innovations, and optimization strategies for transforming operations with Generative AI.
What's New in Databricks Workflows - with Live Demos
Explore latest Databricks Workflows features: enhanced orchestration, run repairs, control flow, scheduling, and Python authoring. Live demos showcase innovations for ETL, analytics, and ML pipeline management.