Dataproc Persistent History Server: Up and Running
Learn to access and troubleshoot Hadoop and Spark application logs using Persistent History Server for ephemeral clusters and Dataproc Serverless, enhancing job monitoring and exploration capabilities.
BigQuery Vector Search and Embedding Generation for Semantic Analysis
Unlock semantic search with BigQuery: transform unstructured data into embeddings, enabling powerful analysis and connections beyond traditional keyword searches.
AI: The Future of Data Analytics Ecosystem in the World of GenAI
Explore the impact of Generative AI on data analytics ecosystems, discussing trends, applications, and future developments in enterprise use cases.
Data and AI Strategy in the Era of GenAI
Explore the convergence of Data Analytics and AI in the era of GenAI. Learn about trends, challenges, and opportunities in this rapidly evolving field, with insights from Google Cloud experts.
Cross-Cloud Analytics Workloads with BigQuery Omni and Looker
Leverage BigQuery and Looker for cross-cloud analytics, enabling real-time insights and smarter business decisions without infrastructure management or capacity concerns.
Exploring Google Cloud's Data and AI Foundation
Discover Google Cloud's data and AI advantages, including Generative AI integration, infrastructure benefits, and real-time data matching across structured and unstructured sources.
Building Next-Generation Data Pipelines with Containers - Fast Track to Modernization
Build efficient, scalable data pipelines using containers. Learn to leverage Cloud Run for streaming, batch, and on-demand data processing, enhancing your business's data management capabilities.
Cloud Storage Infrastructure for Data-Intensive Workloads - Featuring Flipkart and Databricks
Optimize data-intensive workloads with Cloud Storage. Learn from Flipkart's experience and explore Databricks integration for scalable, secure, and cost-effective data lakes.
Build an Open Format Analytics and AI Lakehouse
Unlock data value with an analytics and AI lakehouse architecture, converging to a single platform for all workloads. Learn from Rakuten's CTO about their BigLake transformation.
Monitoring LLMs in Production: Beyond the Hype - Part 2
Explore techniques for monitoring and measuring drift in unstructured data models, focusing on vector/embedding drift for image and language models in production environments.
Bringing Structure to Unstructured Data with an AI-First System Design
Explore AI-powered data systems for unstructured content, addressing challenges and sharing key lessons for end-to-end applications in enterprise environments.
Productionizing Health Insurance Appeal Generation - AI in Production
Explore fine-tuning models for health insurance appeals, cloud resource utilization, and on-premises Kubernetes deployment. Learn about unexpected challenges in server setup and graphics card installation.
MLOps with MLflow - Creating Execution Pipelines Using Projects and Databricks
Explore MLflow Projects to create execution pipelines locally and leverage Databricks for tracking and artifact storage in machine learning workflows.
Pandas Parallel Transformations with Dask and Pandarallel
Optimize data processing with Dask and Pandarallel for faster Pandas transformations. Learn parallel computing techniques to enhance performance.
ML and MLOps: Databricks Secrets and Integration with Azure KeyVault
Explore Databricks Secrets and Azure KeyVault integration for secure ML & MLOps workflows in data science and machine learning projects.
Effortless Change Data Capture with Debezium and Kubernetes
Harness the power of Change Data Capture in Kubernetes using Debezium. Learn to track, stream, and deploy real-time database changes efficiently for data-driven applications.
Apache Kafka Real-Time Personalization Architecture
Explore real-time personalization architecture using Apache Kafka and Spark for advanced content recommendation systems in data engineering and AI.
Inside Spark and Kafka: Data Processing and Real-Time Analytics - Episode 1
Explore Charmed Spark and Kafka: Canonical's solutions for Apache Spark and Kafka on Kubernetes. Discover industry trends, real-time applications, and data processing innovations.
μSlope - High Compression and Fast Search on Semi-Structured Logs
Innovative system for compressing and searching semi-structured log data, offering superior compression ratios and faster search speeds compared to existing solutions for managing large-scale log datasets.
Data Caching for Enterprise-Grade Petabyte-Scale OLAP
Explores Alluxio local cache for petabyte-scale OLAP, optimizing data transfer efficiency in decoupled compute-storage models. Shares insights from Uber and Meta deployments.
Towards Multi-Table Transactions in Delta Lake
Explore managed-commits in Delta Lake: a new protocol enabling multi-table transactions, reliable commit semantics, and enhanced data governance for cloud storage-based data lakes.