The Rise of the YAML Engineer - Declarative Paradigms in Data Systems
Explore the declarative paradigm in data frameworks, its impact on data practitioners, and the role of YAML. Dive into state management, GitOps, and the future of data engineering.
Harnessing WebAssembly for Real-time Stateless Streaming Pipelines
Explore WebAssembly's potential in revolutionizing real-time stateless streaming pipelines for Kafka, focusing on low-latency, high-volume data management.
Changes to Azure Synapse Analytics and Their Impact on Data Architecture Designs
Explore Azure Synapse Analytics' evolution and its impact on data transformation, storage, and querying methods to evaluate its suitability for your data environment.
Speeding Data Product Delivery from Model to Marketplace
Transform your data strategy into an executable program with a blueprint for successful implementation.
Democratizing Data with BigQuery and Data Mesh
Explore CNA's data transformation journey using BigQuery and data mesh to drive organizational value and close the data-to-value gap in uncertain times.
Build an Open Format Analytics and AI Lakehouse
Unlock data value with an analytics and AI lakehouse architecture, converging to a single platform for all workloads. Learn from Rakuten's CTO about their BigLake transformation.
How to Get Complex Data with Aggregation Pipeline in MongoDB
Mastering MongoDB's aggregation pipeline for complex data retrieval. Learn to filter, join, and reshape data efficiently using multiple stages and advanced techniques.
Best Practices for Data Preparation in Generative AI Development
Explore data preparation techniques for generative AI, covering quality, diversity, labeling, preprocessing, and optimization. Gain practical insights for enhancing model performance and accuracy.
Driving Data Transformation in the AI Era with Databricks and Microsoft Fabric
Explore data transformation challenges and solutions in the AI era, focusing on overcoming data silos, accelerating insights, and building critical foundations for AI ambition with Databricks and Microsoft Fabric.
dbt Cloud and AI - Where Transformation and Metadata Meet
Explore how dbt Cloud enhances Databricks transformations and enables AI-driven insights through accurate metadata and business context, reducing hallucinations in LLMs.
Revolutionizing Data Analysis - The Shift to Databricks and AtScale
Discover how Corning transformed data analysis using Databricks and AtScale, enhancing scalability, OLAP capabilities, and Excel integration for improved insights and decision-making.
End-to-End Modern Data Engineering with DBT and BigQuery
Master modern data engineering with DBT and BigQuery. Set up, link, transform data, convert tables to views, seed data, write tests, and generate documentation in this comprehensive tutorial.
Real-Time Data Transformation and Analytics with dbt Labs
Explore real-time data transformation and analytics with dbt Labs. Learn about Modern Data Stack, streaming analytics, and best practices for building efficient data pipelines and democratizing data access.
Billions of Records - The Real Success Story Using Microsoft Power BI Embedded
Learn to process and visualize billions of records efficiently using Azure Databricks, Azure Analysis Services, and Power BI Embedded. Explore architectural approaches, authentication, security, and best practices for handling big data.
Qlik Talend Cloud - AI-Assisted Data Engineering Overview and Demo
Discover how Qlik Talend Cloud revolutionizes data engineering with AI-assisted automation, no-code options, and advanced data integration capabilities for building robust, trustworthy data pipelines.
Introduction to Data Build Tool (DBT) - Features and Project Creation
Master data transformation techniques with DBT (Data Build Tool) to effectively analyze and engineer warehouse data through hands-on project creation and fundamental features.
DocETL: AI Agents for Complex Document Processing and Data Transformation
Discover how DocETL framework leverages AI agents and LLMs to transform complex document processing, featuring innovative operators and optimization techniques for enhanced data extraction and analysis.
Filling the Core Language Gaps - Proposed New Primitives in APL
Explore three proposed APL primitives enhancing function composition, generalization, and indexing, completing the language's core functionality.
Working with BigQuery and DataForm - Streamlining Data Management and Transformation
Streamline data management with BigQuery and DataForm. Learn setup, optimization, and automation for efficient, scalable data pipelines and transformations.
Data Preprocessing and Feature Engineering for Machine Learning
Master data preprocessing and feature engineering techniques for effective machine learning. Explore imputation, encoding, transformations, and more to maximize value from your data and improve model performance.
OpenLineage: An Open Standard for Data Lineage
Explore OpenLineage, an open framework for data lineage metadata collection. Learn its purpose, data model, and integration with tools like Apache Airflow and Spark to enhance pipeline understanding and management.