Cloud-Native Solutions and Practices for Clickstream Data Analysis
Construye un sistema de análisis de datos de flujo autónomo y rentable utilizando prácticas nativas de la nube y Apache Kafka para optimizar productos y potenciar el crecimiento empresarial.
Security Data Science Teams: A Guide to Prestige Classes
Explore data-driven security roles, their overlapping skills, and career paths in this talk on the evolving landscape of security data science teams and job titles.
How Data Teams Can Contribute to Data Privacy
Explore global data privacy regulations, dispel misconceptions, and learn advanced techniques for privacy-aware systems in data engineering and management.
Reinventing ETL for Detection and Response Teams
Explore innovative strategies for efficient, cost-effective data collection and log enrichment tailored to Detection and Response teams' unique requirements in cybersecurity.
AI-Powered EDR: Streamlining Blackberry Cybersecurity with Databricks
Discover how Databricks optimized Blackberry's EDR system, improving incident detection speed, reducing query latency by 20%, and cutting costs by 30% while enhancing data management and cybersecurity capabilities.
Ensuring GDPR Compliance for Real-Time Data Pipelines
Strategies for GDPR compliance in real-time data pipelines using Databricks tools. Covers immediate solutions with Delta Lake's CDF and long-term plans for PII separation, offering practical privacy compliance approaches.
Impersonation in Data Engineering: No More Credentials in Your Code
Discover how to streamline data engineering workflows using IAM, Workload Identity, and impersonation. Eliminate credential hassles, improve security, and boost productivity in your development process.
Empowering Women in Data - Navigating Challenges, Seizing Opportunities
Explore strategies for women to thrive in data, gain insights on inclusivity initiatives, and learn from success stories in the field.
The Challenges of Engineering Data Science
Explore the unique challenges and perspectives of engineering in data science through insights from industry experts.
Accelerating Data and AI with Spice.ai Open-Source Software
Discover how Spice.ai's open-source software accelerates data and AI development, exploring innovative approaches to streamline machine learning workflows and enhance database integration.
The Evolution of Data Infrastructure in the Age of LLM
Explore how Large Language Models are reshaping modern data infrastructure, examining key architectural changes and emerging best practices for scalable AI systems.
Supercharging ETL and Analytics with Ray and Daft
Discover how Daft library enhances Ray clusters with distributed ETL capabilities, enabling seamless data processing, analytics, and ML/AI integration for scalable, high-performance workflows.
BODi's Data Modernization Journey - Implementing Cloud Data Warehouses with Snowflake
Discover how BODi modernized their data infrastructure by implementing Snowflake cloud warehouses, integrating siloed systems, and managing a complex 18-month migration of tables, pipelines, and applications.
ETL with Meltano and Singer in the LLM Era
Explore how traditional ETL tools like Singer and Meltano can enhance data pipeline management for LLM applications, addressing production-level challenges beyond basic LangChain capabilities.
Real-Time Revolution: Kickstarting Your Journey in Streaming Data
Dive into stream processing fundamentals and learn to build real-time data applications using Python's Bytewax framework, debunking common misconceptions along the way.
Unlocking Scalable and Efficient Data Storage with Apache Ozone
Discover how Apache Ozone revolutionizes distributed object storage, offering scalable solutions for managing massive data volumes while ensuring reliability, cost-effectiveness, and seamless integration with Hadoop ecosystem.
Data Alchemy: Transforming Raw Data to Gold with Apache Hudi and DBT
Discover how to build efficient medallion architecture using Apache Hudi's CDC feature and DBT for incremental data processing, enabling low-latency analytics and streamlined data transformation workflows.
Navigating the Landscape of a Fully Open Source Data Stack in 2023
Explore the architecture of modern data stacks, from warehousing to streaming solutions, while understanding the potential and limitations of open-source tools in today's data infrastructure.
Building a ChatGPT Data Pipeline with RisingWave Stream Processor and Astra Vector Search
Discover how to build real-time GenAI pipelines by combining RisingWave's stream processing with Astra's vector embedding and similarity search capabilities for ChatGPT applications.
Where the Modern Data Stack Has Failed and Why Engineering-centric Tools Will Reshape the Data World
Explore how engineering-focused tools like DuckDb, SDF, and Dagster are reshaping data engineering, addressing limitations of the modern data stack, and enabling more scalable, programmable solutions.
Unveiling the Power of dbt and DuckDB - Hype vs Reality
Explore the practical applications and limitations of combining dbt and DuckDB for data transformations, examining real-world use cases and performance considerations.