Designing Streaming Data Pipelines: Best Practices - Cloud Native 2024
Explore best practices for designing streaming data pipelines, covering key concepts, challenges, and considerations for scalability in cloud-native environments.
Empowering Fearless Data Engineering with Rust
Explore Rust's impact on data engineering, focusing on performance, safety, and real-time analytics applications. Learn advantages and future prospects of Rust in the field.
The Streaming Plane - Bridging Operational and Analytical Data
Explore the streaming plane concept, data gravity, and efficient data movement strategies for platform engineering. Learn about synchronous vs asynchronous serving and optimizing global data replication.
Building Modern Data Streaming Apps with Python
Explore modern data streaming app development using Python, focusing on key benefits and unique aspects of building efficient, scalable applications.
FLiPN Stack for Edge AI - Flink, NiFi, Pulsar
Explore FLiPN Stack for Edge AI: Learn about Flink, NiFi, and Pulsar integration for efficient data processing and streaming in IoT environments.
Simplifying Kafka Governance for Developers
Explore Kafka governance simplification using Klaw. Learn about architecture, approval processes, and practical demonstrations for efficient Kafka management in DevSecOps environments.
Pushing Your Streaming Platform to the Limit - Conf42 Chaos Engineering 2024
Explore streaming platform benchmarking techniques, including key criteria, USE method, and OpenMessaging initiative. Learn to assess limits and gain valuable insights for optimizing performance.
Apache NiFi, Kafka, RisingWave, and Iceberg for Stock Data Processing with LLM - Conf42 Python 2024
Explore stream processing with Apache NiFi, Kafka, RisingWave, and Iceberg. Learn real-time analytics, event-driven applications, and integrating stock data with LLMs in this comprehensive overview.
Sketching Algorithms: Making Sense of Big Data in a Single Stroke
Explore sketching algorithms for efficient big data processing, covering concepts, design principles, and practical applications using open-source tools like Apache DataSketches.
Building Apache NiFi 2.0 Python Processors - Conf42 Python 2024
Explore Apache NiFi 2.0 Python processors for data engineering, covering features, use cases, and real-time generative AI integration with a live demo.
Streaming DataFrames: A New Way to Process Streaming Data - Conf42 Python 2024
Explore streaming DataFrames as a novel approach to process real-time data, enhancing efficiency and simplifying stream processing workflows for Python developers.
Best Practices to Manage AWS Streaming Data Pipeline at Scale
Learn best practices for managing AWS streaming data pipelines at scale, covering data distribution, large record processing, schema registry, and validations.
Adding Generative AI to Real-Time Streaming Pipelines - Conf42 LLMs 2024
Explore integrating generative AI into real-time streaming pipelines, covering enterprise use cases, model selection, and implementation using tools like NiFi, Flink SQL, and cloud services.
Enriching Generative AI Events in Real-Time Streaming Pipelines
Explore real-time streaming pipelines for enriching generative AI events, covering unstructured data handling, Milvus architecture, and NiFi 2.0 features with practical demos.
No JVM, No Kafka: The Future of Streaming Data Pipelines
Explore the future of streaming data pipelines without JVM and Kafka, focusing on innovative approaches for efficient and scalable data processing in cloud-native environments.
Simplify Streaming Application Development
Explore declarative interfaces and GraphQL for streamlined streaming app development, focusing on reusability and best practices from Airbnb's experience.
Tool Up Your LLM with Apache Camel on OpenShift
Create an LLM agent using Apache Camel on OpenShift to assist clients with live feeds, enhancing your AI toolset and development skills.
Powering Cisco ThousandEyes High-Performant Data Streams with gRPC and OpenTelemetry
Explore high-performance data streaming using gRPC and OpenTelemetry in Cisco ThousandEyes. Learn to manage heavy traffic and adapt to changing test configurations in shared environments.
Elasticsearch: What if Your Database Was a Search Engine?
Explore Elasticsearch's database capabilities, including NoSQL features, schema flexibility, and relational functionalities. Learn how it can serve as a powerful data management system beyond search.
Forecasting Time Series with Arrow and WASM
Explore novel time-series processing pipeline using Apache Arrow, S3, Polars/DuckDB, and WASM for efficient forecasting and MLOps deployment.
Three AI Use Cases for Analyzing Sales Data
Explore three practical AI applications for analyzing sales data, demonstrated with real-world examples from a warm outreach campaign. Learn data augmentation, structuring unstructured data, and lead scoring techniques.