Delayed Column Generation in Large Scale Integer Optimization Problems
Explore delayed column generation for solving large-scale mixed integer programming problems, focusing on applications in data science and decision mathematics.
Statistical Methodology and Theory - Professor Richard Samworth, Cambridge
Explore high-dimensional and nonparametric statistical inference with Prof. Samworth. Learn techniques for handling Big Data challenges, including random projections and subsampling for variable selection.
Learning Real-World Probabilistic Models with Approximate Message Passing
Explore probabilistic modeling for big data using factor graphs and message passing. Learn how Amazon tackles real-world problems with advanced statistical techniques in the era of structured data.
How to Avoid Overcomplicating Your Data Architecture
Explore strategies for simplifying data architectures, modernizing infrastructures, and leveraging real-time streaming for AI. Learn to navigate complexity and achieve faster results in data engineering.
Stream Processing and New Approaches: Edge Processing
Explore stream processing on the edge for real-time data analysis, enabling rapid anomaly detection and distributed machine learning using open-source software.
Secure IoT Command, Control, and Exfiltration Using Apache NiFi and Apache MiNiFi
Explore secure IoT data collection and control using Apache NiFi and MiNiFi. Learn to prioritize, analyze, and encrypt data at the edge while ensuring compliance with local governance policies.
Building Cloud Integration Applications Through Knative and Apache Camel
Explore cloud-native integration using Knative and Apache Camel, focusing on EIP DSL for middleware integration and leveraging serverless frameworks for efficient service connectivity in modern applications.
Embracing Big Data Workloads in Cloud-Native Environments with Data Locality
Explore data locality in cloud-native big data workloads, focusing on Apache Hadoop Ozone's network topology support and its benefits for performance and scheduling in Kubernetes environments.
Inferencing Big Data with AI and Machine Learning in Metaverse
Explore advanced visualization techniques for big data in AR/VR, focusing on real-time inferencing, infrastructure needs, and cognitive AI agents for enhanced customer engagement.
Introducing Prestissimo: Presto's Next-Gen Query Execution Engine
Explore Prestissimo, Presto's new C++ query execution engine, offering improved performance, reliability, and efficiency for data analytics and open data lakehouses.
Neural Search Improvements with Apache Solr 9.1 - Approximate Nearest Neighbor and Pre-Filtering
Explore neural search in Apache Solr 9.1, including HNSW graph improvements, pre-filtering capabilities, and Deep Learning integrations for enhanced search relevance and efficiency.
Accelerating Spark Workloads in a Mesos Environment with Alluxio
Learn how Alluxio enhances Spark and Mesos performance by providing memory-speed data access across disparate storage systems, optimizing big data processing and enabling new workloads.
Introducing Kubeflow with TensorFlow and Apache Spark
Explore Kubeflow's role in streamlining machine learning workflows, from model development to production deployment on Kubernetes, with insights on scalability and integration with TensorFlow and Apache Spark.
Spark Over a Mesos Secured Productive Environment
Explore advanced Spark and Mesos integration for secure, isolated Big Data environments. Learn to enhance protection, manage secrets, and implement network solutions in enterprise-level deployments.
Getting Started with Delta Lake
Learn to create a Lakehouse architecture with Delta Lake, an open-source storage framework. Explore data reliability challenges, hands-on examples, and benefits for big data use cases in modern data engineering.
Socializing the Elephant - Integrating Big Data Using Egeria Open Metadata
Explore Egeria's open metadata framework for seamless integration of Big Data with diverse information systems, enhancing enterprise-wide data management and governance.
Building Modern Data Streaming Apps with Open Source
Discover best practices for building data streaming applications using open-source frameworks. Learn to orchestrate streams, perform ETL, enhance events, and make continuous queries with tools like Apache NiFi, Pulsar, Spark, and Flink SQL.
Introduction to Stream Processing with Apache Flink
Explore stream processing fundamentals and Apache Flink's capabilities for real-time data analysis, scalable applications, and event-driven architectures.
Lessons Learned from Big Data and AI/ML Collaboration for Giant Hogweed Eradication
Explore big data and AI/ML collaboration for invasive plant eradication, covering challenges, architecture, data flow, and lessons learned in scalable machine learning systems.
Bringing the Power of ONNX to Apache Spark - Integrating Deep Learning Inference
Explore integrating ONNX with Spark for efficient deep learning inference pipelines. Learn about Ascend Hardware Platform's ONNX contributions and Spark community's simplified API for DL inferencing.
Automating Cloud-native Spark Jobs with Argo Workflows
Learn to orchestrate Spark jobs on Kubernetes using Argo Workflows, exploring architecture, resource management, and scaling advantages for efficient large-scale data processing in cloud-native environments.