Artificial Stupidity: The New AI and the Future of Fintech
Explore the intersection of AI and fintech, examining evolutionary perspectives, adaptive markets, and investor behavior. Gain insights into decision-making, market dynamics, and the future of financial technology.
Yes, Generative Models Are The New Sparsity
Explore how generative models revolutionize data compression and signal processing, offering new perspectives on sparsity and optimization in machine learning.
Data-Driven Dynamical Systems Overview
Overview of data-driven approaches to tackle challenges in modern dynamical systems, exploring machine learning techniques for nonlinear and unknown dynamics, prediction, and control.
EvalML AutoML Library to Automate Feature Engineering, Feature Selection, Model Creation and Tuning
Explore EvalML, an AutoML library automating feature engineering, selection, model creation, and tuning. Learn to streamline your data science workflow and improve project efficiency.
SVM Kernels In-Depth Intuition - Polynomial Kernels Part 3 - Machine Learning Data Science
Explore polynomial kernels in SVM, understanding their intuition, use cases, and hyperparameter tuning for enhanced machine learning model performance.
Ancient Architecture
Explore ancient architectural marvels like the Pantheon and Parthenon, examining their design, construction techniques, and historical significance in shaping human civilization.
Automated Data Classification
Explore automated data classification's role in efficient data management, regulatory compliance, security enhancement, and decision-making support for large enterprises with Alex Gorelik.
Migrating Pinterest Apache Spark Clusters from HDFS to S3
Explore Pinterest's migration of Apache Spark clusters from HDFS to S3, addressing technical challenges, optimizing performance, and achieving a smooth transition process.
Deploying Apache Spark Jobs on Kubernetes with Helm and Spark Operator
Learn to deploy Scala Spark jobs on Kubernetes using Helm and Spark Operator. Live coding demo shows scalable, flexible deployments with minimal custom configurations for stress-free implementation.
Delta Lake 0.7.0 and Spark 3.0 - Ask Me Anything Session
Illuminating AMA session with Apache Spark and Delta Lake experts. Explore Spark 3.0 and Delta Lake's latest features, use cases, and development insights. Perfect for data engineers seeking cutting-edge knowledge.
Koalas - Scaling Pandas API on Apache Spark
Learn to scale pandas operations to big data using Koalas, an open-source project implementing the pandas API on Apache Spark. Transition seamlessly from single-machine to distributed environments for large-scale data science.
Healthcare Claim Reimbursement Using Apache Spark - Optum's System Transformation
Optimizing healthcare claim processing with Apache Spark: Improved performance, reduced costs, and enhanced capabilities for hospitals' revenue recovery through efficient data processing and analysis.
Cloud-Native Apache Spark Scheduling with YuniKorn on Kubernetes
Explore cloud-native Apache Spark scheduling on Kubernetes using YuniKorn. Learn about efficient resource management, quota handling, and auto-scaling for large-scale Spark jobs in cloud environments.
Bringing Satellite and Drone Imagery into Data Science Workflows
Explore satellite and drone imagery analysis in data science workflows using RasterFrames, a Spark SQL extension with Python API for processing spatial image data and integrating with ML frameworks.
Scaling Data and ML with Apache Spark and Feast - Feature Engineering for Production
Explore scaling data and ML with Apache Spark and Feast, focusing on feature engineering challenges and solutions for big data-driven machine learning in production environments.
Accelerating Apache Spark Shuffle for Data Analytics on Cloud with Remote Persistent Memory Pools
Innovative solution for accelerating Apache Spark shuffle operations using remote persistent memory pools, improving performance, scalability, and reliability in cloud-based big data analytics.
Geospatial Data Analysis in Apache Spark - Challenges and Solutions
Explore geospatial data challenges in Apache Spark, comparing libraries, and learning best practices for data ingestion, storage, and retrieval using spatial indexing techniques.
Adaptive Query Execution: Speeding Up Spark SQL at Runtime
Explore Spark SQL's Adaptive Query Execution framework, which optimizes query plans at runtime using real-time statistics for improved performance in data processing and analysis.
The Apache Spark File Format Ecosystem - Optimizing Storage for Performance
Explore key file formats in Spark ecosystem: Parquet, ORC, Avro. Learn core concepts, optimization techniques, and how to select the right format for performant data processing and AI/ML workflows.
Generative Hyperloop Design - Managing Massively Scaled Simulations for Demand Modeling
Explore large-scale simulation framework for Hyperloop design, utilizing cloud computing, data pipelines, and machine learning to address key technical and business questions for safe and efficient mass transportation.
Deep Dive into GPU Support in Apache Spark 3.x - Accelerator-Aware Scheduling and RAPIDS Plugin
Explore GPU acceleration in Apache Spark 3.x, covering task scheduling, columnar processing, and the RAPIDS plugin for enhanced ETL, ML, and DL performance without code changes.