Scaling Machine Learning with Spark
Learn to build scalable machine learning solutions with Apache Spark. Explore distributed computing, MLflow, feature engineering, and integrating Spark with deep learning frameworks like TensorFlow and PyTorch.
Kubeflow for Machine Learning
Explore Kubeflow for ML: tooling, scaling Python with Dask/Ray, API comparisons, and insights on distributed computing. Learn from experts about advancements in machine learning infrastructure.
Entity Resolution at Scale
Explore entity resolution techniques for cleaning large-scale data, focusing on challenges and solutions using Apache Spark to process billions of records efficiently.
Scaling Machine Learning with Spark
Learn to build scalable machine learning solutions using Apache Spark, MLlib, MLflow, TensorFlow, and PyTorch. Explore distributed computing concepts, manage ML lifecycles, and combine Spark with deep learning for end-to-end workflows.
Unveiling Much Simplified Functional Programming in Scala for Data Engineering
Simplified functional programming in Scala for data engineering, focusing on feature generation abstraction and optimization techniques without complex libraries or boilerplate code.
Analyzing Pwned Passwords with Apache Spark
Learn to analyze compromised passwords using Apache Spark, exploring data visualization, password policies, and big data security challenges for improved cybersecurity practices.
How to Make Decisions in Real-time While Processing 30 Million Requests per Minute
Explore real-time decision-making techniques for high-volume data processing, featuring Kafka, Spark Streaming, and Aerospike to optimize system performance and reduce infrastructure costs.
Building a Data Platform with Apache Spark on Kubernetes
Explore building a data platform using Apache Spark on Kubernetes, focusing on challenges and solutions for managing on-demand Spark clusters and Jupyter Notebooks in containerized environments.
Harnessing the Power of Spark & Cassandra within Your Spring App
Explore integrating Spark and Cassandra in Spring applications for powerful data analysis and storage. Learn implementation, pitfalls, and real-world usage of these technologies for large-scale data processing.
PySpark and Warcraft Data
Explore PySpark's capabilities for analyzing World of Warcraft auction data, comparing performance with other tools and demonstrating its application in processing large datasets efficiently.
PySpark - Data Processing in Python on Top of Apache Spark
Learn PySpark for large-scale data processing with Python on Apache Spark. Covers RDDs, DataFrame API, transformations, actions, and data sources. Ideal for those seeking efficient big data analysis techniques.
Apache Spark vs Cloud-Native SQL Engines
Opinionated comparison of Apache Spark and cloud-native SQL engines, exploring their strengths, use cases, and complementary nature for data processing and business intelligence tasks.
Building Modern Data Pipelines with Spark on Azure HDInsight
Explore common patterns for building end-to-end data analytics pipelines using Apache Spark on Azure HDInsight, covering architecture, integration points, and various pipeline options.
Using Azure Databricks to Develop Scalable Data Solutions
Develop scalable data solutions using Azure Databricks for efficient processing, collaborative development, and seamless integration with Azure services and Power BI visualization.
Introduction to Azure Data Bricks - Cloud
Explore Azure Databricks for big data processing, advanced analytics, and real-time insights. Learn platform basics, architecture, and integration with Azure components for data-driven solutions.
Big Data Analytics in SQL Server 2019 Big Data Cluster Using Spark
Learn to leverage Apache Spark for big data analysis in SQL Server 2019 Big Data Cluster, exploring techniques for processing and analyzing large-scale datasets efficiently.
Presenting Big Data Clusters for SQL Server 2019
Explore SQL Server 2019's Big Data Clusters, combining open-source technologies with SQL Server for advanced analytics. Learn how containers and Kubernetes integrate Apache Spark, Hadoop, and SQL Server into a unified analytics solution.
Power of Electric Snakes! PySpark for Big Data and Data Science
Learn to harness PySpark for big data analytics, covering RDDs, DataFrames, transformations, and machine learning. Gain practical skills for efficient data processing and analysis using Python and Spark.
Data Analysis with Spark and Databricks in Azure Synapse
Comparing Spark and Databricks in Azure Synapse: use cases, costs, data types, processing volumes, and implementation demos. Learn when to choose Spark-based tools vs. alternatives like SQL on-demand or ELT.
Supercharged Analytics for Prometheus Metrics with Spark, Presto, & Superset
Explore advanced analytics for Prometheus metrics using Spark, Presto, and Superset. Learn to perform complex queries and join metrics with Kubernetes metadata for deeper insights.
Scaling to Millions of ML Models to Solve the Problems of SRE and Security
Explore scaling ML models for SRE and security, using open-source technologies to improve zero trust frameworks and infrastructure diagnosis on Kubernetes and service mesh environments.