Apache Spark Performance Tuning and Best Practices
Optimize Apache Spark performance with best practices for production environments, covering system tuning, casting, broadcasting, serialization, and memory management.
Real-Time Streaming Using Apache Kafka
Explore Apache Kafka streams for building scalable, fault-tolerant streaming applications with parallel processing capabilities.
Apache Spark Structured APIs Using Databricks
Master Apache Spark Structured APIs for data manipulation using Databricks. Learn RDD, DataFrame API, data aggregation, and ETL operations in this comprehensive overview.
Deep Dive into Kafka for Big Data Applications
Explore Kafka's components, configurations, and internal workings for efficient big data applications and pub/sub models.
Getting Started with Delta Lake on Databricks
Explore Delta Lake's optimized data storage in Databricks, enhancing query performance and enabling time travel while reducing system complexity.
CodeCamp - Functional Programming Principles
Master functional programming principles and apply them to build scalable, efficient applications using Scala's powerful features.
CodeCamp: Functional Programming Principles - Part 2
Master functional programming principles in Scala, exploring polymorphic functions, data structures, and pattern matching for industry-ready applications.
CodeCamp: Introduction to Reactive Programming
Explore reactive programming concepts and techniques to build scalable, responsive applications. Learn to handle asynchronous data streams efficiently.
Akka Streams: Creating Graphs and Dynamic Components
Learn to create Akka streams graphs using graph DSL, explore non-linear components, and design dynamic graphs for efficient stream processing and ingestion.
Effect-Based Reactive Streams in Scala
Master effect-based reactive streaming in Scala to enhance your programming skills and build more efficient, scalable applications.
Understanding Streams in Redis
Explore Redis Streams: memory-efficient data processing, handling time-based data, and decoupling producers/consumers. Gain insights into Redis' unique perspective on streams.
Introduction to DataFlow
Explore fully managed streaming analytics with Dataflow, minimizing latency and costs through autoscaling and batch processing.
Data Mesh: Architecture and Implementation on GCP and Databricks
Explore Data Mesh principles for decentralized data management, empowering teams and ensuring data quality across organizations. Learn implementation on GCP and Databricks.
Using InfluxDB for Real-Time Monitoring in JMeter
Integrate InfluxDB with JMeter for real-time performance monitoring, capturing metrics and visualizing results with Grafana to gain proactive insights into application performance.
Getting Started with Apache Spark
Learn Apache Spark's architecture, data lineage, and DAG concepts. Explore this multi-language engine for data engineering, data science, and machine learning on single-node machines or clusters.
Event-Driven Architecture Using Apache Kafka
Explore event-driven architecture and Apache Kafka for building scalable, real-time systems with efficient data streaming and communication between components.
Introduction to PySpark
Learn the fundamentals of PySpark for efficient big data processing and analytics using Python in Apache Spark's distributed computing environment.
Moving Data Platforms from Hadoop to Kubernetes
Explore migrating data platforms from Hadoop to Kubernetes, improving operations and developer satisfaction while enhancing performance and deployment strategies.
Bringing Machine Learning to Streaming Data with a Few Lines of Code
Explore ML-powered stream processing with Dataflow and Apache Beam. Learn about Dataflow ML's integration with Vertex AI and Etsy's customer analytics platform journey.
What's New in Serverless Spark for Data Analytics and AI
Explore Walmart's approach to simplifying data analytics using Spark on Google Cloud, combining open-source flexibility with cloud-native advantages for scalable, secure solutions.
What's New with the AI Lakehouse
Explore the AI Lakehouse's evolution, combining data warehouses and lakes for real-time analytics and AI insights across multi-cloud environments.