Enriching the Data vs Filtering in Apache Spark

Enriching the Data vs Filtering in Apache Spark

Explore a conference talk that delves into the comparison between enriching data and filtering in Apache Spark. Learn about a loyalty use case at Capital One and discover the advantages and disadvantages of both approaches. Understand the issues with the filtering approach and how enriching data can provide a more efficient solution. Gain insights into practical examples of both methods and their implementation in Spark. Conclude with a summary of the key takeaways and learn about the speaker's background in data engineering.