Explore how Intuit leverages Spark on Kubernetes to process big data at scale in this conference talk. Learn about the advantages of running data processing workloads on Kubernetes, including cost reduction and increased production speed. Discover Intuit's journey in building a data processing platform, their experiences with the Spark operator, and how they addressed challenges like network bottlenecks. Gain insights into the benefits of containerization for data scientists and the future plans for Intuit's big data infrastructure. Understand the comparison between Kubernetes and Yarn, native workflows, and the impact on transaction categorization and personalization problems.