Turbocharging Spark with Samsung SmartSSD Computational Storage Devices
Discover how to significantly boost Apache Spark performance using Samsung SmartSSD® Computational Storage Devices (CSDs) powered by Xilinx FPGAs in this 30-minute video presentation by Databricks. Learn about the innovative approach developed by Samsung, Xilinx, and Bigstream to seamlessly accelerate the Spark platform, resulting in impressive 2x-8x performance gains without requiring any user code changes. Explore the technical aspects of Bigstream middleware's acceleration method, examine performance results using the TPC-DS benchmark suite, and understand the potential Total Cost of Ownership (TCO) savings for Spark users. Gain insights into the industry surrounding computational storage, SmartSSD use cases, acceleration techniques, and limitations of Spark. Delve into the inner workings of SmartSSDs, their acceleration capabilities, and the partnership ecosystem supporting this technology.