Accelerating Apache Spark with Intel QuickAssist Technology - Databricks

Accelerating Apache Spark with Intel QuickAssist Technology

Download Slides

Enterprise and cloud data centers are under pressure to continuously expand revenue-generating and value-added services, such as compute intensive and I/O-demanding Big Data solutions, which moves large amounts of data into and out of storage, and sends it across the networked clusters.

A significant amount of time and network bandwidth can be saved when the data is compressed before it is passed between servers, as long as the compression/decompression operations are efficient and require negligible CPU cycles. Intel QuickAssist Technology allows compute-intensive workloads, specifically compression, to be offloaded from the CPU core onto dedicated hardware accelerators. Intel Quick Assist Technology enables developers to create software solutions that leverage compression/decompression acceleration, accessing the technology through APIs in the Intel QuickAssist Software.

This talk provides developers with information on Intel QuickAssist Technology and presents some key use cases to provide background for them to understand how they can take advantage of the hardware-based compression acceleration and performance improvements available with Intel QuickAssist Technology in their Spark applications.

 

Try Databricks
See More Spark + AI Summit Europe 2019 Videos

« back
About Qi Xie

Intel

Xie Qi is a senior architect of Intel Big Data team. He once worked for IT Flags at Intel and joined Intel Big Data team in 2016 and has a broad experience across Big Data, Multi Media and Wireless.