Di Wu - Databricks

Di Wu

PhD Student, UCLA & Falcon Computing Solutions, Inc.

Di Wu is a 5th-year PhD student at UCLA, working with professor Jason Cong. Previous to UCLA, he got his bachelor degree of Electrical Engineering from Tsinghua University, China. He did an internship at Intel Lab from Jun. 2014 to Sep. 2014, working on Spark integration with the Intel HARP FPGA system. His research interests include large-scale deployment of hardware acceleration systems including GPU and FPGA, and domain-specific acceleration for large-scale machine learning and cognitive computations.

UPCOMING SESSIONS

PAST SESSIONS

Deploying Accelerators At Datacenter Scale Using SparkSummit 2016

Accelerators, such as GPUs and FPGAs, have been gaining popularity in commodity clusters due to their high computing and energy efficiency. However, deploying accelerators at a large scale still requires significant effort when using existing approaches. In this talk, we present Blaze, an accelerator-aware runtime system that enables rapid warehouse-scale accelerator deployment for the Hadoop/Spark ecosystem. In particular, Blaze provides accelerator management for data-intensive scalable computing (DISC) systems in a cluster with heterogeneous accelerator platforms, including GPUs and FPGAs. Blaze also provides APIs for system architects to design cluster-wide ready-to-use accelerators, and APIs for DISC system developers to use accelerators. Blaze demonstrates improved DISC system throughput and accelerator utilization on a cluster with commodity FPGA and GPU cards.