As the Corporate Vice President of Machine Learning software engineering, Ajit is the engineering leader responsible for design, development of ROCm (Radeon Open Compute) Machine Intelligence software spanning Deep Learning Frameworks, Compilers, Language Runtimes, Libraries and Linux Compute Kernel. Ajit is also responsible for the Machine Learning Software Roadmap and Strategy. Ajit is passionate about distributed machine learning and high performance computing. Ajit holds Masters in Computer Science and MBA from Kellogg.
April 24, 2019 05:00 PM PT
ROCm, the Radeon Open Ecosystem, is an open-source software foundation for GPU computing on Linux. ROCm supports TensorFlow and PyTorch using MIOpen, a library of highly optimized GPU routines for deep learning.
In this talk, we describe how Apache Spark is a key enabling platform for distributed deep learning on ROCm, as it enables different deep learning frameworks to be embedded in Spark workflows in a secure end-to-end machine learning pipeline. We will analyse the different frameworks for integrating Spark with Tensorflow on ROCm, from Horovod to HopsML to Databrick's Project Hydrogen.
We will also examine the surprising places where bottlenecks can surface when training models (everything from object stores to the Data Scientists themselves), and we will investigate ways to get around these bottlenecks. The talk will include a live demonstration of training and inference for a Tensorflow application embedded in a Spark pipeline written in a Jupyter notebook on Hopsworks with ROCm.