Holly Smith has over a decade of experience working with Data & AI teams in a variety of capacities from individual contributors all the way up to leadership. She has spent the last two years at Databricks working with many multi national companies as they embark on their journey to develop their data maturity. She also works with the non profits Datakind UK and Tech Talent Charter to advise on data strategy and operations.
November 17, 2020 04:00 PM PT
Spark has become synonymous with big data processing, however the majority of data scientists still build models using single machine libraries. This talk will explore the multitude of ways Spark can be used to scale machine learning applications. In particular, we will guide you through distributed solutions for training and inference, distributed hyperparameter search, deployment issues, and new features for Machine Learning in Apache Spark 3.0. Niall Turbitt and Holly Smith combine their years of experience working with Spark to summarize best practices for scaling ML solutions.
Speakers: Holly Smith and Niall Turbitt