Production Readiness Testing At Salesforce Using Spark MLlib - Databricks

Production Readiness Testing At Salesforce Using Spark MLlib

Download Slides

Overview : is a platform as a service (PaaS) that allows customers to develop custom applications that integrate into the main application. As part of the production readiness testing of the platform, we test for regression in customers’ applications in Production. In this talk, we explain how we leverage Spark to help us with this large scale effort. Extended Description : Salesforce customers have written hundreds of millions (and growing) number of automated tests for their custom applications. As part of our pre-release regression testing, we run these tests twice – once with the old platform code and once with the new platform code. These test runs should have identical behavior if the new platform code has to pass the regression testing and be ready for production. Our application stack is setup to run these hundreds of millions of tests, store their results, analyze, find and fix bugs – all in a few weeks. We leverage Spark jobs to do filtering and perform various transformations on the results. Once cleaned up, the results then go through a unsupervised learning pipeline written in Spark MLlib to cluster results to identify real issues vs non-issues and known issues. Key takeaways: Spark MLlib, Spark at scale, business use case, improve operational efficiency.

About Jag Jayaprakash

Jag Jayaprakash is a Member of Technical Staff at in Seattle. He is part of the Hammer team that uses Spark to find regressions during platform releases. Prior to Salesforce, Jag worked at CDK Global, (AWS) and Sun Microsystems. Jag holds a Masters degree from GeorgiaTech, Atlanta and BE(Hons) in Computer Science from BITS, Pilani, India.

About Ganesh Tiwari

Ganesh is a Senior Member of Technical Staff at, where he has been working on the platform.