Simon King – Databricks

Simon King

Software Engineer, Pepperdata

Simon King is a software engineer at Pepperdata where he is the engineering lead on Pepperdata work with both the open source Dr. Elephant project and integration of Dr. Elephant technology with the Pepperdata Application Profiler. Prior to Pepperdata, Simon worked at Microsoft and Yahoo on a variety of technology projects.



Dr. Elephant for Monitoring and Tuning Apache Spark Jobs on HadoopSummit 2017

Dr. Elephant helps improve Spark and Hadoop developer productivity and increase cluster efficiency by making clear recommendations on how to tune workloads and configurations. Originally developed by LinkedIn, Dr. Elephant is now in use at multiple sites. This session will explore how Dr. Elephant works, the data it collects from Spark environments and the customizable heuristics that generate tuning recommendations. Learn how Dr. Elephant can be used to improve production cluster operations, help developers avoid common issues, and green light applications for use on production clusters. Session hashtag: #SFdev18