The Spark Listener interface provides a fast, simple and efficient route to monitoring and observing your Spark application – and you can start using it in minutes. In this talk, we’ll introduce the Spark Listener interfaces available in core and streaming applications, and show a few ways in which they’ve changed our world for the better at SpotX. If you’re looking for a “Eureka!” moment in monitoring or tracking of your Spark apps, look no further than Spark Listeners and this talk!
Landon is a Senior Big Data Engineer at SpotX, a video ad serving platform that reaches 100s of millions of people a day. He engineers pipelines that process dozens of terabytes daily in Spark, and enjoys building solutions to difficult-to-scale problems.
Ben Storrie is a Senior Big Data Engineer at SpotX, playing a critical role in the big data pipelines that power the company. He's contributed to reliable 24/7 streaming applications, ETL pipelines, and infrastructure designs. He loves continuous development, hands-free deployment, and nice, clean code.