Stavros Kontopoulos - Databricks

Stavros Kontopoulos

Software Engineer, Lightbend

Stavros is an R&D polyglot software engineer (Java, Scala, C, C++, Javascript). He has worked for several years building software solutions that scale in different verticals like telecoms and marketing. He’s currently working for Lightbend the company behind reactive applications, Scala, Akka, and Play. He helps with the implementation of the company’s fast data strategy. His interests among others are: distributed system design, streaming technologies, and NoSql databases. He is also a Phd student in the area of distributed indexing structures, social network analysis, and data structures.



Problem Solving Recipes Learned from Supporting SparkSummit East 2017

Due to Spark, writing big data applications has never been least until they stop being easy! At Lightbend we've helped our customers out of a number of hidden Spark pitfalls. Some crop up often; the ever-persistent OutOfMemoryError, the confusing NoSuchMethodError, shuffle and partition management, etc. Others occur less frequently; an obscure configuration affecting SQL broadcasts, struggles with speculating, a failing stream recovery due to RDD joins, S3 file reading leading to hangs, etc. All are intriguing! In this session we will provide insights into their origins and show how you can avoid making the same mistakes. Whether you are a seasoned Spark developer or a novice, you should learn some new tips and tricks that could save you hours or even days of debugging.