If you are planning to deploy Spark in cloud - Databricks

If you are planning to deploy Spark in cloud

Download Slides

or doing so today: this is information you need to understand. The performance of you code and integrity of your data depends on it.”

About Steve Loughran

Steve Loughran works at Hortonworks on leading-edge Hadoop applications, most recently in high-performance Amazon's S3 storage support in Hadoop and Spark, as well as long-lived Yarn Service He's the author of Ant in Action, a member of the Apache Software Foundation, and a committer on the Hadoop core since 2009. Prior to joining Hortonworks in 2012, he was a Research Scientist at HP Laboratories. He lives and works in Bristol, England. For fun he falls of bicycles in the local woodland.