Weather is both massive and intensely local. Building a weather service involves capturing lots of data for many, many places over long timeframes, applying intensive analysis to those datasets to predict what will happen next, and then delivering those insights to the millions mobile users and other endpoints who request it, all within a fraction of a second. Come see the full end-to-end view of how The Weather Company uses Spark to manage this large scale challenge.
Robbie has been involved in the big data community for the last seven years, and he was an early Spark adopter back in 2014. He has contributed to a number of projects, including Apache Cassandra and the Cassandra Spark connector, and is the author of Cassandra High Availability. At IBM, Robbie leads a group that includes the Spark Technology Center, as well as Big Insights and other data processing technologies that power the Watson Data Platform.