Ion Stocia is the Executive Chairman and co-founder of Databricks. Ion also serves as a professor in the EECS Department at UC Berkeley, and as a co-director of the AMPLab. At AMPLab Ion has been leading the software systems effort, which included the development of Apache Spark, as well as two other high profile open source projects: Apache Mesos and Tachyon. In 2006, he co-founded Conviva, a startup to commercialize technologies for large scale video distribution, where he is serving as a CTO. Ion is an ACM Fellow and has received numerous awards, including the SIGCOMM Test of Time Award (2011), and the ACM doctoral dissertation award (2001). Ion holds a Ph.D. in Electrical and Computer Engineering from Carnegie Mellon University and an M.S. in Computer Science and Control Engineering from Polytechnic University Bucharest.
Big data and AI are joined at the hip: the best AI applications require massive amounts of constantly updated training data to build state-of-the-art models AI has always been one of the most exciting applications of big data and Apache Spark. Increasingly Spark users want to integrate Spark with distributed deep learning and machine learning frameworks built for state-of-the-art training.
Databricks Update and Announcing Databricks Cloud
A long-standing grand challenge in computing is to enable machines to act autonomously and intelligently: to rapidly and repeatedly take appropriate actions based on information in the world around them. To address this challenge, at UC Berkeley we are starting a new five year effort that focuses on the development of data-intensive systems that provide Real-Time Intelligence with Secure Execution (RISE). Following in the footsteps of AMPLab, RISELab is an interdisciplinary effort bringing together researchers across AI, robotics, security, and data systems. In this talk I'll present our research vision and then discuss some of the applications that will be enabled by RISE technologies.