Selected Sessions to Watch for at Spark + AI Summit 2018
Early last month, we announced our agenda for Spark + AI Summit 2018, with over 180 selected talks with 11 tracks and training courses. For this summit, we have added four new tracks to expand its scope to include Deep Learning Frameworks, AI, Productionizing Machine Learning, Hardware in the Cloud, and Python and Advanced Analytics....
Accelerate Innovation with Microsoft Azure Databricks
It’s hard to believe that we are already three weeks into 2018. If you’re still struggling to get valuable insights from your data, now is the perfect time to try something new! We recently announced Azure Databricks, a fast, easy and collaborative Apache® Spark™ based analytics platform optimized for Azure. With Azure Databricks, you can help your...
Matei Zaharia’s 5 predictions about big data and AI in 2018
Over the past few years, the demand for artificial intelligence (AI) and machine learning capabilities has surged with innovations in natural language processing, task automation, and predictions. From autonomous cars to a more personalized shopping experience, big data and artificial intelligence is at the forefront of new solutions that are delighting customers, improving business operations...
Spark Summit is Becoming the Spark + AI Summit
We’re excited to announce that Spark Summit is expanding its coverage in 2018 to include in-depth content on artificial intelligence. We are also renaming the conference Spark + AI Summit. AI has always been one of the most exciting applications of big data and Apache Spark, so with this change, we are planning to bring...
Women in Big Data, Apache Spark and AI: Bay Area Spark Meetup at Databricks Summary
When Fei-Fei Li, the director of Stanford’s AI Lab and now a chief scientist at Google Cloud, was asked in an interview in the MIT Technical Review: The Artificial Intelligence Issue why she advocated more women be involved in technical fields, and AI in particular, she said: "When you are making a technology this pervasive...
Spark Summit EU 2017 Recap and Reflections
“Dublin is now a truly cosmopolitan capital, with an influx of people, energy, and ideas infusing the ever-beguiling, multi-layered city with fresh flavors and kaleidoscopic colors,” writes the Lonely Planet. Add to this multi-layered city three days of Spark Summit, held at the Guinness barrel-shaped Dublin Convention Center, and you get an infusion of visionary...
Crossing The Ocean for Spark Summit EU
This is a guest post from Movile. Eiti Kimura and Flavio Clésio share their highlights and what they're looking forward to the most at Spark Summit EU in Dublin, Ireland. About the Authors: Eiti Kimura has over 15 years of experience working with software development. He holds a Master’s Degree in Electrical Engineering. He has...
The Biggest EU Summit Ever: Over One Hundred Presentations, Two Conference Days, and a Day of Training
SAVE 15% ON REGISTRATION* WITH CODE "DATABRICKS". This year’s Spark Summit Europe is poised to be the biggest yet and we here at Databricks could not be more excited to be hosting this event. The level of participation and continued growth of the summit is a clear indicator of how critical Apache Spark has become...
Bay Area Apache Spark Meetup at HPE/Aruba Networks Summary
On September 7th, we held our monthly Bay Area Apache Spark Meetup (BASM) at HPE/Aruba Networks in Santa Clara. We had two Apache Spark related talks: one from Aruba Networks’ Data Engineering team and other from Databricks’ Machine Learning team. For those who missed the meetup, below is the video and link to each presentation...
Learn about Apache Spark’s Memory Model and Spark’s State in the Cloud
Since Apache Spark 1.6, as part of the Project Tungsten, we started an ongoing effort to substantially improve the memory and CPU efficiency of Apache Spark’s backend execution and push performance closer to the limits of the modern hardware. This effort culminated in Apache Spark 2.0 with Catalyst optimizer and whole-stage code generation. Because Spark...
