Introduction Apache Spark is fast, but applications such as preliminary data exploration need to be even faster and are willing to sacrifice some...

For the past few months, we have been busy contributing to the next major release of the big data open source software we...

At the Spark Summit New York , we announced Databricks Community Edition (CE) beta. CE is a free version of the Databricks service...

Update: this post is an April Fools joke. It is not an actual project we're working on. For the past three years, our...

Last week, Stack Overflow released the result of their 2016 developer survey . This is one of the most significant surveys in the...

Introduction Graph structures are a more intuitive approach to many classes of data problems. Whether traversing social networks, restaurant recommendations, or flight paths...

We would like to thank Ankur Dave from UC Berkeley AMPLab for his contribution to this blog post. Databricks is excited to announce...

Spark Summit East is just around the corner! If you haven’t registered yet, you can get tickets and here’s a promo code for...

Data scientists often spend hours or days tuning models to get the highest accuracy. This tuning typically involves running a large number of...