Improved Frequent Pattern Mining in Apache Spark 1.5: Association Rules and Sequential Patterns
We would like to thank Jiajin Zhang and Dandan Tu from Huawei for contributing to this blog. To get started mining patterns from...
Spark Survey 2015 Results are now available
We ran the Spark Survey 2015 this summer to gain insights on how organizations are using Apache Spark. The results of this year’s...
Easier Spark Code Debugging
To try the features mentioned in this blog, sign up for a 14-day free trial of Databricks today . We are excited to...
Large Scale Topic Modeling: Improvements to LDA on Apache Spark
This blog was written by Feynman Liang and Joseph Bradley from Databricks, and Yuhao Yang from Intel. To get started using LDA, download...
Apache Spark 1.5 DataFrame API Highlights: Date/Time/String Handling, Time Intervals, and UDAFs
To try new features highlighted in this blog post, download Spark 1.5 or sign up Databricks for a 14-day free trial today...
Announcing Apache Spark 1.5
The inaugural Spark Summit Europe will be held in Amsterdam this October. Check out the full agenda and get your ticket before it...
Spark Summit Europe Full Agenda Available Online
This October, join the Apache Spark community in Amsterdam at the Beurs Van Berlage for the very first Spark Summit in Europe! We...
Apache Spark 1.5 Preview Now Available in Databricks
We are excited to announce that starting today, Apache Spark 1.5.0 is available as a preview in Databricks. Our users can now choose...
From Pandas to Apache Spark's DataFrame
This is a cross-post from the blog of Olivier Girardot. Olivier is a software engineer and the co-founder of Lateral Thoughts, where he...
Helping the Democratization of Big Data
When we started Databricks, we thought that extracting insights from big data was insanely difficult for no good reason. You almost needed an...