Apache Spark 2015 Year In Review
To learn more about Apache Spark, attend Spark Summit East in New York in Feb 2016 . 2015 has been a year of...
Announcing Apache Spark 1.6
To learn more about Apache Spark, attend Spark Summit East in New York in Feb 2016 . Today we are happy to announce...
Introducing Apache Spark Datasets
Developers have always loved Apache Spark for providing APIs that are simple yet powerful, a combination of traits that makes complex analysis possible...
The Best of The Databricks Blog: Most Read Posts of 2015
Databricks developers are prolific blog authors when they are not writing code for the Databricks platform or Apache Spark. As 2015 draws to...
Succinct Spark from AMPLab: Queries on Compressed RDDs
This is a guest post from Rachit Agarwal and Anurag Khandelwal of the UC Berkeley AMPLab, leads of an ongoing research project called...
Announcing the TFOCS for Spark Optimization Package
Aaron is the developer of this Apache Spark package, with support from Databricks. Aaron is a freelance software developer with experience in data...
Generalized Linear Models in SparkR and R Formula Support in MLlib
To get started with SparkR, download Apache Spark 1.5 or sign up for a 14-day free trial of Databricks today . Apache Spark...
Apache Spark 1.5.1 and What do Version Numbers Mean?
The inaugural Spark Summit Europe will be held in Amsterdam on October 27 - 29. Check out the full agenda and get your...
Improved Frequent Pattern Mining in Apache Spark 1.5: Association Rules and Sequential Patterns
We would like to thank Jiajin Zhang and Dandan Tu from Huawei for contributing to this blog. To get started mining patterns from...
Large Scale Topic Modeling: Improvements to LDA on Apache Spark
This blog was written by Feynman Liang and Joseph Bradley from Databricks, and Yuhao Yang from Intel. To get started using LDA, download...