Introducing Redshift Data Source for SparkOctober 19, 2015 by Sameer Wadkar and Josh Rosen in Engineering Blog This is a guest blog from Sameer Wadkar, Big Data Architect/Data Scientist at Axiomine. The Spark SQL Data Sources API was introduced in...
Interactive Audience Analytics With Apache Spark and HyperLogLogOctober 13, 2015 by Eugene Zhulenev in Partners This is a guest blog from Eugene Zhulenev on his experiences with Engineering Machine Learning and Audience Modeling at Collective. At Collective, we...
Spark Survey 2015 Results are now availableSeptember 24, 2015 by Matei Zaharia, Patrick Wendell and Denny Lee in Announcements We ran the Spark Survey 2015 this summer to gain insights on how organizations are using Apache Spark. The results of this year’s...
Easier Spark Code DebuggingSeptember 23, 2015 by Chaoyu Yang in Product To try the features mentioned in this blog, sign up for a 14-day free trial of Databricks today . We are excited to...
Apache Spark 1.5 Preview Now Available in DatabricksAugust 18, 2015 by Reynold Xin and Michael Lumb in Product We are excited to announce that starting today, Apache Spark 1.5.0 is available as a preview in Databricks. Our users can now choose...
Helping the Democratization of Big DataAugust 5, 2015 by Ali Ghodsi in Company Blog When we started Databricks, we thought that extracting insights from big data was insanely difficult for no good reason. You almost needed an...
Guest blog: SequoiaDB Connector for Apache SparkAugust 3, 2015 by Tao Wang in Company Blog This is a guest blog from Tao Wang at SequoiaDB . He is the co-founder and CTO of SequoiaDB, leading its long-term technology...
Using 3rd Party Libraries in Databricks: Apache Spark Packages and Maven LibrariesJuly 28, 2015 by Burak Yavuz in Company Blog In an earlier post, we described how you can easily integrate your favorite IDE with Databricks to speed up your application development. In...
Introducing R Notebooks in DatabricksJuly 13, 2015 by Hossein Falaki in Product Apache Spark 1.4 was released on June 11 and one of the exciting new features was SparkR . I am happy to announce...
Announcing SparkHub: A Community Site for Apache SparkJuly 10, 2015 by Denny Lee in Announcements Today, we are happy to announce SparkHub , a service for the Apache Spark community to easily find the most relevant Spark resources...