Azure Databricks, industry-leading analytics platform powered by Apache Spark™March 22, 2018 by Ali Ghodsi and Rohan Kumar in Partners The confluence of cloud, data, and AI is driving unprecedented change. The ability to utilize data and turn it into breakthrough insights is...
Introducing Azure DatabricksNovember 15, 2017 by Ali Ghodsi in Company Blog 99% of organizations still struggle to get valuable analytics from their Big Data and achieve the full potential of AI. Today I’m excited...
Helping the Democratization of Big DataAugust 5, 2015 by Ali Ghodsi in Company Blog When we started Databricks, we thought that extracting insights from big data was insanely difficult for no good reason. You almost needed an...
Databricks Launches "Jobs" Feature for Production WorkloadsMarch 18, 2015 by Ali Ghodsi in Product Databricks now includes a new feature called Jobs, enabling support for running production pipelines, consisting of standalone Spark applications. Jobs includes a scheduler...
Apache Spark In MapReduce (SIMR)January 1, 2014 by Ali Ghodsi and Ahir Reddy in Engineering Blog Apache Hadoop integration has always been a key goal of Apache Spark and YARN users have long been able to run Spark on...