Company Blog

We recently hosted the webinar — CIO Survey: Enterprise Challenges to AI and How to Overcome Them — featuring Jen Garofalo, Research Director at IDG, the parent company to CIO.com, and Pat McDonough, VP of Customer Success at Databricks. This webinar covered key findings from a recent CIO.com survey of 200 executives on the topic...

This is the final part of our blog series on security available here. In this blog, I will be talking about our culture of security at Databricks. Artificial intelligence software that can learn and improve human decision-making is transforming business. All sorts of companies are looking to AI to gain an edge over competitors. Unfortunately,...

Powering innovation on AWS in life sciences, public sector, machine learning, and big data analytics. Databricks, founded by the original creators of Apache SparkTM, is proud to be a Platinum sponsor at AWS re:Invent. Stop by booth #416 to grab some cool schwag and see demos of MLflow, TensorFlow, Apache Spark, and other  technologies that...

Six months ago we introduced the Databricks Runtime for Machine Learning with the goal of making machine learning performant and easy on the Databricks Unified Analytics Platform. The Databricks Runtime for ML comes pre-packaged with many ML frameworks and enables distributed training and inference. Today we are excited to release the second iteration including Conda...

As part of the organizing committee and program chairs for this summit, we are delighted to share two achievements with you. First, we have published a preliminary agenda for the Spark + AI Summit in San Francisco on April 23-25, 2019, comprising of 12 technical tracks, with 100+ breakout sessions, on data and AI across...

This is Blog #3 in a series of blog posts about Databricks security. My colleagues David Cook (our CISO) and David Meyer (SVP products) laid out Databricks' approach to Security in blog #1  & blog #2. With this blog, I will be talking about deploying and operating  Databricks at scale while minimizing human error. Democratize...

We’re excited to announce the general availability of Databricks Runtime 5.0. Included in this release is Spark 2.4. This release offers substantial performance increases within key areas of the platform. Benchmarking workloads have shown a 16% improvement in total execution time and Databricks Delta benefits from substantial improvements to metadata caching, improving query latency by...

This is a guest blog from our partners at MongoDB Bryan Reinero and Dana Groce We are happy to announce that the MongoDB Connector for Apache Spark is now officially certified for Azure Databricks. MongoDB Atlas users can integrate Spark and MongoDB in the cloud for advanced analytics and machine learning workloads by using the...

This is a guest post from Shaun Elliott, Data Engineering Tech Lead and Sam Shuster, Staff Engineer at Edmunds. What is Databricks and How is it Useful for Edmunds? Databricks is a cloud-based, fully managed, big data and analytics processing platform that leverages Apache SparkTM and the JVM. The big selling point of the Databricks Unified...

This is Blog #2 in a series of blog posts about Databricks security. My colleague David Cook (our CISO) laid out Databricks' approach to Security in blog #1.  With this blog, I will be talking in detail about our platform. DIY Platforms: A Lack of Cohesion in Security Many companies today operate on homegrown DIY big...