New Databricks Delta Features Simplify Data Pipelines
Continued Innovation and Expanded Availability for the Next-gen Unified Analytics Engine Databricks Delta Lake the next generation unified analytics engine, built on top...
Databricks Security Advisory: Critical Runc Vulnerability (CVE-2019-5736)
Databricks became aware of a new critical runc vulnerability (CVE-2019-5736) on February 12, 2019 that allows malicious container users to gain root access...
How to Work with Avro, Kafka, and Schema Registry in Databricks
In the previous blog post , we introduced the new built-in Apache Avro data source in Apache Spark and explained how you can...
Near-Real-Time Hardware Failure Rate Estimation with Bayesian Reasoning
Try this notebook in Databricks You might be using Bayesian techniques in your data science without knowing it! And if you're not, then...
Announcing Databricks Runtime 5.2
We are excited to announce the release of Databricks Runtime 5.2 which introduces several new features including the following: Delta Time Travel Fast...
Accelerating Machine Learning on Databricks: On-Demand Webinar and FAQ Now Available!
Try this notebook in Databricks On January 15th, we hosted a live webinar— Accelerating Machine Learning on Databricks —with Adam Conway, VP of...
Apparate: Managing Libraries in Databricks with CI/CD
This is a guest blog from Hanna Torrence, Data Scientist at ShopRunner. Introduction As leveraging data becomes a more vital component of organizations'...
CIO Survey: Top 3 Challenges Adopting AI and How to Overcome Them
We recently hosted the webinar — CIO Survey: Enterprise Challenges to AI and How to Overcome Them — featuring Jen Garofalo, Research Director...
Is your AI software vendor taking security shortcuts?
This is the final part of our blog series on security available here . In this blog, I will be talking about our...
Are you ready to scale your Data and AI initiatives? How will you scale your security?
This is Blog #3 in a series of blog posts about Databricks security. My colleagues David Cook (our CISO) and David Meyer (SVP...