Databricks Security Advisory: Critical Runc Vulnerability (CVE-2019-5736)
Databricks became aware of a new critical runc vulnerability (CVE-2019-5736) on February 12, 2019 that allows malicious container users to gain root access...
AI Trends that Paved the Way in 2018
With 2018 behind us, it’s been amazing to see AI projects gain steam and make significant impact across industries. In fact, a recent...
How to Work with Avro, Kafka, and Schema Registry in Databricks
In the previous blog post , we introduced the new built-in Apache Avro data source in Apache Spark and explained how you can...
Near-Real-Time Hardware Failure Rate Estimation with Bayesian Reasoning
Try this notebook in Databricks You might be using Bayesian techniques in your data science without knowing it! And if you're not, then...
High-Performance Modern Data Warehousing with Azure Databricks and Azure SQL Data Warehouse
As organizations move to the cloud, the architecture for a Modern Data Warehouse (MDW) allows a new level of performance and scalability. A...
Announcing Databricks Runtime 5.2
We are excited to announce the release of Databricks Runtime 5.2 which introduces several new features including the following: Delta Time Travel Fast...
Introducing Delta Time Travel for Large Scale Data Lakes
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake . Data versioning for...
Accelerating Machine Learning on Databricks: On-Demand Webinar and FAQ Now Available!
Try this notebook in Databricks On January 15th, we hosted a live webinar— Accelerating Machine Learning on Databricks —with Adam Conway, VP of...
Databricks Runtime 5.2 ML Features Multi-GPU Workflow, Pregel API, and Performant GraphFrames
We are excited to announce the release of Databricks Runtime 5.2 for Machine Learning. This release includes several new features and performance improvements...
Apparate: Managing Libraries in Databricks with CI/CD
This is a guest blog from Hanna Torrence, Data Scientist at ShopRunner. Introduction As leveraging data becomes a more vital component of organizations'...