Diving Into Delta Lake: Unpacking The Transaction Log
The transaction log is key to understanding Delta Lake because it is the common thread that runs through many of its most important...
AutoML on Databricks: Augmenting Data Science from Data Prep to Operationalization
Thousands of data science jobs are going unfilled today as global demand for the talent greatly outstrips supply. Every day, businesses pay the...
Network performance regressions from TCP SACK vulnerability fixes
Update on Aug 2, 2019: Added to the end explaining our kernel patch and additional details we found. On June 17, three vulnerabilities...
Announcing Databricks Runtime 5.5 with Conda (Beta)
Databricks is pleased to announce the release of Databricks Runtime 5.5 with Conda (Beta). We introduced Databricks Runtime 5.4 with Conda (Beta), with...
Announcing the MLflow 1.1 Release
We’re excited to announce today the release of MLflow 1.1. In this release, we’ve focused on fleshing out the tracking component of MLflow...
How Databricks IAM Credential Passthrough Solves Common Data Authorization Problems
In our first blog post , we introduced Databricks IAM Credential Passthrough as a secure, convenient way for customers to manage access to...
Announcing Databricks Runtime 5.4
Databricks is pleased to announce the release of Databricks Runtime 5.4. This release includes Apache Spark 2.4.3 along with several important improvements and...
Simplifying Streaming Stock Analysis using Delta Lake and Apache Spark: On-Demand Webinar and FAQ Now Available!
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. On June 13th, we...
Databricks Connect: Bringing the capabilities of hosted Apache Spark™ to applications and microservices
In this blog post we introduce Databricks Connect , a new library that allows you to leverage native Apache Spark APIs from any...
Enhanced Hyperparameter Tuning and Optimized AWS Storage with Databricks Runtime 5.4 ML
We are excited to announce the release of Databricks Runtime 5.4 ML ( Azure | AWS ). This release includes two Public Preview...