Fast Parallel Testing at Databricks with Bazel
The Databricks Developer Tools team recently completed a project to greatly speed up the pull-request (PR) validation workflows for many of our engineers...
Announcing the MLflow 1.1 Release
We’re excited to announce today the release of MLflow 1.1. In this release, we’ve focused on fleshing out the tracking component of MLflow...
Automated Hyperparameter Tuning, Scaling and Tracking: On-Demand Webinar and FAQs now available!
Try this notebook in Databricks On June 20th, our team hosted a live webinar— Automated Hyperparameter Tuning, Scaling and Tracking on Databricks —with...
How Databricks IAM Credential Passthrough Solves Common Data Authorization Problems
In our first blog post , we introduced Databricks IAM Credential Passthrough as a secure, convenient way for customers to manage access to...
Announcing Databricks Runtime 5.5 and Runtime 5.5 for Machine Learning
Databricks is pleased to announce the release of Databricks Runtime 5.5. This release includes Apache Spark 2.4.3 along with several important improvements and...
Migrating Transactional Data to a Delta Lake using AWS DMS
Try this notebook in Databricks Note: We also recommend you read Efficient Upserts into Data Lakes with Databricks Delta which explains the use...
Getting Data Ready for Data Science: On-Demand Webinar and Q&A Now Available
On June 25th, our team hosted a live webinar — Getting Data Ready for Data Science — with Prakash Chockalingam, Product Manager at...
Scaling Genomic Workflows with Spark SQL BGEN and VCF Readers
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Announcing Databricks Runtime 5.4
Databricks is pleased to announce the release of Databricks Runtime 5.4. This release includes Apache Spark 2.4.3 along with several important improvements and...
Accurately Building Genomic Cohorts at Scale with Delta Lake and Spark SQL
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. This is the second...