Skip to main content
Page 1
Platform blog

Improve Lakehouse Security Monitoring using System Tables in Databricks Unity Catalog

As the lakehouse becomes increasingly mission-critical to data-forward organizations, so too grows the risk that unexpected events, outages, and security incidents may derail...
Engineering blog

Announcing Terraform Databricks modules

The Databricks Terraform provider reached more than 10 million installations, significantly increasing adoption since it became generally available less than one year ago...
Platform blog

Applying software development & DevOps best practices to Delta Live Table pipelines

April 28, 2023 by Alex Ott in Platform Blog
Databricks Delta Live Tables (DLT) radically simplifies the development of the robust data processing pipelines by decreasing the amount of code that data...
Platform blog

Production-Ready and Resilient Disaster Recovery for DLT Pipelines

March 17, 2023 by Tony Farias and Alex Ott in Platform Blog
Disaster recovery is a standard requirement for many production systems, especially in the regulated industries. As many companies rely on data to make...
Platform blog

Building a Cybersecurity Lakehouse for CrowdStrike Falcon Events Part III

December 16, 2022 by Alex Ott, Aemro Amare and Kristin Waters in Platform Blog
In Part I of this series, we walked through the process of setting up a Cybersecurity Lakehouse that allowed us to collect and...
Platform blog

Build Reliable and Cost Effective Streaming Data Pipelines With Delta Live Tables’ Enhanced Autoscaling

This year we announced the general availability of Delta Live Tables (DLT) , the first ETL framework to use a simple, declarative approach...
Platform blog

Building a Cybersecurity Lakehouse for CrowdStrike Falcon Events Part II

July 19, 2022 by Aemro Amare, Alex Ott and Kristin Waters in Product
Visibility is critical when it comes to cyber defense – you can't defend what you can't see. In the context of a modern...
Platform blog

Databricks Terraform Provider Is Now Generally Available

June 22, 2022 by Serge Smertin, Alex Ott and Vuong Nguyen in Product
Today, we are thrilled to announce that Databricks Terraform Provider is generally available (GA)! HashiCorp Terraform is a popular open source infrastructure as...
Engineering blog

Build Data and ML Pipelines More Easily With Databricks and Apache Airflow

We are excited to announce a series of enhancements in Apache Airflow’s support for Databricks. These new features make it easy to build...