Easy Ingestion to Lakehouse With COPY INTO
A new data management architecture known as the data lakehouse emerged independently across many organizations and use cases to support AI and BI...
Supercharging H3 for Geospatial Analytics
On the heels of the initial release of H3 support in Databricks Runtime (DBR ), we are happy to share ground-breaking performance improvements...
Databricks Power BI Connector Now Supports Native Query
This is a collaborative post from Databricks and Microsoft. We thank Mahesh Prakriya (Director in Intelligence Platform, Microsoft) and Bob Zhang (Sr. Technical...
Streaming in Production: Collected Best Practices, Part 2
In our two-part blog series titled "Streaming in Production: Collected Best Practices," this is the second article. Here we discuss the "After Deployment"...
Better Alerts: Announcing New Workflows Notifications
Databricks Workflows is a fully-managed orchestration service that is deeply integrated with the Databricks Lakehouse Platform. Workflows is a great alternative to Airflow...
Reuse Existing Workflows Through Terraform
Part 2 of the blog series on deploying Workflows through Terraform. Here we focus on how to convert inherited Workflows into Terraform IaC...
Building a Cybersecurity Lakehouse for CrowdStrike Falcon Events Part III
In Part I of this series, we walked through the process of setting up a Cybersecurity Lakehouse that allowed us to collect and...
Streaming in Production: Collected Best Practices
Releasing any data pipeline or application into a production state requires planning, testing, monitoring, and maintenance. Streaming pipelines are no different in this...
Announcing General Availability of Data lineage in Unity Catalog
Today, we are excited to announce the general availability of data lineage in Unity Catalog , available on AWS and Azure. With data...
Best Practices for Super Powering Your dbt Project on Databricks
dbt is a data transformation framework that enables data teams to collaboratively model, test and document data in data warehouses . Getting started...