Announcing Public Preview of Data Lineage in Unity Catalog
Today, we are excited to announce the public preview of data lineage in Unity Catalog , available on AWS and Azure. In the...
Four Steps to Migrate a SAS Data Warehouse to the Lakehouse
Although SAS is known as the analytical platform, it is quite often that an organization uses it for data engineering and even for...
Previewing Updates to the Databricks Notebook
At Databricks, we are committed to delivering a world-class, data-driven development experience in the Notebook, and we are very excited to preview the...
Using Enhanced Security Monitoring to Detect & Alert for Suspicious Activity on Your Databricks Clusters
Databricks on AWS relies on custom machine images, AMIs, deployed as EC2 instances in the customer’s account. These EC2 instances provide the elastic...
Cybersecurity in the Era of Multiple Clouds and Regions
In 2021, more than three quarters of all enterprises have infrastructure in multiple clouds . This trend shows no signs of slowdown with...
Databricks Workspace Administration – Best Practices for Account, Workspace and Metastore Admins
This blog is part of our Admin Essentials series, where we discuss topics relevant to Databricks administrators. Other blogs include our Workspace Management...
Announcing General Availability of Delta Sharing
Today we are excited to announce that Delta Sharing is generally available (GA) on AWS and Azure. With the GA release, you can...
Cohort Analysis on Databricks Using Fivetran, dbt and Tableau
Overview Cohort Analysis refers to the process of studying the behavior, outcomes and contributions of customers (also known as a “cohort”) over a...
Restricting Libraries in JVM Compute Platforms
Security challenges with Scala and Java libraries Open source communities have built incredibly useful libraries. They simplify many common development scenarios. Through our...
Feature Deep Dive: Watermarking in Apache Spark Structured Streaming
Key Takeaways Watermarks help Spark understand the processing progress based on event time, when to produce windowed aggregates and when to trim the...