Skip to main content
Page 1

Security best practices for the Databricks Data Intelligence Platform

At Databricks, we know that data is one of your most valuable assets. Our product and security teams work together to deliver an...

Improve Lakehouse Security Monitoring using System Tables in Databricks Unity Catalog

As the lakehouse becomes increasingly mission-critical to data-forward organizations, so too grows the risk that unexpected events, outages, and security incidents may derail...

Security best practices for the Databricks Lakehouse Platform

Your data security is our priority At Databricks, we know that data is one of your most valuable assets and always has to...

Monitoring Notebook Command Logs With Static Analysis Tools

November 1, 2022 by Silvio Fiorito in
Background Code review and static analysis tools are standard practices in the Software Development Lifecycle (SDLC). Static analysis tools help developers find code...

Using Enhanced Security Monitoring to Detect & Alert for Suspicious Activity on Your Databricks Clusters

September 1, 2022 by Silvio Fiorito in
Databricks on AWS relies on custom machine images, AMIs, deployed as EC2 instances in the customer’s account. These EC2 instances provide the elastic...

Building ETL pipelines for the cybersecurity lakehouse with Delta Live Tables

Databricks recently introduced Workflows to enable data engineers, data scientists, and analysts to build reliable data, analytics, and ML workflows on any cloud...

Monitoring Your Databricks Lakehouse Platform with Audit Logs

This blog is part two of our Admin Essentials series, where we'll focus on topics that are important to those managing and maintaining...

How Databricks IAM Credential Passthrough Solves Common Data Authorization Problems

July 17, 2019 by Greg Owen and Silvio Fiorito in
In our first blog post , we introduced Databricks IAM Credential Passthrough as a secure, convenient way for customers to manage access to...

Introducing Databricks AWS IAM Credential Passthrough

March 26, 2019 by Silvio Fiorito and Greg Owen in
As more and more analytics move to the cloud, customers are faced with the challenge of how to control which users have access...

Learn about Apache Spark APIs and Best Practices

September 12, 2017 by Jules Damji and Silvio Fiorito in
Since Apache Spark 1.3, Spark and its APIs have evolved to make them easier, faster, and smarter. The goal has been to unify...