Databricks and Jupyter: Announcing ipywidgets in the Databricks Notebook
Today, we are excited to announce a deeper integration between the Databricks Notebook and the ecosystem established by Project Jupyter, a leader in...
Identity Columns to Generate Surrogate Keys Are Now Available in a Lakehouse Near You!
What is an identity column? An identity column is a column in a database that automatically generates a unique ID number for each...
Announcing Photon Engine General Availability on the Databricks Lakehouse Platform
We are pleased to announce that Photon , the record-setting next-generation query engine for lakehouse systems, is now generally available on Databricks across...
How to Build a Marketing Analytics Solution Using Fivetran and dbt on the Databricks Lakehouse
Marketing teams use many different platforms to drive marketing and sales campaigns, which can generate a significant volume of valuable but disconnected data...
Sharing Context Between Tasks in Databricks Workflows
Databricks Workflows is a fully-managed service on Databricks that makes it easy to build and manage complex data and ML pipelines in your...
Security Best Practices for Delta Sharing
Update: Delta Sharing is now generally available on AWS and Azure. The data lakehouse has enabled us to consolidate our data management architectures...
Databricks SQL Highlights From Data & AI Summit
Data warehouses are not keeping up with today's world: the explosion of languages other than SQL, unstructured data, machine learning, IoT and streaming...
Building a Cybersecurity Lakehouse for CrowdStrike Falcon Events Part II
Visibility is critical when it comes to cyber defense – you can't defend what you can't see. In the context of a modern...
Scanning for Arbitrary Code in Databricks Workspace With Improved Search and Audit Logs
How can we tell whether our users are using a compromised library? How do we know whether our users are using that API...
Recap of Databricks Machine Learning announcements from Data & AI Summit
Databricks Machine Learning on the lakehouse provides end-to-end machine learning capabilities from data ingestion and training to deployment and monitoring, all in one...