Securing Databricks cluster init scripts
This blog was co-authored by Elia Florio, Sr. Director of Detection & Response at Databricks and Florian Roth and Marius Bartholdy, security researchers...
Databricks ❤️ Hugging Face
Generative AI has been taking the world by storm. As the data and AI company, we have been on this journey with the...
Announcing the General Availability of Predictive I/O for Reads
Today, we are excited to announce the general availability of Predictive I/O for Databricks SQL (DB SQL) : a machine learning powered feature...
Announcing the Public Preview of Predictive I/O for Updates
Previously, we’ve shown you how a new technology called Predictive I/O could improve selective reads by up to 35x for CDW customers without...
Processing data simultaneously from multiple streaming platforms using Delta Live Tables
One of the major imperatives of organizations today is to enable decision making at the speed of business. Business teams and autonomous decisioning...
PyTorch on Databricks - Introducing the Spark PyTorch Distributor
Background and Motives Deep Learning algorithms are complex and time consuming to train, but are quickly moving from the lab to production because...
Building Data Applications on the Lakehouse With the Databricks SQL Driver for Node.js
We are excited to announce the general availability of the Databricks SQL Driver for NodeJS . This follows the recent general availability of...
Building Data Applications on the Lakehouse With the Databricks SQL Driver for GO
We are excited to announce the general availability of the Databricks SQL Driver for GO . This follows the recent general availability of...
Spark Connect Available in Apache Spark 3.4
Last year Spark Connect was introduced at the Data and AI Summit. As part of the recently released Apache SparkTM 3.4, Spark Connect...
Introducing AI Functions: Integrating Large Language Models with Databricks SQL
With all the incredible progress being made in the space of Large Language Models, customers have asked us how they can enable their...