What’s New in Data Engineering and Streaming at Data + AI Summit 2023June 29, 2023 by Ori Zohar and Matt Jones in Platform Blog It's Thursday and we are fresh off a week of announcements from the 2023 Data + AI Summit. The theme of this year's...
Build governed pipelines with Delta Live Tables and Unity CatalogJune 23, 2023 by Zoe Durand, Mukul Murthy, Jon Mio and Yuhong Chen in Platform Blog We are excited to announce the public preview of Unity Catalog support for Delta Live Tables (DLT). With this preview, any data team...
Introducing Lakehouse AppsJune 21, 2023 by Matei Zaharia, Shanku Niyogi and Prem Prakash in Platform Blog Lakehouse Apps is a new way to build native applications for Databricks. Lakehouse Apps will offer the most secure way to build, distribute...
Lakehouse Orchestration with Databricks WorkflowsJune 13, 2023 by Ori Zohar, Richard Tomlinson, Bilal Aslam, Erika Ehrli and Roland Fäustlin in Platform Blog Organizations across industries are adopting the lakehouse architecture and using a unified platform for all their data, analytics and AI workloads. When moving...
Extending Databricks Unity Catalog with an Open Apache Hive Metastore APIJune 9, 2023 by Todd Greenstein, Junlin Zeng, Vihang Karajgaonkar, Zeashan Pappa, Abhishek Pratap Singh, Sachin Thakur and Matei Zaharia in Platform Blog Today, we are excited to announce the preview of a Hive Metastore (HMS) interface for Databricks Unity Catalog , which allows any software...
Easy Ingestion to Lakehouse with File Upload and Add Data UIMay 31, 2023 by Emma Liu, Vincent Liaw, Yu Guo, Maraki Ketema, Amit Kara and Brecht Moulin in Platform Blog Data ingestion into the Lakehouse can be a bottleneck for many organizations, but with Databricks, you can quickly and easily ingest data of...
Using Structured Streaming with Delta Sharing in Unity CatalogMay 9, 2023 by Will Girten, Josh Seidel, Lin Zhou and Sachin Thakur in Platform Blog We are excited to announce that support for using Structured Streaming with Delta Sharing is now generally available (GA) in Azure, AWS, and...
Find what you seek with the new navigation UIMay 2, 2023 by Austin Green, Jim Allen Wallace, Justin Kim, Tyler Townley and Xiaolei Shi in Platform Blog We are excited to announce that we will be releasing a new UI that will make it easier for you to navigate Databricks...
Acceleration Unlocked: DS3_v2 Instance Types on Azure now supported by PhotonMay 1, 2023 by Zach Christopherson, Han Xiao, Desmond Cheong and Kent Marten in Platform Blog At Databricks, we offer maximal flexibility for choosing compute for ETL and ML/AI workloads. Staying true to the theme of flexibility, we announce...
Announcing the General Availability of Predictive I/O for ReadsApril 25, 2023 by Shoumik Palkar, Justin Breese, Shant Hovsepian, Kent Marten and Cyrielle Simeone in Platform Blog Today, we are excited to announce the general availability of Predictive I/O for Databricks SQL (DB SQL) : a machine learning powered feature...