Skip to main content
Page 1

Announcing GA of Predictive I/O for Updates: Faster DML Queries, Right Out of the Box

November 2, 2023 by Sirui Sun, Ala Luszczak, Sabir Akhadov, Andreas Chatzistergiou, Carmen Kwan, Ole Sasse, Tom van Bussel, Lars Kroll, Pengfei Xu, Polo-François Poli, Bart Samwel, Himanshu Raja, Christos Stavrakakis, Venki Korukanti, Tathagata Das and Nicolas Poggi in Platform & Products & Announcements
Announcing GA of Predictive I/O for Updates, which harnesses Photon and AI atop Deletion Vectors in order to significantly speed up MERGE, UPDATE and DELETE operations. We've prevented over 15 trillion unnecessary row writes, and we’re just getting started.

Introducing Ingestion Time Clustering with Databricks SQL and Databricks Runtime 11.2

November 17, 2022 by Piyush Revuri, Tom van Bussel, Joe Widen, Bart Samwel, Sabir Akhadov and Carmen Kwan in Engineering Blog
Databricks customers are processing over an exabyte of data every day on the Databricks Lakehouse platform using Delta Lake , a significant amount...

Faster MERGE Performance With Low-Shuffle MERGE and Photon

October 16, 2022 by Bart Samwel, Piyush Revuri, Himanshu Raja, Justin Breese, Tom van Bussel, Lars Kroll, Sabir Akhadov, Tathagata Das and Prakhar Jain in Platform Blog
At Databricks, one of our key goals is to provide our customers with an industry-best price/performance experience out of the box. From ETL...