Announcing the Public Preview of Predictive I/O for UpdatesApril 25, 2023 by Piyush Revuri, Bart Samwel, Ala Luszczak, Lars Kroll, Polo-François Poli, Frank Munz and Himanshu Raja in Platform Blog Previously, we’ve shown you how a new technology called Predictive I/O could improve selective reads by up to 35x for CDW customers without...
Introducing Ingestion Time Clustering with Databricks SQL and Databricks Runtime 11.2November 18, 2022 by Piyush Revuri, Tom van Bussel, Joe Widen, Bart Samwel, Sabir Akhadov and Carmen Kwan in Engineering Blog Databricks customers are processing over an exabyte of data every day on the Databricks Lakehouse platform using Delta Lake , a significant amount...
Faster MERGE Performance With Low-Shuffle MERGE and PhotonOctober 17, 2022 by Bart Samwel, Piyush Revuri, Himanshu Raja, Justin Breese, Tom van Bussel, Lars Kroll, Sabir Akhadov, Tathagata Das and Prakhar Jain in Platform Blog At Databricks, one of our key goals is to provide our customers with an industry-best price/performance experience out of the box. From ETL...