Announcing General Availability of Liquid ClusteringMay 22, 2024 by Cindy Jiang and Terry Kim in Platform Blog We're excited to announce the General Availability of Delta Lake Liquid Clustering in the Databricks Data Intelligence Platform. Liquid Clustering is an innovative...
Announcing Delta Lake 3.0 with New Universal Format and Liquid ClusteringJune 29, 2023 by Ryan Johnson, Michael Armbrust, Reynold Xin, Denny Lee, Tathagata Das, Bart Samwel, Terry Kim, Sirui Sun, Himanshu Raja, Rahul Potharaju, Juan Yu and Susan Pierce in Engineering Blog We are excited to announce Delta Lake 3.0, the next major release of the Linux Foundation open source Delta Lake Project, available in...
How Databricks improved query performance by up to 2.2x by automatically optimizing file sizesMay 22, 2023 by Sirui Sun, Himanshu Raja, Vijayan Prabhakaran, Terry Kim, Bart Samwel, Rahul Mahadev, Rajesh Parangi Sharabhalingappa, Rahul Potharaju and Kam Cheung Ting in Platform Blog Optimizing tables has long been a necessary but complicated task for data engineers. One particularly thorny area has been getting to the optimal...