Introducing Predictive Optimization: Faster Queries, Cheaper Storage, No SweatOctober 26, 2023 by Sirui Sun, Vijayan Prabhakaran, Naga Raju Bhanoori, Rajesh Parangi Sharabhalingappa, Jintian Liang, Kam Cheung Ting, Vivek Narasimhan, Sunitha Beeram, Himanshu Raja, Rahul Potharaju, Reynold Xin, Matei Zaharia and Susan Pierce in Platform Blog Predictive Optimization intelligently optimizes your Lakehouse table data layouts for peak performance and cost-efficiency - without you needing to lift a finger.
How Databricks improved query performance by up to 2.2x by automatically optimizing file sizesMay 22, 2023 by Sirui Sun, Himanshu Raja, Vijayan Prabhakaran, Terry Kim, Bart Samwel, Rahul Mahadev, Rajesh Parangi Sharabhalingappa, Rahul Potharaju and Kam Cheung Ting in Platform Blog Optimizing tables has long been a necessary but complicated task for data engineers. One particularly thorny area has been getting to the optimal...