Skip to main content
Page 1
>

Predictive Optimization Automatically Delivers Faster Queries and Lower TCO

December 2, 2024 by Cindy Jiang, Don Jang, Naga Raju Bhanoori, Mostafa Mokhtar and Kent Marten in Platform Blog
Predictive Optimization (PO) enhances the performance of Unity Catalog managed tables by intelligently optimizing data layouts, leading to significant improvements in query performance...

Introducing Predictive Optimization for Statistics

November 20, 2024 by Kent Marten and Mohamed Zait in Platform Blog
We are excited to introduce the gated Public Preview of Predictive Optimization for statistics. Announced at the Data + AI Summit, Predictive Optimization...

Season's Speedings: Databricks SQL Delivers 4x Performance Boost Over Two Years

November 7, 2024 by Jeremy Lewallen, Kent Marten, Ina Felsheim and Maggie Wu in Platform Blog
As the season of giving approaches, we at Databricks have been making our list and checking it twice--but instead of toys and treats...

Introducing the Open Variant Data Type in Delta Lake and Apache Spark

June 2, 2024 by Kent Marten, Gene Pang, Chenhao Li and Han Xiao in Engineering Blog
We are excited to announce a new data type called variant for semi-structured data. Variant provides an order of magnitude performance improvements compared...

Acceleration Unlocked: DS3_v2 Instance Types on Azure now supported by Photon

May 1, 2023 by Zach Christopherson, Han Xiao, Desmond Cheong and Kent Marten in Platform Blog
At Databricks, we offer maximal flexibility for choosing compute for ETL and ML/AI workloads. Staying true to the theme of flexibility, we announce...

Announcing the General Availability of Predictive I/O for Reads

April 25, 2023 by Shoumik Palkar, Justin Breese, Shant Hovsepian, Kent Marten and Cyrielle Simeone in Platform Blog
Today, we are excited to announce the general availability of Predictive I/O for Databricks SQL (DB SQL) : a machine learning powered feature...

Supercharging H3 for Geospatial Analytics

January 12, 2023 by Kent Marten, Michael Johns, Menelaos Karavelas and Desmond Cheong in Platform Blog
On the heels of the initial release of H3 support in Databricks Runtime (DBR ), we are happy to share ground-breaking performance improvements...

Spatial Analytics at Any Scale With H3 and Photon

December 7, 2022 by Kent Marten, Michael Johns and Menelaos Karavelas in Engineering Blog
H3's global grid indexing system is driving new patterns for spatial analytics across a variety of geospatial use-cases. Recently, Databricks added built-in support...

ArcGIS GeoAnalytics Engine in Databricks

December 6, 2022 by Kent Marten and Arif Masrur in Platform Blog
This is a collaborative post from Esri and Databricks. We thank Senior Solution Engineer Arif Masrur, Ph.D. at Esri for his contributions. Advances...

Announcing Built-in H3 Expressions for Geospatial Processing and Analytics

September 14, 2022 by Kent Marten, Menelaos Karavelas and Michael Johns in Engineering Blog
The 11.2 Databricks Runtime is a milestone release for Databricks and for customers processing and analyzing geospatial data. The 11.2 release introduces 28...
Next