Introducing the Open Variant Data Type in Delta Lake and Apache SparkJune 3, 2024 by Kent Marten, Gene Pang, Chenhao Li and Han Xiao in Engineering Blog We are excited to announce a new data type called variant for semi-structured data. Variant provides an order of magnitude performance improvements compared...
Acceleration Unlocked: DS3_v2 Instance Types on Azure now supported by PhotonMay 1, 2023 by Zach Christopherson, Han Xiao, Desmond Cheong and Kent Marten in Platform Blog At Databricks, we offer maximal flexibility for choosing compute for ETL and ML/AI workloads. Staying true to the theme of flexibility, we announce...