Introducing Apache Spark™ 3.5
Today, we are happy to announce the availability of Apache Spark™ 3.5 on Databricks as part of Databricks Runtime 14.0. We extend our...
Announcing Databricks Belgrade Development Center
We are thrilled to announce the opening of Databricks’ latest development center in Belgrade, Serbia. This addition joins our existing R&D centers in...
Databricks + MosaicML
Today, we’re excited to share that we’ve completed our acquisition of MosaicML, a leading platform for creating and customizing generative AI models for...
Introducing English as the New Programming Language for Apache Spark
Introduction We are thrilled to unveil the English SDK for Apache Spark, a transformative tool designed to enrich your Spark experience. Apache Spark™...
Announcing Delta Lake 3.0 with New Universal Format and Liquid Clustering
We are excited to announce Delta Lake 3.0, the next major release of the Linux Foundation open source Delta Lake Project, available in...
Project Lightspeed Update - Advancing Apache Spark Structured Streaming
In this blog post, we will review the advancements in Spark Structured Streaming since we announced Project Lightspeed a year ago, from performance...
Welcome Rubicon to Databricks: The Future of AI Storage and Serving Systems
We are incredibly excited to announce that the team behind Rubicon is joining Databricks. Founded by large scale infrastructure builders, Akhil Gupta and...
Welcome Okera: Adopting an AI-centric approach to governance
For a decade, Databricks has focused on democratizing data and AI for organizations around the world. And since the debut of ChatGPT last...
Spark Connect Available in Apache Spark 3.4
Last year Spark Connect was introduced at the Data and AI Summit. As part of the recently released Apache SparkTM 3.4, Spark Connect...
Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0
Today, we are happy to announce the availability of Apache Spark™ 3.4 on Databricks as part of Databricks Runtime 13.0 . We extend...