Announcing the General Availability of Materialized Views and Streaming Tables for Databricks SQL
We’re excited to announce that materialized views (MVs) and streaming tables (STs) are now Generally Available in Databricks SQL on AWS and Azure...
Page 1
>
Cost-effective, incremental ETL with serverless compute for Delta Live Tables pipelines
We recently announced the general availability of serverless compute for Notebooks, Workflows, and Delta Live Tables (DLT) pipelines. Today, we'd like to explain...
Introducing Databricks LakeFlow: A unified, intelligent solution for data engineering
Today, we are excited to announce Databricks LakeFlow, a new solution that contains everything you need to build and operate production data pipelines...
Data Intelligence Platforms
The observation that " software is eating the world " has shaped the modern tech industry. Today, software is ubiquitous in our lives...
Announcing Delta Lake 3.0 with New Universal Format and Liquid Clustering
We are excited to announce Delta Lake 3.0, the next major release of the Linux Foundation open source Delta Lake Project, available in...
Project Lightspeed Update - Advancing Apache Spark Structured Streaming
In this blog post, we will review the advancements in Spark Structured Streaming since we announced Project Lightspeed a year ago, from performance...
Introducing Materialized Views and Streaming Tables for Databricks SQL
We are thrilled to announce that materialized views and streaming tables are now publicly available in Databricks SQL on AWS and Azure. Streaming...
Latency goes subsecond in Apache Spark Structured Streaming
Apache Spark Structured Streaming is the leading open source stream processing platform. It is also the core technology that powers streaming on the...
Open Sourcing All of Delta Lake
The theme of this year's Data + AI Summit is that we are building the modern data stack with the lakehouse. A fundamental...
Delta Live Tables Announces New Capabilities and Performance Optimizations
Since the availability of Delta Live Tables (DLT) on all clouds in April ( announcement ), we've introduced new features to make development...