Announcing General Availability of Databricks’ Delta Live Tables (DLT)
Today, we are thrilled to announce that Delta Live Tables (DLT) is generally available (GA) on the Amazon AWS and Microsoft Azure clouds,…
Databricks Delta Live Tables Announces Support for Simplified Change Data Capture
As organizations adopt the data lakehouse architecture, data engineers are looking for efficient ways to capture continually arriving data. Even with the right…
Frequently Asked Questions About the Data Lakehouse
Question Index What is a Data Lakehouse? What is a Data Lake? What is a Data Warehouse? How is a Data Lakehouse different…
Announcing the Launch of Delta Live Tables: Reliable Data Engineering Made Easy
As the amount of data, data sources and data types at organizations grow, building and maintaining reliable data pipelines has become a key…
Introducing Delta Sharing: An Open Protocol for Secure Data Sharing
Data sharing has become critical in the modern economy as enterprises look to securely exchange data with their customers, suppliers and partners. For…
What Is a Lakehouse?
Over the past few years at Databricks, we’ve seen a new data management architecture that emerged independently across many customers and use cases:…
Delta Lake Now Hosted by the Linux Foundation to Become the Open Standard for Data Lakes
At today’s Spark + AI Summit Europe in Amsterdam, we announced that Delta Lake is becoming a Linux Foundation project. Together with the…
Diving Into Delta Lake: Unpacking The Transaction Log
The transaction log is key to understanding Delta Lake because it is the common thread that runs through many of its most important…
How to Work with Avro, Kafka, and Schema Registry in Databricks
In the previous blog post, we introduced the new built-in Apache Avro data source in Apache Spark and explained how you can use…
Apache Avro as a Built-in Data Source in Apache Spark 2.4
Apache Avro is a popular data serialization format. It is widely used in the Apache Spark and Apache Hadoop ecosystem, especially for Kafka-based…
