Project Lightspeed: Faster and Simpler Stream Processing With Apache Spark
Streaming data is a critical area of computing today. It is the basis for making quick decisions on the enormous amounts of incoming...
Announcing General Availability of Databricks’ Delta Live Tables (DLT)
Today, we are thrilled to announce that Delta Live Tables (DLT) is generally available (GA) on the Amazon AWS and Microsoft Azure clouds...
Databricks Delta Live Tables Announces Support for Simplified Change Data Capture
As organizations adopt the data lakehouse architecture, data engineers are looking for efficient ways to capture continually arriving data. Even with the right...
Frequently Asked Questions About the Data Lakehouse
Question Index What is a Data Lakehouse? What is a Data Lake? What is a Data Warehouse? How is a Data Lakehouse different...
Announcing the Launch of Delta Live Tables: Reliable Data Engineering Made Easy
SIGN UP FOR PUBLIC PREVIEW As the amount of data, data sources and data types at organizations grow, building and maintaining reliable data...
Introducing Delta Sharing: An Open Protocol for Secure Data Sharing
Update: Delta Sharing is now generally available on AWS and Azure. Get an early preview of O'Reilly's new ebook for the step-by-step guidance...
What Is a Lakehouse?
Read Building the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data warehouse...
Delta Lake Now Hosted by the Linux Foundation to Become the Open Standard for Data Lakes
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. At today’s Spark +...
Diving Into Delta Lake: Unpacking The Transaction Log
The transaction log is key to understanding Delta Lake because it is the common thread that runs through many of its most important...
How to Work with Avro, Kafka, and Schema Registry in Databricks
In the previous blog post , we introduced the new built-in Apache Avro data source in Apache Spark and explained how you can...