Skip to main content
Page 1

Project Lightspeed Update - Advancing Apache Spark Structured Streaming

June 28, 2023 by Karthik Ramasamy, Michael Armbrust, Matei Zaharia, Reynold Xin, Praveen Gattu, Ray Zhu, Shrikanth Shankar, Awez Syed, Sameer Paranjpye, Frank Munz and Matt Jones in Engineering Blog
In this blog post, we will review the advancements in Spark Structured Streaming since we announced Project Lightspeed a year ago, from performance...

Real-Time Insights: The Top Three Reasons Why Customers Love Data Streaming with Databricks

March 14, 2023 by Erika Ehrli, Karthikeyan Ramasamy, Ray Zhu, Richard Tomlinson, Matt Jones and Frank Munz in Announcements
The world operates in real-time The ability to make real-time decisions in today's fast paced world is more critical than ever before. Today's...

Project Lightspeed: Faster and Simpler Stream Processing With Apache Spark

June 28, 2022 by Karthik Ramasamy, Matei Zaharia, Reynold Xin, Michael Armbrust, Awez Syed, Ray Zhu, Alexander Balikov, Jerry Peng, Shrikanth Shankar and Sameer Paranjpye in Engineering Blog
Streaming data is a critical area of computing today. It is the basis for making quick decisions on the enormous amounts of incoming...

Structured Streaming: A Year in Review

February 7, 2022 by Steven Yu and Ray Zhu in Data Engineering
As we enter 2022, we want to take a moment to reflect on the great strides made on the streaming front in Databricks...