Databricks + Arcion: Real-time enterprise data replication to the LakehouseNovember 6, 2023 by Reynold Xin, Sameer Paranjpye, Awez Syed, Bilal Aslam, Erika Ehrli, Ori Zohar and Cassie Miao in Announcements We are excited to announce that we have completed our acquisition of Arcion , a leading provider for real-time data replication technologies. Arcion’s...
Introducing Databricks Bengaluru Development CenterSeptember 5, 2023 by Sameer Paranjpye and Vinod Marur in Company Blog In May this year, we opened our latest development center in Bengaluru, India. We've been busy building out our R&D teams in India...
Project Lightspeed Update - Advancing Apache Spark Structured StreamingJune 28, 2023 by Karthik Ramasamy, Michael Armbrust, Matei Zaharia, Reynold Xin, Praveen Gattu, Ray Zhu, Shrikanth Shankar, Awez Syed, Sameer Paranjpye, Frank Munz and Matt Jones in Engineering Blog In this blog post, we will review the advancements in Spark Structured Streaming since we announced Project Lightspeed a year ago, from performance...
Project Lightspeed: Faster and Simpler Stream Processing With Apache SparkJune 28, 2022 by Karthik Ramasamy, Matei Zaharia, Reynold Xin, Michael Armbrust, Awez Syed, Ray Zhu, Alexander Balikov, Jerry Peng, Shrikanth Shankar and Sameer Paranjpye in Engineering Blog Streaming data is a critical area of computing today. It is the basis for making quick decisions on the enormous amounts of incoming...