Articles by Joseph Torres - Databricks Blog

Introducing Low-latency Continuous Processing Mode in Structured Streaming in Apache Spark 2.3

March 20, 2018 by Joseph Torres, Michael Armbrust, Tathagata Das and Shixiong Zhu in Open Source

Import this notebook on Databricks Structured Streaming in Apache Spark 2.0 decoupled micro-batch processing from its high-level APIs for a couple of reasons...

Introducing Stream-Stream Joins in Apache Spark 2.3

March 13, 2018 by Tathagata Das and Joseph Torres in Engineering Blog

Since we introduced Structured Streaming in Apache Spark 2.0 , it has supported joins (inner join and some type of outer joins) between...