Articles by Joseph Torres - The Databricks Blog

Introducing Low-latency Continuous Processing Mode in Structured Streaming in Apache Spark 2.3

March 20, 2018 by Joseph Torres , Michael Armbrust , Tathagata Das and Shixiong Zhu in Data Engineering

Structured Streaming in Apache Spark 2.0 decoupled micro-batch processing from its high-level APIs for a couple of reasons. First, it made developer’s experience…

Introducing Stream-Stream Joins in Apache Spark 2.3

March 13, 2018 by Tathagata Das and Joseph Torres in Engineering Blog

Since we introduced Structured Streaming in Apache Spark 2.0, it has supported joins (inner join and some type of outer joins) between a…

Categories

Introducing Low-latency Continuous Processing Mode in Structured Streaming in Apache Spark 2.3

Introducing Stream-Stream Joins in Apache Spark 2.3

Sign up