Skip to main content
Jungtaek Lim

Jungtaek Lim

Jungtaek Lim's posts

Introducing Easier Change Data Capture in Apache Spark™ Structured Streaming

Solutions

January 27, 2025/6 min read

Announcing Simplified State Tracking in Apache Spark™ Structured Streaming

Announcing the State Reader API: The New "Statestore" Data Source

Data Engineering

March 28, 2024/10 min read

Announcing the State Reader API: The New "Statestore" Data Source

Introducing Apache Spark™ 3.5

Open Source

September 15, 2023/10 min read

Introducing Apache Spark™ 3.5

Multiple Stateful Operators in Structured Streaming

Data Engineering

August 6, 2023/11 min read

Multiple Stateful Operators in Structured Streaming

og image

Data Streaming

June 1, 2023/4 min read

Adaptive Query Execution in Structured Streaming

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Data Engineering

April 14, 2023/10 min read

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Python Arbitrary Stateful Processing in Structured Streaming

Data Engineering

October 17, 2022/6 min read

Python Arbitrary Stateful Processing in Structured Streaming

native-support-blog-og

Open Source

October 12, 2021/5 min read

Native Support of Session Window in Spark Structured Streaming