Skip to main content
Hyukjin Kwon

Hyukjin Kwon

Hyukjin Kwon's posts

PySpark in 2023: A Year in Review

Data Engineering

March 25, 2024/5 min read

PySpark in 2023: A Year in Review

Data Intelligence Platforms

Open Source

January 3, 2024/6 min read

Parameterized queries with PySpark

Python Dependency Management in Spark Connect

Data Engineering

November 13, 2023/4 min read

Python Dependency Management in Spark Connect

Arrow-optimized Python UDFs in Apache Spark™ 3.5

Data Engineering

November 6, 2023/4 min read

Arrow-optimized Python UDFs in Apache Spark™ 3.5

Introducing Apache Spark™ 3.5

Open Source

September 15, 2023/10 min read

Introducing Apache Spark™ 3.5

Announcing the general availability of Spark Connect in Apache Spark 3.4

Open Source

April 18, 2023/6 min read

Spark Connect Available in Apache Spark 3.4

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Data Engineering

April 14, 2023/10 min read

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Python Arbitrary Stateful Processing in Structured Streaming

Data Engineering

October 17, 2022/6 min read

Python Arbitrary Stateful Processing in Structured Streaming

How to Profile PySpark

Open Source

October 6, 2022/4 min read

How to Profile PySpark

db-209-blog-img-og

Open Source

June 15, 2022/4 min read

Introducing Apache Spark™ 3.3 for Databricks Runtime 11.0

PySpark

Open Source

May 27, 2022/7 min read

How to Monitor Streaming Queries in PySpark

apache-spark-32-og

Open Source

October 19, 2021/5 min read

Introducing Apache Spark™ 3.2