Skip to main content
Allan Folting

Allan Folting

Allan Folting's posts

pyhton

Data Engineering

November 7, 2023/5 min read

Introducing Python User-Defined Table Functions (UDTFs)

Arrow-optimized Python UDFs in Apache Spark™ 3.5

Data Engineering

November 6, 2023/4 min read

Arrow-optimized Python UDFs in Apache Spark™ 3.5

Introducing Apache Spark™ 3.5

Open Source

September 15, 2023/10 min read

Introducing Apache Spark™ 3.5

Announcing the general availability of Spark Connect in Apache Spark 3.4

Open Source

April 18, 2023/6 min read

Spark Connect Available in Apache Spark 3.4

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Data Engineering

April 14, 2023/10 min read

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Memory Profiling in PySpark

Data Engineering

November 29, 2022/4 min read

Memory Profiling in PySpark

How to Profile PySpark

Open Source

October 6, 2022/4 min read

How to Profile PySpark