Skip to main content
Xinrong Meng

Xinrong Meng

Xinrong Meng's posts

PySpark UDF Unified Profiling

Open Source

June 9, 2025/4 min read

PySpark Native Plotting

PySpark UDF Unified Profiling

Open Source

June 9, 2025/3 min read

PySpark UDF Unified Profiling

PySpark in 2023: A Year in Review

Data Engineering

March 25, 2024/5 min read

PySpark in 2023: A Year in Review

Arrow-optimized Python UDFs in Apache Spark™ 3.5

Data Engineering

November 6, 2023/4 min read

Arrow-optimized Python UDFs in Apache Spark™ 3.5

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Data Engineering

April 14, 2023/10 min read

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Memory Profiling in PySpark

Data Engineering

November 30, 2022/4 min read

Memory Profiling in PySpark

How to Profile PySpark

Open Source

October 6, 2022/4 min read

How to Profile PySpark

pandas-api-blog-og

Open Source

October 4, 2021/5 min read

Pandas API on Upcoming Apache Spark™ 3.2

koalas-pyspark-dask-blog-og-img

Open Source

April 7, 2021/8 min read

Benchmark: Koalas (PySpark) and Dask

python-autocomplete-og

Open Source

December 15, 2020/4 min read

Python Autocomplete Improvements for Databricks Notebooks