Skip to main content
Herman van Hövell

Herman van Hövell

Herman van Hövell's posts

Apache Spark 4.0

Open Source

May 28, 2025/10 min read

Introducing Apache Spark 4.0

Unity Catalog Lakeguard - Data Governance for multi-user Apache Spark Clusters

Platform & Products & Announcements

April 24, 2024/5 min read

Unity Catalog Lakeguard: Industry-first and only data governance for multi-user Apache Spark™ clusters

Introducing Apache Spark™ 3.5

Open Source

September 15, 2023/10 min read

Introducing Apache Spark™ 3.5

Shared Clusters in Unity Catalog

Open Source

September 4, 2023/5 min read

Shared Clusters in Unity Catalog for the win: Introducing Cluster Libraries, Python UDFs, Scala, Machine Learning and more

Announcing the general availability of Spark Connect in Apache Spark 3.4

Open Source

April 18, 2023/6 min read

Spark Connect Available in Apache Spark 3.4

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

Data Engineering

April 14, 2023/10 min read

Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0

db-263-blog-img-og

Announcements

July 22, 2022/5 min read

Power to the SQL People: Introducing Python UDFs in Databricks SQL

db-254-blog-img-og

Open Source

July 7, 2022/4 min read

Introducing Spark Connect - The Power of Apache Spark, Everywhere

Adaptive Query Execution: Speeding Up Spark SQL at Runtime

Solutions

May 29, 2020/7 min read

Adaptive Query Execution: Speeding Up Spark SQL at Runtime

Data Intelligence Platforms

Open Source

November 16, 2018/4 min read

Introducing New Built-in and Higher-Order Functions for Complex Data Types in Apache Spark 2.4

Data Intelligence Platforms

Product

May 24, 2017/8 min read

Working with Nested Data Using Higher Order Functions in SQL on Databricks

Data Intelligence Platforms

Open Source

June 17, 2016/Less than a minute

SQL Subqueries in Apache Spark 2.0