Introducing New Built-in and Higher-Order Functions for Complex Data Types in Apache Spark 2.4 – Databricks