Unity Catalog Lakeguard: Industry-first and only data governance for multi-user Apache Spark™ clustersApril 24, 2024 by Stefania Leone, Martin Grund, Herman van Hövell, Reynold Xin and Matei Zaharia in Platform & Products & Announcements We are thrilled to announce Unity Catalog Lakeguard , which allows you to run Apache Spark™ workloads in SQL, Python, and Scala with...
Bringing the Lakehouse to R developers: Databricks Connect now available in sparklyrDecember 13, 2023 by Rafi Kurlansik, Vladislav Mantic-Lugo and Stefania Leone in Partners We’re excited to announce that the latest release of sparklyr on CRAN introduces support for Databricks Connect . R users now have seamless...
Shared Clusters in Unity Catalog for the win: Introducing Cluster Libraries, Python UDFs, Scala, Machine Learning and more September 4, 2023 by Jakob Mund, Stefania Leone, Martin Grund, Herman van Hövell, Andrew Li and Sven Wagner-Boysen in Engineering Blog We are thrilled to announce that you can run even more workloads on Databricks’ highly efficient multi-user clusters thanks to new security and...
Spark Connect Available in Apache Spark 3.4April 18, 2023 by Allan Folting, Hyukjin Kwon, Xiao Li, Herman van Hövell, Stefania Leone, Martin Grund, Reynold Xin and Kris Mo in Engineering Blog Last year Spark Connect was introduced at the Data and AI Summit. As part of the recently released Apache SparkTM 3.4, Spark Connect...
Use Databricks from anywhere with Databricks Connect “v2”April 18, 2023 by Stefania Leone, Martin Grund, Vladislav Mantic-Lugo and Niranjan Jayakar in Platform Blog We are thrilled to announce the public preview of Databricks Connect "v2", which enables developers to use the power of Databricks from any...
Power to the SQL People: Introducing Python UDFs in Databricks SQLJuly 22, 2022 by Martin Grund, Herman van Hövell, Stefania Leone and Jakob Mund in Platform Blog We were thrilled to announce the preview for Python User-Defined Functions (UDFs) in Databricks SQL (DBSQL) at last month's Data and AI Summit...
Introducing Spark Connect - The Power of Apache Spark, EverywhereJuly 7, 2022 by Stefania Leone, Martin Grund, Herman van Hövell and Reynold Xin in Engineering Blog At last week's Data and AI Summit, we highlighted a new project called Spark Connect in the opening keynote. This blog post walks...
How We Achieved High-bandwidth Connectivity With BI ToolsAugust 11, 2021 by Bogdan Ionut Ghit, Juliusz Sompolski, Stefania Leone and Reynold Xin in Platform Blog Databricks SQL is now generally available on AWS and Azure. Business Intelligence (BI) tools such as Tableau and Microsoft Power BI are notoriously...
Women in Product at DatabricksJune 7, 2021 by Allie Emrich, Stephanie Liu, Stefania Leone, Anna Shrestinian, Noa Braun, Ginny Wood and Miranda Luna in Company Blog Databricks was a proud sponsor of the 2021 Women In Product Conference , which this year, had a theme of igniting possibility...
Improved Tableau Databricks Connector With Azure AD Authentication SupportMay 7, 2021 by Stefania Leone, Christian Stuart and Bogdan Ghit in Partners With the release of Tableau 2021.1, we have added new functionality to the Tableau Databricks Connector that simplifies security administration and streamlines...