Now Generally Available: Simplify Data and Machine Learning Pipelines With Jobs OrchestrationNovember 1, 2021 by Roland Fäustlin in Platform Blog We are excited to announce the general availability of Jobs orchestration , a new capability that lets Databricks customers easily build data and...
Introducing SQL User-Defined FunctionsOctober 20, 2021 by Serge Rielau and Allison Wang in Platform Blog A user-defined function (UDF) is a means for a user to extend the native capabilities of Apache Spark™ SQL. SQL on Databricks has...
Databricks Repos Is Now Generally Available - New ‘Files’ Feature in Public PreviewOctober 7, 2021 by Ka-Hing Cheung and Vaibhav Sethi in Platform Blog Thousands of Databricks customers have adopted Databricks Repos since its public preview and have standardized on it for their development and production workflows...
Databricks SQL: Delivering a Production SQL Development Experience on the Data LakeSeptember 30, 2021 by Miranda Luna and Cyrielle Simeone in Platform Blog Databricks SQL is now generally available on AWS and Azure. Databricks SQL (DB SQL) is a simple and powerful SQL analytics platform for...
Part 1: Implementing CI/CD on Databricks Using Databricks Notebooks and Azure DevOpsSeptember 20, 2021 by Michael Shtelma and Piotr Majer in Platform Blog Discussed code can be found here . This is the first part of a two-part series of blog posts that show how to...
Announcing Public Preview of Low Shuffle MergeSeptember 8, 2021 by Himanshu Raja in Platform Blog Today, we are excited to announce the public preview of Low Shuffle Merge in Delta Lake , available on AWS, Azure, and Google...
5 Steps to Implementing Intelligent Data Pipelines With Delta Live TablesSeptember 8, 2021 by Awez Syed and Amit Kara in Platform Blog Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake Many IT organizations are...
New Performance Improvements in Databricks SQLSeptember 8, 2021 by Reynold Xin, Can Efeoglu and Cyrielle Simeone in Platform Blog Databricks SQL is now generally available on AWS and Azure. Originally announced at Data + AI Summit 2020 Europe, Databricks SQL lets you...
Implementing More Effective FAIR Scientific Data Management With a LakehouseSeptember 7, 2021 by Greg Wood and Amir Kermany in Platform Blog Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Announcing the Launch of Delta Live Tables on Google CloudSeptember 2, 2021 by Awez Syed and Sam Steiny in Platform Blog Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. Today, we are excited...