Skip to main content
Page 1

Introducing Databricks Library Utilities for Notebooks

January 8, 2019 by Srinath Shankar and Todd Greenstein in Announcements
Databricks has introduced a new feature, Library Utilities for Notebooks, as part of Databricks Runtime version 5.1. It allows you to install and...

Transparent Autoscaling of Instance Storage

December 1, 2017 by Greg Owen, Srinath Shankar and Prakash Chockalingam in Platform Blog
Big data workloads require access to disk space for a variety of operations, generally when intermediate results will not fit in memory. When...

Databricks Serverless: Next Generation Resource Management for Apache Spark

June 7, 2017 by Greg Owen, Eric Liang, Prakash Chockalingam and Srinath Shankar in Product
As the amount of data in an organization grows, more and more engineers, analysts and data scientists need to analyze this data using...

Transactional Writes to Cloud Storage on Databricks

May 31, 2017 by Eric Liang, Srinath Shankar and Bill Chambers in Platform Blog
In another blog post published today , we showed the top five reasons for choosing S3 over HDFS. With the dominance of simple...

Query Watchdog: Handling Disruptive Queries in Spark SQL

April 17, 2017 by Alicja Luszczak, Srinath Shankar and Bill Chambers in Product
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...