By Customer Demand: Databricks and Snowflake IntegrationAugust 27, 2018 by Brian Dirking, Bill Chambers and Harsha Kapre in Announcements Today, we are proud to announce a partnership between Snowflake and Databricks that will help our customers further unify Big Data and AI...
Databricks Delta: A Unified Data Management System for Real-time Big DataOctober 24, 2017 by Michael Armbrust, Bill Chambers and Matei Zaharia in Platform Blog Combining the best of data warehouses, data lakes and streaming For an in-depth look and demo, join the webinar . Today we are...
Arbitrary Stateful Processing in Apache Spark’s Structured StreamingOctober 17, 2017 by Bill Chambers and Jules Damji in Engineering Blog This is the seventh post in a multi-part series about how you can perform complex streaming analytics using Apache Spark and Structured Streaming...
Best Practices for Coarse Grained Data Security in DatabricksAugust 23, 2017 by Bill Chambers and Jules Damji in Platform Blog At Databricks, we work with hundreds of companies, all pushing the bleeding edge in their respective industries. We want to share patterns for...
Sharing Knowledge with the Community in a Preview of Apache Spark: The Definitive GuideJune 5, 2017 by Bill Chambers and Matei Zaharia in Announcements Apache Spark has seen immense growth over the past several years. The size and scale of this Spark Summit is a true reflection...
Transactional Writes to Cloud Storage on DatabricksMay 31, 2017 by Eric Liang, Srinath Shankar and Bill Chambers in Platform Blog In another blog post published today , we showed the top five reasons for choosing S3 over HDFS. With the dominance of simple...
Working with Nested Data Using Higher Order Functions in SQL on DatabricksMay 24, 2017 by Herman van Hövell and Bill Chambers in Product View this notebook on Databricks Nested data types offer Databricks customers and Apache Spark users powerful ways to manipulate structured data. In particular...
Taking Apache Spark’s Structured Streaming to ProductionMay 18, 2017 by Bill Chambers and Michael Lumb in Engineering Blog This is the fifth post in a multi-part series about how you can perform complex streaming analytics using Apache Spark. At Databricks, we’ve...
Query Watchdog: Handling Disruptive Queries in Spark SQLApril 17, 2017 by Alicja Luszczak, Srinath Shankar and Bill Chambers in Product Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Databricks Launches a Comprehensive Guide for Its Product and Apache SparkNovember 10, 2016 by Bill Chambers in Company Blog We are proud to announce the launch of a new online guide for Databricks and Apache Spark at docs.databricks.com . Our goal is...