By Customer Demand: Databricks and Snowflake Integration
Today, we are proud to announce a partnership between Snowflake and Databricks that will help our customers further unify Big Data and AI…
Databricks Delta: A Unified Data Management System for Real-time Big Data
Combining the best of data warehouses, data lakes and streaming For an in-depth look and demo, join the webinar. Today we are proud…
Arbitrary Stateful Processing in Apache Spark’s Structured Streaming
This is the seventh post in a multi-part series about how you can perform complex streaming analytics using Apache Spark and Structured Streaming.…
Best Practices for Coarse Grained Data Security in Databricks
At Databricks, we work with hundreds of companies, all pushing the bleeding edge in their respective industries. We want to share patterns for…
Sharing Knowledge with the Community in a Preview of Apache Spark: The Definitive Guide
Apache Spark has seen immense growth over the past several years. The size and scale of this Spark Summit is a true reflection…
Transactional Writes to Cloud Storage on Databricks
In another blog post published today, we showed the top five reasons for choosing S3 over HDFS. With the dominance of simple and…
Working with Nested Data Using Higher Order Functions in SQL on Databricks
Nested data types offer Databricks customers and Apache Spark users powerful ways to manipulate structured data. In particular, they allow you to put…
Taking Apache Spark’s Structured Streaming to Production
This is the fifth post in a multi-part series about how you can perform complex streaming analytics using Apache Spark. At Databricks, we’ve…
Query Watchdog: Handling Disruptive Queries in Spark SQL
At Databricks, our users range from SQL Analysts who explore data through JDBC connections and SQL Notebooks to Data Engineers orchestrating large scale…
Databricks Launches a Comprehensive Guide for Its Product and Apache Spark
We are proud to announce the launch of a new online guide for Databricks and Apache Spark at docs.databricks.com. Our goal is to…
