Top 5 Reasons for Choosing S3 over HDFS
At Databricks, our engineers guide thousands of organizations to define their big data and cloud strategies. When migrating big data workloads to the...
Bay Area Apache Spark Meetup Summary
On May 16, we held our monthly Bay Area Apache Spark Meetup (BASM) at SalesforceIQ in Palo Alto. In all, we had three...
Working with Nested Data Using Higher Order Functions in SQL on Databricks
View this notebook on Databricks Nested data types offer Databricks customers and Apache Spark users powerful ways to manipulate structured data. In particular...
Databricks Runtime 3.0 Beta Delivers Cloud Optimized Apache Spark
A major value Databricks provides is the automatic provisioning, configuration, and tuning of clusters of machines that process data. Running on these machines...
Persistent Clusters: Simplifying Cluster Management for Analytics
Today we are excited to announce persistent clusters for analytics in Databricks. With persistent clusters, users no longer need to go through the...
Query Watchdog: Handling Disruptive Queries in Spark SQL
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Take Reports From Concept to Production with PySpark and Databricks
Introduction: What is MediaMath? MediaMath is a demand-side media buying and data management platform. This means that brands and ad agencies can use...
Delivering a Personalized Shopping Experience with Apache Spark on Databricks
This is a guest blog from our friends at Dollar Shave Club. Dollar Shave Club (DSC) is a men's lifestyle brand and e-commerce...
The Tenth Spark Summit with a Terrific Agenda for All
The number 10 is often used as a measuring yardstick to denote achievement, attainment or accomplishment: the 10th anniversary; a perfect score of...
How Apache Spark on Databricks is Taming the Wild West of Wi-Fi
iPass is the world’s largest Wi-Fi provider, yet we don’t own a single hotspot. You can think of us as the Uber of...