Working with Nested Data Using Higher Order Functions in SQL on Databricks
View this notebook on Databricks Nested data types offer Databricks customers and Apache Spark users powerful ways to manipulate structured data. In particular...
Databricks Runtime 3.0 Beta Delivers Cloud Optimized Apache Spark
A major value Databricks provides is the automatic provisioning, configuration, and tuning of clusters of machines that process data. Running on these machines...
Persistent Clusters: Simplifying Cluster Management for Analytics
Today we are excited to announce persistent clusters for analytics in Databricks. With persistent clusters, users no longer need to go through the...
Detecting Abuse at Scale: Locality Sensitive Hashing at Uber Engineering
This is a cross blog post effort between Databricks and Uber Engineering. Yun Ni is a software engineer on Uber’s Machine Learning Platform...
Query Watchdog: Handling Disruptive Queries in Spark SQL
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Delivering a Personalized Shopping Experience with Apache Spark on Databricks
This is a guest blog from our friends at Dollar Shave Club. Dollar Shave Club (DSC) is a men's lifestyle brand and e-commerce...
The Tenth Spark Summit with a Terrific Agenda for All
The number 10 is often used as a measuring yardstick to denote achievement, attainment or accomplishment: the 10th anniversary; a perfect score of...
Analyse One Year of Radio Station Songs Aired with Apache Spark, Spark SQL, Spotify, and Databricks
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
How Apache Spark on Databricks is Taming the Wild West of Wi-Fi
iPass is the world’s largest Wi-Fi provider, yet we don’t own a single hotspot. You can think of us as the Uber of...
Anonymizing Datasets at Scale Leveraging Databricks Interoperability
A key challenge for data-driven companies across a wide range of industries is how to leverage the benefits of analytics at scale when...