3 Things CISO’s expect from Tech Companies in a Cloudy World
Adding new software to an enterprise is a difficult process. In the past, choosing new software only required budget approval before it could...
A Summer of Personal and Professional Growth at Databricks
This summer, I worked at Databricks as a software engineering intern on the Growth team. By introducing two new features, user groups and...
Best Practices for Coarse Grained Data Security in Databricks
At Databricks, we work with hundreds of companies, all pushing the bleeding edge in their respective industries. We want to share patterns for...
Apache Spark’s Structured Streaming with Amazon Kinesis on Databricks
On July 11, 2017, we announced the general availability of Apache Spark 2.2.0 as part of Databricks Runtime 3.0 (DBR) for the Unified...
Databricks Named as a Strong Performer in The Forrester Wave: Insight Platforms-as-a-Service, Q3 2017
Forrester recently published The Forrester Wave: Insight Platforms-as-a-Service Wave, Q3 2017 . In its 36-criteria evaluation of insight platform-as-a-service (PaaS) providers, Forrester identified...
On-Demand Webinar and FAQ: Accelerate Data Science with Better Data Engineering on Databricks
On July 13th, we hosted a live webinar — Accelerate Data Science with Better Data Engineering on Databricks . This webinar focused on...
Serverless Continuous Delivery with Databricks and AWS CodePipeline
Two characteristics commonly mark many companies' success. First, they quickly adapt to new technology. Second, as a result, they gain technological leadership and...
4 SQL High-Order and Lambda Functions to Examine Complex and Structured Data in Databricks
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Shell Oil Use Case: Parallelizing Large Simulations with Apache SparkR on Databricks
This blog post is a joint engineering effort between Shell’s Data Science Team ( Wayne W. Jones and Dennis Vallinga ) and Databricks...
Managing and Securing Credentials in Databricks for Apache Spark Jobs
Since Apache Spark separates compute from storage, every Spark Job requires a set of credentials to connect to disparate data sources. Storing those...