Improving Threat Detection in a Big Data World
High-profile cybersecurity breaches dominated headlines in 2017. In the first half of the year, over 1.9B records were stolen . That’s more than...
Transparent Autoscaling of Instance Storage
Big data workloads require access to disk space for a variety of operations, generally when intermediate results will not fit in memory. When...
Databricks Achieves AWS Machine Learning Competency Status
Today we announced that Amazon has awarded Databricks with the Amazon Web Services (AWS) Machine Learning (ML) Competency status. This designation recognizes Databricks...
Women in Big Data, Apache Spark and AI: Bay Area Spark Meetup at Databricks Summary
When Fei-Fei Li , the director of Stanford’s AI Lab and now a chief scientist at Google Cloud, was asked in an interview...
Cloud-based Relational Database Management Systems at Databricks
Databricks and Microsoft have jointly developed a new cloud service called Microsoft Azure Databricks , which makes Apache Spark analytics fast, easy, and...
A Technical Overview of Azure Databricks
This is a joint blog post from Matei Zaharia, Chief Technologist at Databricks and Peter Carlin, Distinguished Engineer at Microsoft. Today at Microsoft...
Introducing Azure Databricks
99% of organizations still struggle to get valuable analytics from their Big Data and achieve the full potential of AI. Today I’m excited...
Introducing Command Line Interface for Databricks Developers
Introduction As part of Unified Analytics Platform , Databricks Workspace along with Databricks File System (DBFS) are critical components that facilitate collaboration among...
What AWS Per-Second Billing Means for Big Data Processing
Databricks, the Unified Analytics Platform, has always been a cloud-first platform. We believe in the scalability and elasticity of the cloud so that...
Spark Summit EU 2017 Recap and Reflections
“Dublin is now a truly cosmopolitan capital, with an influx of people, energy, and ideas infusing the ever-beguiling, multi-layered city with fresh flavors...