Apache Avro as a Built-in Data Source in Apache Spark 2.4
Try this notebook in Databricks Apache Avro is a popular data serialization format. It is widely used in the Apache Spark and Apache...
Is your AI software vendor taking security shortcuts?
This is the final part of our blog series on security available here . In this blog, I will be talking about our...
Databricks Shows off AWS Competencies at AWS re:Invent
Powering innovation on AWS in life sciences, public sector, machine learning, and big data analytics. Databricks, founded by the original creators of Apache...
Introducing Databricks Runtime 5.0 for Machine Learning
Six months ago we introduced the Databricks Runtime for Machine Learning with the goal of making machine learning performant and easy on the...
Preliminary Agenda Announced for Spark + AI Summit 2019
As part of the organizing committee and program chairs for this summit, we are delighted to share two achievements with you. First, we...
MLflow v0.8.0 Features Improved Experiment UI and Deployment Tools
Last week we released MLflow v0.8.0 with multiple new features, including improved UI experience and support for deploying models directly via Docker containers...
Are you ready to scale your Data and AI initiatives? How will you scale your security?
This is Blog #3 in a series of blog posts about Databricks security. My colleagues David Cook (our CISO) and David Meyer (SVP...
Introducing HorovodRunner for Distributed Deep Learning Training
Today, we are excited to introduce HorovodRunner in our Databricks Runtime 5.0 ML ! HorovodRunner provides a simple way to scale up your...
Announcing Databricks Runtime 5.0
We’re excited to announce the general availability of Databricks Runtime 5.0. Included in this release is Spark 2.4 . This release offers substantial...
MongoDB Atlas: Connector for Apache Spark now Officially Certified for Azure Databricks
This is a guest blog from our partners at MongoDB Bryan Reinero and Dana Groce We are happy to announce that the MongoDB...