Introducing Built-in Image Data Source in Apache Spark 2.4
Introduction With recent advances in deep learning frameworks for image classification and object detection, the demand for standard image processing in Apache Spark...
Apache Avro as a Built-in Data Source in Apache Spark 2.4
Try this notebook in Databricks Apache Avro is a popular data serialization format. It is widely used in the Apache Spark and Apache...
Introducing Databricks Runtime 5.0 for Machine Learning
Six months ago we introduced the Databricks Runtime for Machine Learning with the goal of making machine learning performant and easy on the...
MLflow v0.8.0 Features Improved Experiment UI and Deployment Tools
Last week we released MLflow v0.8.0 with multiple new features, including improved UI experience and support for deploying models directly via Docker containers...
Introducing HorovodRunner for Distributed Deep Learning Training
Today, we are excited to introduce HorovodRunner in our Databricks Runtime 5.0 ML ! HorovodRunner provides a simple way to scale up your...
Announcing Databricks Runtime 5.0
We’re excited to announce the general availability of Databricks Runtime 5.0. Included in this release is Spark 2.4 . This release offers substantial...
Introducing New Built-in and Higher-Order Functions for Complex Data Types in Apache Spark 2.4
Try this notebook in Databricks Apache Spark 2.4 introduces 29 new built-in functions for manipulating complex types (for example, array type), including higher-order...
Applying your Convolutional Neural Network: On-Demand Webinar and FAQ Now Available!
Try this notebook in Databricks On October 25th, we hosted a live webinar— Applying your Convolutional Neural Network —with Denny Lee, Technical Product...
Open Sourcing Databricks Integration Tools at Edmunds
This is a guest post from Shaun Elliott, Data Engineering Tech Lead and Sam Shuster, Staff Engineer at Edmunds. What is Databricks and...
Introducing Apache Spark 2.4
UPDATED: 11/19/2018 We are excited to announce the availability of Apache Spark 2.4 on Databricks as part of the Databricks Runtime 5.0...