5 Reasons to Become an Apache Spark Expert
Apache Spark ™ has fast become the most popular unified analytics engine for big data and machine learning. It was originally developed at...
Apparate: Managing Libraries in Databricks with CI/CD
This is a guest blog from Hanna Torrence, Data Scientist at ShopRunner. Introduction As leveraging data becomes a more vital component of organizations'...
Kicking Off 2019 with an MLflow User Survey
It’s been six months since we launched MLflow , an open source platform to manage the machine learning lifecycle, and the project has...
Introducing Databricks Library Utilities for Notebooks
Databricks has introduced a new feature, Library Utilities for Notebooks, as part of Databricks Runtime version 5.1. It allows you to install and...
Announcing Databricks Runtime 5.1
We are excited to announce the release of Databricks Runtime 5.1. This release includes several new features, performance and quality improvements. We highly...
Introducing Databricks Runtime 5.1 for Machine Learning
Last week, we released Databricks Runtime 5.1 Beta for Machine Learning. As part of our commitment to provide developers with the latest deep...
A Guide to AI, Machine Learning, and Deep Learning Talks at Spark + AI 2019
To a good degree, this back-of-the-envelope flowchart, by Karen Hao of MIT Technology Review , charts to elucidate what constitutes the use of...
Introducing Built-in Image Data Source in Apache Spark 2.4
Introduction With recent advances in deep learning frameworks for image classification and object detection, the demand for standard image processing in Apache Spark...
CIO Survey: Top 3 Challenges Adopting AI and How to Overcome Them
We recently hosted the webinar — CIO Survey: Enterprise Challenges to AI and How to Overcome Them — featuring Jen Garofalo, Research Director...
Apache Avro as a Built-in Data Source in Apache Spark 2.4
Try this notebook in Databricks Apache Avro is a popular data serialization format. It is widely used in the Apache Spark and Apache...