How to Work with Avro, Kafka, and Schema Registry in Databricks
In the previous blog post , we introduced the new built-in Apache Avro data source in Apache Spark and explained how you can...
Near-Real-Time Hardware Failure Rate Estimation with Bayesian Reasoning
Try this notebook in Databricks You might be using Bayesian techniques in your data science without knowing it! And if you're not, then...
Announcing Databricks Runtime 5.2
We are excited to announce the release of Databricks Runtime 5.2 which introduces several new features including the following: Delta Time Travel Fast...
Accelerating Machine Learning on Databricks: On-Demand Webinar and FAQ Now Available!
Try this notebook in Databricks On January 15th, we hosted a live webinar— Accelerating Machine Learning on Databricks —with Adam Conway, VP of...
Databricks Runtime 5.2 ML Features Multi-GPU Workflow, Pregel API, and Performant GraphFrames
We are excited to announce the release of Databricks Runtime 5.2 for Machine Learning. This release includes several new features and performance improvements...
5 Reasons to Become an Apache Spark Expert
Apache Spark ™ has fast become the most popular unified analytics engine for big data and machine learning. It was originally developed at...
Apparate: Managing Libraries in Databricks with CI/CD
This is a guest blog from Hanna Torrence, Data Scientist at ShopRunner. Introduction As leveraging data becomes a more vital component of organizations'...
Kicking Off 2019 with an MLflow User Survey
It’s been six months since we launched MLflow , an open source platform to manage the machine learning lifecycle, and the project has...
Introducing Databricks Library Utilities for Notebooks
Databricks has introduced a new feature, Library Utilities for Notebooks, as part of Databricks Runtime version 5.1. It allows you to install and...
Introducing Databricks Runtime 5.1 for Machine Learning
Last week, we released Databricks Runtime 5.1 Beta for Machine Learning. As part of our commitment to provide developers with the latest deep...